3201-3250 of 10000 results (49ms)
2022-01-18 §
08:32 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host pc1012.eqiad.wmnet with OS bullseye [production]
08:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
08:30 <marostegui@deploy1002> Synchronized wmf-config/ProductionServices.php: Promote pc1014 to master in pc2 T299046 (duration: 00m 51s) [production]
08:20 <Amir1> cleaning up commons linter errors T298782 [production]
08:17 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
08:13 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
08:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
08:12 <ladsgroup@deploy1002> Synchronized php-1.38.0-wmf.17/extensions/Linter/includes/RecordLintJob.php: Backport: [[gerrit:754144|Drop 'inline-media-caption' lint requests (T297443 T299302)]] (duration: 00m 52s) [production]
08:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
07:36 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1014.eqiad.wmnet with OS bullseye [production]
07:09 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host pc1014.eqiad.wmnet with OS bullseye [production]
06:34 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host pc1014.eqiad.wmnet with OS bullseye [production]
06:23 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host pc1014.eqiad.wmnet with OS bullseye [production]
06:13 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host pc1014.eqiad.wmnet with OS bullseye [production]
06:02 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host pc1014.eqiad.wmnet with OS bullseye [production]
05:58 <kart_> Update apertium to 2022-01-18-052631-production (T218184, T202276, T218184, T270061, T248653, T248293, T248812, T248654) [production]
05:56 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/apertium: sync on production [production]
05:54 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/apertium: apply on staging [production]
05:54 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/apertium: apply on production [production]
05:54 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/apertium: apply on staging [production]
05:54 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/apertium: apply on production [production]
05:53 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/apertium: sync on production [production]
05:51 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/apertium: apply on staging [production]
05:51 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/apertium: apply on production [production]
05:49 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/apertium: sync on staging [production]
05:49 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/apertium: apply on production [production]
05:49 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/apertium: apply on staging [production]
05:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove watchlist group from s3 eqiad T263127', diff saved to https://phabricator.wikimedia.org/P18764 and previous config saved to /var/cache/conftool/dbconfig/20220118-054659-marostegui.json [production]
02:54 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
02:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
02:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
02:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
02:36 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
02:29 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
02:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
02:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
2022-01-17 §
23:27 <jynus> forced session revocation on phab for a user T299315 [production]
20:48 <aqu@deploy1002> Finished deploy [airflow-dags/analytics-test@27a4f7a]: (no justification provided) (duration: 00m 02s) [production]
20:48 <aqu@deploy1002> Started deploy [airflow-dags/analytics-test@27a4f7a]: (no justification provided) [production]
18:47 <krinkle@deploy1002> Finished deploy [integration/docroot@1621c26]: (no justification provided) (duration: 01m 14s) [production]
18:46 <krinkle@deploy1002> Started deploy [integration/docroot@1621c26]: (no justification provided) [production]
16:30 <moritzm> installing python-virtualenv bugfix updates from bullseye 11.2 point release [production]
16:21 <moritzm> installing wget bugfix updates from bullseye 11.2 point release [production]
16:13 <moritzm> installing freeipmi bugfix updates from bullseye 11.2 point release [production]
16:02 <moritzm> installing curl bugfix updates from bullseye 11.2 point release [production]
15:54 <mutante> mw1414,mw1415,mw1416,mw1417,mw1418,mw1447,mw1448,mw1449,mw1450,mw1437,mw1438 (all canaries eqiad) - apt-get remove --purge fonts*; apt-get remove --purge xfonts* (T294378) [production]
15:46 <mutante> parse2001, parse2002, wtp1025, wtp1026 (all parsoid canaries - apt-get remove --purge fonts*; apt-get remove --purge xfonts* (T294378) [production]
15:40 <mutante> mw2278, mw2279, mw2374, mw2376 (API and jobrunner canaries codfw) - apt-get remove --purge fonts*; apt-get remove --purge xfonts* (T294378) [production]
15:34 <mutante> mw2271, mw2272, mw2251, mw2252 (appserver and API canaries codfw) - apt-get remove --purge fonts*; apt-get remove --purge xfonts* (T294378) [production]
15:01 <btullis@cumin1001> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM an-airflow1003.eqiad.wmnet [production]