1351-1400 of 10000 results (82ms)
2023-08-01 ยง
08:33 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] (duration: 10m 52s) [production]
08:30 <elukey@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
08:29 <elukey@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync [production]
08:27 <urbanecm@deploy1002> sgimeno and urbanecm: Continuing with sync [production]
08:24 <urbanecm@deploy1002> sgimeno and urbanecm: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
08:22 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] [production]
08:22 <moritzm> installing Linux 4.19.289 on Buster hosts [production]
08:17 <elukey@deploy1002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
08:17 <elukey@deploy1002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: sync [production]
07:49 <elukey@deploy1002> helmfile [eqiad] DONE helmfile.d/services/changeprop: sync [production]
07:49 <elukey@deploy1002> helmfile [eqiad] START helmfile.d/services/changeprop: sync [production]
07:44 <elukey@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop: sync [production]
07:44 <elukey@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop: sync [production]
07:41 <elukey@deploy1002> helmfile [staging] DONE helmfile.d/services/changeprop: sync [production]
07:41 <elukey@deploy1002> helmfile [staging] START helmfile.d/services/changeprop: sync [production]
07:37 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 732 hosts [production]
07:37 <root@cumin2002> START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 732 hosts [production]
07:37 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 24 hosts [production]
07:37 <root@cumin2002> START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 24 hosts [production]
07:37 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 1277 hosts [production]
07:36 <root@cumin2002> START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 1277 hosts [production]
07:07 <elukey@deploy1002> helmfile [eqiad] DONE helmfile.d/services/changeprop: sync [production]
07:07 <elukey@deploy1002> helmfile [eqiad] START helmfile.d/services/changeprop: sync [production]
06:54 <elukey@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop: sync [production]
06:54 <elukey@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop: sync [production]
06:24 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-jumbo-eqiad cluster: Roll restart of jvm daemons. [production]
05:48 <kart_> cxserver: Remove Youdao MT service (T329137) [production]
05:46 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
05:45 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
05:41 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
05:41 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
05:36 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
05:36 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
05:26 <kart_> Updated cxserver to 2023-07-13-063245-production (T340953) [production]
05:24 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
05:23 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
05:18 <marostegui> dbmaint s4 testcommonswiki eqiad T343174 [production]
05:16 <marostegui> dbmaint s4 labswiki (wikitech) eqiad T343175 [production]
05:15 <marostegui> dbmaint s4 testcommonswiki eqiad T343175 [production]
05:12 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
05:12 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
05:07 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
05:06 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
03:57 <mwpresync@deploy1002> Pruned MediaWiki: 1.41.0-wmf.18 (duration: 02m 09s) [production]
03:54 <mwpresync@deploy1002> Finished scap: testwikis wikis to 1.41.0-wmf.20 refs T340248 (duration: 52m 06s) [production]
03:02 <mwpresync@deploy1002> Started scap: testwikis wikis to 1.41.0-wmf.20 refs T340248 [production]
02:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T342617)', diff saved to https://phabricator.wikimedia.org/P49867 and previous config saved to /var/cache/conftool/dbconfig/20230801-023010-ladsgroup.json [production]
02:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P49866 and previous config saved to /var/cache/conftool/dbconfig/20230801-021504-ladsgroup.json [production]
01:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P49865 and previous config saved to /var/cache/conftool/dbconfig/20230801-015958-ladsgroup.json [production]
01:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T342617)', diff saved to https://phabricator.wikimedia.org/P49864 and previous config saved to /var/cache/conftool/dbconfig/20230801-014452-ladsgroup.json [production]