|
2023-08-01
ยง
|
| 08:40 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reimage for host analytics1077.eqiad.wmnet with OS bullseye |
[production] |
| 08:38 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reimage for host analytics1076.eqiad.wmnet with OS bullseye |
[production] |
| 08:33 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] (duration: 10m 52s) |
[production] |
| 08:30 |
<elukey@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 08:29 |
<elukey@deploy1002> |
helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 08:27 |
<urbanecm@deploy1002> |
sgimeno and urbanecm: Continuing with sync |
[production] |
| 08:24 |
<urbanecm@deploy1002> |
sgimeno and urbanecm: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) |
[production] |
| 08:22 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:940347|GrowthExperiments: enable AddLink task frontend in 10th round of wikis (T308135)]] |
[production] |
| 08:22 |
<moritzm> |
installing Linux 4.19.289 on Buster hosts |
[production] |
| 08:17 |
<elukey@deploy1002> |
helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 08:17 |
<elukey@deploy1002> |
helmfile [staging] START helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 07:49 |
<elukey@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: sync |
[production] |
| 07:49 |
<elukey@deploy1002> |
helmfile [eqiad] START helmfile.d/services/changeprop: sync |
[production] |
| 07:44 |
<elukey@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/changeprop: sync |
[production] |
| 07:44 |
<elukey@deploy1002> |
helmfile [codfw] START helmfile.d/services/changeprop: sync |
[production] |
| 07:41 |
<elukey@deploy1002> |
helmfile [staging] DONE helmfile.d/services/changeprop: sync |
[production] |
| 07:41 |
<elukey@deploy1002> |
helmfile [staging] START helmfile.d/services/changeprop: sync |
[production] |
| 07:37 |
<root@cumin2002> |
END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 732 hosts |
[production] |
| 07:37 |
<root@cumin2002> |
START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 732 hosts |
[production] |
| 07:37 |
<root@cumin2002> |
END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 24 hosts |
[production] |
| 07:37 |
<root@cumin2002> |
START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 24 hosts |
[production] |
| 07:37 |
<root@cumin2002> |
END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Nmaphophe out of all services on: 1277 hosts |
[production] |
| 07:36 |
<root@cumin2002> |
START - Cookbook sre.idm.logout Logging Nmaphophe out of all services on: 1277 hosts |
[production] |
| 07:07 |
<elukey@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: sync |
[production] |
| 07:07 |
<elukey@deploy1002> |
helmfile [eqiad] START helmfile.d/services/changeprop: sync |
[production] |
| 06:54 |
<elukey@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/changeprop: sync |
[production] |
| 06:54 |
<elukey@deploy1002> |
helmfile [codfw] START helmfile.d/services/changeprop: sync |
[production] |
| 06:24 |
<elukey@cumin1001> |
START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-jumbo-eqiad cluster: Roll restart of jvm daemons. |
[production] |
| 05:48 |
<kart_> |
cxserver: Remove Youdao MT service (T329137) |
[production] |
| 05:46 |
<kartik@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:45 |
<kartik@deploy1002> |
helmfile [eqiad] START helmfile.d/services/cxserver: apply |
[production] |
| 05:41 |
<kartik@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:41 |
<kartik@deploy1002> |
helmfile [codfw] START helmfile.d/services/cxserver: apply |
[production] |
| 05:36 |
<kartik@deploy1002> |
helmfile [staging] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:36 |
<kartik@deploy1002> |
helmfile [staging] START helmfile.d/services/cxserver: apply |
[production] |
| 05:26 |
<kart_> |
Updated cxserver to 2023-07-13-063245-production (T340953) |
[production] |
| 05:24 |
<kartik@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:23 |
<kartik@deploy1002> |
helmfile [eqiad] START helmfile.d/services/cxserver: apply |
[production] |
| 05:18 |
<marostegui> |
dbmaint s4 testcommonswiki eqiad T343174 |
[production] |
| 05:16 |
<marostegui> |
dbmaint s4 labswiki (wikitech) eqiad T343175 |
[production] |
| 05:15 |
<marostegui> |
dbmaint s4 testcommonswiki eqiad T343175 |
[production] |
| 05:12 |
<kartik@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:12 |
<kartik@deploy1002> |
helmfile [codfw] START helmfile.d/services/cxserver: apply |
[production] |
| 05:07 |
<kartik@deploy1002> |
helmfile [staging] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:06 |
<kartik@deploy1002> |
helmfile [staging] START helmfile.d/services/cxserver: apply |
[production] |
| 03:57 |
<mwpresync@deploy1002> |
Pruned MediaWiki: 1.41.0-wmf.18 (duration: 02m 09s) |
[production] |
| 03:54 |
<mwpresync@deploy1002> |
Finished scap: testwikis wikis to 1.41.0-wmf.20 refs T340248 (duration: 52m 06s) |
[production] |
| 03:02 |
<mwpresync@deploy1002> |
Started scap: testwikis wikis to 1.41.0-wmf.20 refs T340248 |
[production] |
| 02:30 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2177 (T342617)', diff saved to https://phabricator.wikimedia.org/P49867 and previous config saved to /var/cache/conftool/dbconfig/20230801-023010-ladsgroup.json |
[production] |
| 02:15 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P49866 and previous config saved to /var/cache/conftool/dbconfig/20230801-021504-ladsgroup.json |
[production] |