2024-01-31
§
|
14:21 |
<eevans@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2020.codfw.wmnet with reason: Decommissioning — T352469 |
[production] |
14:20 |
<eevans@cumin1002> |
START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2020.codfw.wmnet with reason: Decommissioning — T352469 |
[production] |
14:20 |
<urbanecm@deploy2002> |
Started scap: Backport for [[gerrit:994702|[metawiki] Let admins add/remove the event-organizer group (T356070)]], [[gerrit:994711|index.php: Restore support for forcesafemode option. (T355314)]] |
[production] |
14:19 |
<urbanecm@deploy2002> |
Finished scap: Backport for [[gerrit:994234|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994235|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994708|Add an exception for ConvenientDiscussions-style permalinks (T349653)]], [[gerrit:994709|Add an exception for ConvenientDiscussions-style permalinks (T349653) |
[production] |
14:18 |
<urbanecm> |
[urbanecm@mwmaint2002 ~]$ mwscript migrateUserGroup.php --wiki=metawiki campaignevents-beta-tester event-organizer # T356070 |
[production] |
14:13 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1146:3312 (T355609)', diff saved to https://phabricator.wikimedia.org/P55962 and previous config saved to /var/cache/conftool/dbconfig/20240131-141316-marostegui.json |
[production] |
14:13 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance |
[production] |
14:13 |
<urbanecm@deploy2002> |
urbanecm and kemayo and matmarex and daimona: Continuing with sync |
[production] |
14:12 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance |
[production] |
14:10 |
<urbanecm@deploy2002> |
urbanecm and kemayo and matmarex and daimona: Backport for [[gerrit:994234|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994235|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994708|Add an exception for ConvenientDiscussions-style permalinks (T349653)]], [[gerrit:994709|Add an exception for ConvenientDiscuss |
[production] |
14:09 |
<jgiannelos@deploy2002> |
helmfile [staging] DONE helmfile.d/services/mobileapps: apply |
[production] |
14:08 |
<urbanecm@deploy2002> |
Started scap: Backport for [[gerrit:994234|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994235|decodeURI fragments before sending them to discussiontoolsfindcomment (T356199)]], [[gerrit:994708|Add an exception for ConvenientDiscussions-style permalinks (T349653)]], [[gerrit:994709|Add an exception for ConvenientDiscussions-style permalinks (T349653)] |
[production] |
14:08 |
<jgiannelos@deploy2002> |
helmfile [staging] START helmfile.d/services/mobileapps: apply |
[production] |
14:07 |
<urbanecm@deploy2002> |
Finished scap: Backport for [[gerrit:994732|testwiki: Temporarily change default value for 4 Echo properties (T353225)]] (duration: 19m 37s) |
[production] |
14:04 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance |
[production] |
14:04 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance |
[production] |
14:00 |
<urbanecm@deploy2002> |
urbanecm: Continuing with sync |
[production] |
13:54 |
<jelto@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host people2003.codfw.wmnet |
[production] |
13:51 |
<urbanecm@deploy2002> |
urbanecm: Backport for [[gerrit:994732|testwiki: Temporarily change default value for 4 Echo properties (T353225)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:48 |
<jelto@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host people2003.codfw.wmnet |
[production] |
13:48 |
<jelto@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host planet1003.eqiad.wmnet |
[production] |
13:48 |
<urbanecm@deploy2002> |
Started scap: Backport for [[gerrit:994732|testwiki: Temporarily change default value for 4 Echo properties (T353225)]] |
[production] |
13:44 |
<jelto@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host planet1003.eqiad.wmnet |
[production] |
13:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2189 (T355609)', diff saved to https://phabricator.wikimedia.org/P55960 and previous config saved to /var/cache/conftool/dbconfig/20240131-133143-marostegui.json |
[production] |
13:27 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow6001.drmrs.wmnet |
[production] |
13:23 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow6001.drmrs.wmnet |
[production] |
13:22 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow5002.eqsin.wmnet |
[production] |
13:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P55959 and previous config saved to /var/cache/conftool/dbconfig/20240131-131637-marostegui.json |
[production] |
13:16 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow5002.eqsin.wmnet |
[production] |
13:14 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow4002.ulsfo.wmnet |
[production] |
13:09 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow4002.ulsfo.wmnet |
[production] |
13:08 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow3003.esams.wmnet |
[production] |
13:04 |
<filippo@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host titan1002.eqiad.wmnet |
[production] |
13:04 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow3003.esams.wmnet |
[production] |
13:01 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow2003.codfw.wmnet |
[production] |
13:01 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P55957 and previous config saved to /var/cache/conftool/dbconfig/20240131-130130-marostegui.json |
[production] |
12:58 |
<filippo@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host titan1002.eqiad.wmnet |
[production] |
12:57 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow2003.codfw.wmnet |
[production] |
12:54 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow1002.eqiad.wmnet |
[production] |
12:48 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host netflow1002.eqiad.wmnet |
[production] |
12:46 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2189 (T355609)', diff saved to https://phabricator.wikimedia.org/P55956 and previous config saved to /var/cache/conftool/dbconfig/20240131-124623-marostegui.json |
[production] |
12:44 |
<cgoubert@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply |
[production] |
12:44 |
<cgoubert@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-api-int: apply |
[production] |
12:44 |
<cgoubert@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply |
[production] |
12:44 |
<cgoubert@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-api-int: apply |
[production] |
12:42 |
<jmm@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host netmon1003.wikimedia.org |
[production] |
12:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2189 (T355609)', diff saved to https://phabricator.wikimedia.org/P55955 and previous config saved to /var/cache/conftool/dbconfig/20240131-123224-marostegui.json |
[production] |
12:32 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2189.codfw.wmnet with reason: Maintenance |
[production] |
12:32 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2189.codfw.wmnet with reason: Maintenance |
[production] |
12:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2175 (T355609)', diff saved to https://phabricator.wikimedia.org/P55954 and previous config saved to /var/cache/conftool/dbconfig/20240131-123203-marostegui.json |
[production] |