4501-4550 of 10000 results (132ms)
2024-07-24 ยง
23:02 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1160 (T367856)', diff saved to https://phabricator.wikimedia.org/P66919 and previous config saved to /var/cache/conftool/dbconfig/20240724-230209-marostegui.json [production]
23:02 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
23:01 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
22:59 <zabe@deploy1002> Started scap sync-world: T370905 [production]
22:59 <zabe> Create Wikivoyage Czech # T370905 [production]
22:42 <ejegg> re-enabled Adyen job runner [production]
22:41 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e across all frack servers [production]
22:34 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e on frpig1002 only [production]
22:34 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e on frpig2001 only [production]
22:33 <ejegg> disabled Adyen job runner [production]
21:59 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1021.eqiad.wmnet [production]
21:59 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1020.eqiad.wmnet [production]
21:58 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1019.eqiad.wmnet [production]
21:58 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1018.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1021.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1020.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1019.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1018.eqiad.wmnet [production]
21:54 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[1018-1021].eqiad.wmnet with reason: T366555 security [production]
21:54 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[1018-1021].eqiad.wmnet with reason: T366555 security [production]
21:51 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1014.eqiad.wmnet [production]
21:50 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1015.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1014.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1015.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[1014-1015].eqiad.wmnet with reason: T366555 security [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[1014-1015].eqiad.wmnet with reason: T366555 security [production]
21:46 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2007.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2010.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2011.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1012.eqiad.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2012.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2009.codfw.wmnet [production]
21:44 <ryankemper@cumin2002> END (PASS) - Cookbook sre.apifeatureusage.roll-restart-reboot-logstash (exit_code=0) rolling reboot on A:apifeatureusage [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2012.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2011.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2010.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2009.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2007.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1013.eqiad.wmnet [production]
21:41 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[2007,2009-2012].codfw.wmnet with reason: T366555 security [production]
21:40 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[2007,2009-2012].codfw.wmnet with reason: T366555 security [production]
21:38 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1013.eqiad.wmnet [production]
21:38 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1012.eqiad.wmnet [production]
21:38 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[1012-1013].eqiad.wmnet with reason: T366555 security [production]
21:38 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[1012-1013].eqiad.wmnet with reason: T366555 security [production]
21:35 <ryankemper@cumin2002> START - Cookbook sre.apifeatureusage.roll-restart-reboot-logstash rolling reboot on A:apifeatureusage [production]
21:32 <ebernhardson@deploy1002> Finished scap: Backport for [[gerrit:1056580|Check the output of RevisionStore::getRevisionById (T370770)]] (duration: 12m 07s) [production]
21:28 <ebernhardson@deploy1002> ebernhardson: Continuing with sync [production]
21:26 <ebernhardson@deploy1002> ebernhardson: Backport for [[gerrit:1056580|Check the output of RevisionStore::getRevisionById (T370770)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:20 <ebernhardson@deploy1002> Started scap sync-world: Backport for [[gerrit:1056580|Check the output of RevisionStore::getRevisionById (T370770)]] [production]