1-50 of 10000 results (83ms)
2024-07-24 ยง
23:59 <dani@deploy1002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
23:59 <dani@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
23:59 <dani@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
23:20 <zabe@deploy1002> Finished scap: update interwiki cache (duration: 08m 25s) [production]
23:11 <zabe@deploy1002> Started scap sync-world: update interwiki cache [production]
23:09 <zabe> zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=cswikivoyage --cluster=all 2>&1 | tee /tmp/cswikivoyage.UpdateSearchIndexConfig.log # T370905 [production]
23:08 <zabe@deploy1002> Finished scap: T370905 (duration: 09m 14s) [production]
23:02 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1160 (T367856)', diff saved to https://phabricator.wikimedia.org/P66919 and previous config saved to /var/cache/conftool/dbconfig/20240724-230209-marostegui.json [production]
23:02 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
23:01 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
22:59 <zabe@deploy1002> Started scap sync-world: T370905 [production]
22:59 <zabe> Create Wikivoyage Czech # T370905 [production]
22:42 <ejegg> re-enabled Adyen job runner [production]
22:41 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e across all frack servers [production]
22:34 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e on frpig1002 only [production]
22:34 <ejegg> SmashPig upgraded from f2aca230 to 1b2d9a6e on frpig2001 only [production]
22:33 <ejegg> disabled Adyen job runner [production]
21:59 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1021.eqiad.wmnet [production]
21:59 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1020.eqiad.wmnet [production]
21:58 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1019.eqiad.wmnet [production]
21:58 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1018.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1021.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1020.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1019.eqiad.wmnet [production]
21:55 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1018.eqiad.wmnet [production]
21:54 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[1018-1021].eqiad.wmnet with reason: T366555 security [production]
21:54 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[1018-1021].eqiad.wmnet with reason: T366555 security [production]
21:51 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1014.eqiad.wmnet [production]
21:50 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1015.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1014.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1015.eqiad.wmnet [production]
21:47 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[1014-1015].eqiad.wmnet with reason: T366555 security [production]
21:47 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[1014-1015].eqiad.wmnet with reason: T366555 security [production]
21:46 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2007.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2010.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2011.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1012.eqiad.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2012.codfw.wmnet [production]
21:45 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2009.codfw.wmnet [production]
21:44 <ryankemper@cumin2002> END (PASS) - Cookbook sre.apifeatureusage.roll-restart-reboot-logstash (exit_code=0) rolling reboot on A:apifeatureusage [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2012.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2011.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2010.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2009.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs2007.codfw.wmnet [production]
21:42 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1013.eqiad.wmnet [production]
21:41 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on wdqs[2007,2009-2012].codfw.wmnet with reason: T366555 security [production]
21:40 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on wdqs[2007,2009-2012].codfw.wmnet with reason: T366555 security [production]
21:38 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1013.eqiad.wmnet [production]
21:38 <ryankemper@cumin2002> START - Cookbook sre.hosts.reboot-single for host wdqs1012.eqiad.wmnet [production]