3651-3700 of 10000 results (89ms)
2023-10-17 §
02:10 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2176.codfw.wmnet with reason: Maintenance [production]
02:10 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2176.codfw.wmnet with reason: Maintenance [production]
02:10 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2174 (T343198)', diff saved to https://phabricator.wikimedia.org/P52981 and previous config saved to /var/cache/conftool/dbconfig/20231017-021018-arnaudb.json [production]
01:55 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P52980 and previous config saved to /var/cache/conftool/dbconfig/20231017-015511-arnaudb.json [production]
01:40 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P52979 and previous config saved to /var/cache/conftool/dbconfig/20231017-014005-arnaudb.json [production]
01:24 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2174 (T343198)', diff saved to https://phabricator.wikimedia.org/P52978 and previous config saved to /var/cache/conftool/dbconfig/20231017-012459-arnaudb.json [production]
2023-10-16 §
22:04 <maryum> deployed security patch for T347742 [production]
21:53 <maryum> deployed security patch for T347708 [production]
21:40 <maryum> deployed security patch for T348343 [production]
21:04 <sbassett> deployed security mitigation for T348828 [production]
20:55 <cjming> end of UTC late backport window [production]
20:52 <cjming@deploy2002> Finished scap: Backport for [[gerrit:960147|wordmarks/taglines for Wiktionary projects (T341257)]] (duration: 07m 17s) [production]
20:47 <cjming@deploy2002> jdlrobson and cjming: Continuing with sync [production]
20:46 <cjming@deploy2002> jdlrobson and cjming: Backport for [[gerrit:960147|wordmarks/taglines for Wiktionary projects (T341257)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:45 <cjming@deploy2002> Started scap: Backport for [[gerrit:960147|wordmarks/taglines for Wiktionary projects (T341257)]] [production]
20:44 <cjming@deploy2002> Finished scap: Backport for [[gerrit:966281|Update logos for remaining Wikisource projects (T343753)]] (duration: 07m 50s) [production]
20:39 <cjming@deploy2002> jdlrobson and cjming: Continuing with sync [production]
20:37 <cjming@deploy2002> jdlrobson and cjming: Backport for [[gerrit:966281|Update logos for remaining Wikisource projects (T343753)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:36 <cjming@deploy2002> Started scap: Backport for [[gerrit:966281|Update logos for remaining Wikisource projects (T343753)]] [production]
20:35 <cjming@deploy2002> Finished scap: Backport for [[gerrit:966280|Fixes Thai Wikinews wordmark and sewikimedia (T348757 T347534)]] (duration: 07m 08s) [production]
20:30 <cjming@deploy2002> cjming and jdlrobson: Continuing with sync [production]
20:29 <cjming@deploy2002> cjming and jdlrobson: Backport for [[gerrit:966280|Fixes Thai Wikinews wordmark and sewikimedia (T348757 T347534)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:28 <cjming@deploy2002> Started scap: Backport for [[gerrit:966280|Fixes Thai Wikinews wordmark and sewikimedia (T348757 T347534)]] [production]
20:26 <cjming@deploy2002> Finished scap: Backport for [[gerrit:965904|Merge ReplyWidget[Plain/Visual] modules (T348834)]] (duration: 07m 23s) [production]
20:21 <cjming@deploy2002> kemayo and cjming: Continuing with sync [production]
20:20 <cjming@deploy2002> kemayo and cjming: Backport for [[gerrit:965904|Merge ReplyWidget[Plain/Visual] modules (T348834)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:19 <cjming@deploy2002> Started scap: Backport for [[gerrit:965904|Merge ReplyWidget[Plain/Visual] modules (T348834)]] [production]
20:18 <cjming@deploy2002> Finished scap: Backport for [[gerrit:964545|Enable display of Client Hints data on all wikis (T341110 T337942)]] (duration: 08m 17s) [production]
20:13 <cjming@deploy2002> dreamyjazz and cjming: Continuing with sync [production]
20:11 <cjming@deploy2002> dreamyjazz and cjming: Backport for [[gerrit:964545|Enable display of Client Hints data on all wikis (T341110 T337942)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:10 <cjming@deploy2002> Started scap: Backport for [[gerrit:964545|Enable display of Client Hints data on all wikis (T341110 T337942)]] [production]
19:55 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:55 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:42 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:42 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:30 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:30 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:27 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:27 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:23 <eevans@cumin1001> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts aqs1010.eqiad.wmnet [production]
19:23 <eevans@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts aqs1010.eqiad.wmnet [production]
19:20 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:20 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:17 <eevans@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts aqs1010.eqiad.wmnet [production]
19:13 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:12 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:09 <eevans@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts aqs1010.eqiad.wmnet [production]
18:51 <sukhe> exiqgrep -i -r <redacted> | xargs exim -Mrm [production]
18:41 <bking@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
18:27 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'llm' for release 'main' . [production]