7751-7800 of 10000 results (112ms)
2024-03-19 ยง
13:07 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
13:07 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
13:06 <claime> manually adding 20 replicas to mw-parsoid to help with big reparse [production]
12:59 <cmooney@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
12:59 <cmooney@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
12:59 <cmooney@cumin1002> END (FAIL) - Cookbook sre.netbox.update-extras (exit_code=1) rolling restart_daemons on A:netbox-canary [production]
12:49 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
12:49 <cmooney@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
12:48 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
12:48 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
12:48 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
12:11 <slyngs> Switch idp-test to upgraded Bookworm host [production]
11:45 <cgoubert@deploy2002> Finished scap: mediawiki: Route /w/CREDITS and /w/COPYING to /w/static.php - gerrit:1012627 - T359643 (duration: 06m 59s) [production]
11:40 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:39 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:21 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:21 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:19 <oblivian@deploy2002> dancy and oblivian: Continuing with sync [production]
11:18 <oblivian@deploy2002> dancy and oblivian: Backport for [[gerrit:1012427|static.php: Handle COPYING and CREDITS files (T359643)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:16 <oblivian@deploy2002> Started scap: Backport for [[gerrit:1012427|static.php: Handle COPYING and CREDITS files (T359643)]] [production]
11:02 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:02 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:53 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:53 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:35 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:35 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:33 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:32 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:29 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:29 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:45 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:45 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:34 <hashar@deploy2002> Finished scap: Backport for [[gerrit:1012607|wikitech: close parenthesis in log message (T307558)]] (duration: 15m 19s) [production]
09:22 <hashar@deploy2002> hashar: Continuing with sync [production]
09:21 <hashar@deploy2002> hashar: Backport for [[gerrit:1012607|wikitech: close parenthesis in log message (T307558)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:18 <hashar@deploy2002> Started scap: Backport for [[gerrit:1012607|wikitech: close parenthesis in log message (T307558)]] [production]
08:58 <hashar@deploy2002> Finished scap: Backport for [[gerrit:1011171|wikitech: fix curl_exec a falsey value (T307558)]] (duration: 14m 36s) [production]
08:46 <hashar@deploy2002> hashar: Continuing with sync [production]
08:45 <hashar@deploy2002> hashar: Backport for [[gerrit:1011171|wikitech: fix curl_exec a falsey value (T307558)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:43 <hashar@deploy2002> Started scap: Backport for [[gerrit:1011171|wikitech: fix curl_exec a falsey value (T307558)]] [production]
08:42 <slyngshede@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host idp-test1003.wikimedia.org with OS bookworm [production]
08:33 <hashar@deploy2002> Finished scap: Backport for [[gerrit:1011151|wikitech: fix handling of Gerrit status code (T307558)]] (duration: 15m 31s) [production]
08:24 <slyngshede@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on idp-test1003.wikimedia.org with reason: host reimage [production]
08:22 <slyngshede@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on idp-test1003.wikimedia.org with reason: host reimage [production]
08:21 <hashar@deploy2002> hashar: Continuing with sync [production]
08:20 <hashar@deploy2002> hashar: Backport for [[gerrit:1011151|wikitech: fix handling of Gerrit status code (T307558)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:17 <hashar@deploy2002> Started scap: Backport for [[gerrit:1011151|wikitech: fix handling of Gerrit status code (T307558)]] [production]
08:09 <slyngshede@cumin1002> START - Cookbook sre.hosts.reimage for host idp-test1003.wikimedia.org with OS bookworm [production]
08:00 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:00 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]