4301-4350 of 10000 results (92ms)
2024-03-20 ยง
09:57 <claime> running homer 'cr*eqiad*' commit 'T351074' [production]
09:56 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1369.eqiad.wmnet with OS bullseye [production]
09:54 <slyngshede@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on idp-test1003.wikimedia.org with reason: host reimage [production]
09:54 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 200132 [production]
09:54 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 200132 [production]
09:53 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1478.eqiad.wmnet with OS bullseye [production]
09:52 <slyngshede@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on idp-test1003.wikimedia.org with reason: host reimage [production]
09:52 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1479.eqiad.wmnet with OS bullseye [production]
09:50 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1370.eqiad.wmnet with OS bullseye [production]
09:48 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1368.eqiad.wmnet with OS bullseye [production]
09:43 <ayounsi@cumin1002> START - Cookbook sre.hosts.reimage for host sretest2003.codfw.wmnet with OS bookworm [production]
09:39 <slyngshede@cumin1002> START - Cookbook sre.hosts.reimage for host idp-test1003.wikimedia.org with OS bullseye [production]
09:37 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1369.eqiad.wmnet with reason: host reimage [production]
09:35 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1478.eqiad.wmnet with reason: host reimage [production]
09:32 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1479.eqiad.wmnet with reason: host reimage [production]
09:30 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1370.eqiad.wmnet with reason: host reimage [production]
09:28 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1368.eqiad.wmnet with reason: host reimage [production]
09:27 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1370.eqiad.wmnet with reason: host reimage [production]
09:26 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1479.eqiad.wmnet with reason: host reimage [production]
09:26 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1369.eqiad.wmnet with reason: host reimage [production]
09:26 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1478.eqiad.wmnet with reason: host reimage [production]
09:26 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1368.eqiad.wmnet with reason: host reimage [production]
09:19 <Emperor> rolling-restart memcached on swift-fe-eqiad [production]
09:13 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw1479.eqiad.wmnet with OS bullseye [production]
09:13 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw1478.eqiad.wmnet with OS bullseye [production]
09:12 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw1370.eqiad.wmnet with OS bullseye [production]
09:12 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw1369.eqiad.wmnet with OS bullseye [production]
09:12 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw1368.eqiad.wmnet with OS bullseye [production]
09:02 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad [production]
08:59 <kart_> Update MinT to 2024-03-20-072303-production (T353791, T340956) [production]
08:59 <mvernon@cumin1002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad [production]
08:58 <claime> Depooling mw1368.eqiad.wmnet,mw1369.eqiad.wmnet,mw1370.eqiad.wmnet,mw1478.eqiad.wmnet,mw1479.eqiad.wmnet - T351074 [production]
08:57 <kartik@deploy2002> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
08:51 <moritzm> installing systemd updates from bookworm point release [production]
08:47 <kartik@deploy2002> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
08:29 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
08:23 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
08:21 <kartik@deploy2002> Finished scap: Backport for [[gerrit:1010226|Enable Content/Section translation on some Wikipedias (T353510)]] (duration: 17m 06s) [production]
08:09 <kartik@deploy2002> kartik: Continuing with sync [production]
08:07 <kartik@deploy2002> kartik: Backport for [[gerrit:1010226|Enable Content/Section translation on some Wikipedias (T353510)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:04 <kartik@deploy2002> Started scap: Backport for [[gerrit:1010226|Enable Content/Section translation on some Wikipedias (T353510)]] [production]
08:00 <kartik@deploy2002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
07:56 <kartik@deploy2002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
07:52 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:52 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:44 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:44 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:41 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:41 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:36 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]