1-50 of 10000 results (69ms)
2024-03-05 ยง
23:53 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1025.eqiad.wmnet with OS bullseye [production]
23:48 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:48 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:45 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:45 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:42 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:42 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:35 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:35 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:26 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:26 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:22 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:22 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:08 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
23:08 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
23:01 <akosiaris@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host parse1014.eqiad.wmnet with OS bullseye [production]
22:37 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
22:37 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
22:37 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 60 days, 0:00:00 on wdqs[1022-1024].eqiad.wmnet with reason: T337013 [production]
22:37 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 60 days, 0:00:00 on wdqs[1022-1024].eqiad.wmnet with reason: T337013 [production]
22:34 <brett@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp4037.ulsfo.wmnet [production]
22:33 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host wdqs1025.eqiad.wmnet with OS bullseye [production]
22:27 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet [production]
22:26 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ncredir4037.ulsfo.wmnet [production]
22:21 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ncredir4037.ulsfo.wmnet [production]
22:18 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5025.eqsin.wmnet [production]
22:09 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wdqs1025'] [production]
22:07 <brett> upload fifo-log-demux 0.6.5+deb11u1 to bullseye-wikimedia [production]
22:03 <brett> upload fifo-log-demux 0.6.5+deb12u1 to bookworm-wikimedia [production]
21:49 <brett> Remove fifo-log-demux from bookworm-wikimedia (dist version needs revision) [production]
21:47 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wdqs1025'] [production]
21:47 <bking@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wdqs1025.eqiad.wmnet with OS bullseye [production]
21:42 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:1008765|Set background/color to inherit for common templates in dark mode (T358164)]], [[gerrit:1008472|HandleSectionLinks: Fix handling headings with raw `>` in attributes (T358810)]] (duration: 15m 50s) [production]
21:41 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse1014.eqiad.wmnet with OS bullseye [production]
21:32 <urbanecm@deploy2002> matmarex and jdlrobson and urbanecm: Continuing with sync [production]
21:30 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host wdqs1025.eqiad.wmnet with OS bullseye [production]
21:28 <urbanecm@deploy2002> matmarex and jdlrobson and urbanecm: Backport for [[gerrit:1008765|Set background/color to inherit for common templates in dark mode (T358164)]], [[gerrit:1008472|HandleSectionLinks: Fix handling headings with raw `>` in attributes (T358810)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:27 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wdqs1025'] [production]
21:26 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ncredir4001.ulsfo.wmnet [production]
21:26 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:1008765|Set background/color to inherit for common templates in dark mode (T358164)]], [[gerrit:1008472|HandleSectionLinks: Fix handling headings with raw `>` in attributes (T358810)]] [production]
21:25 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ncredir5001.eqsin.wmnet [production]
21:22 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:1005161|Move account vanishing contact form to Meta wiki. (T343536)]], [[gerrit:1007992|Stop sharing vector and vector-2022 scripts on wikis where no users are impacted (T331679)]] (duration: 14m 46s) [production]
21:20 <bking@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['elastic2107'] [production]
21:20 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['elastic2107'] [production]
21:20 <brett@puppetmaster1001> conftool action : set/pooled=no; selector: name=ncredir5001.eqsin.wmnet [production]
21:17 <bking@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wdqs1025'] [production]
21:17 <bking@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wdqs1025.eqiad.wmnet with OS bullseye [production]
21:12 <urbanecm@deploy2002> jdlrobson and urbanecm and dbrant: Continuing with sync [production]
21:10 <urbanecm@deploy2002> jdlrobson and urbanecm and dbrant: Backport for [[gerrit:1005161|Move account vanishing contact form to Meta wiki. (T343536)]], [[gerrit:1007992|Stop sharing vector and vector-2022 scripts on wikis where no users are impacted (T331679)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:07 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:1005161|Move account vanishing contact form to Meta wiki. (T343536)]], [[gerrit:1007992|Stop sharing vector and vector-2022 scripts on wikis where no users are impacted (T331679)]] [production]