6051-6100 of 10000 results (118ms)
2024-03-06 ยง
12:53 <claime> Running homer 'cr*codfw*' commit 'T351074' [production]
12:52 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2374.codfw.wmnet with OS bullseye [production]
12:49 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2373.codfw.wmnet with OS bullseye [production]
12:46 <jiji@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply [production]
12:46 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2376.codfw.wmnet with OS bullseye [production]
12:46 <jnuche@deploy2002> jnuche and ladsgroup: Continuing with sync [production]
12:45 <jnuche@deploy2002> jnuche and ladsgroup: Backport for [[gerrit:1008503|Set two more wikis to read new for pagelinks migration (T351237)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
12:43 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2007.codfw.wmnet with OS bullseye [production]
12:43 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2371.codfw.wmnet with OS bullseye [production]
12:42 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2006.codfw.wmnet with OS bullseye [production]
12:42 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2005.codfw.wmnet with OS bullseye [production]
12:42 <jnuche@deploy2002> Started scap: Backport for [[gerrit:1008503|Set two more wikis to read new for pagelinks migration (T351237)]] [production]
12:41 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2004.codfw.wmnet with OS bullseye [production]
12:41 <volans@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
12:41 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2372.codfw.wmnet with OS bullseye [production]
12:41 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2003.codfw.wmnet with OS bullseye [production]
12:40 <akosiaris@cumin1002> START - Cookbook sre.hosts.reimage for host parse2002.codfw.wmnet with OS bullseye [production]
12:39 <jnuche@deploy2002> Finished scap: Backport for [[gerrit:1009231|Add missing function argument to titleWithoutPrefix call (T359290)]] (duration: 11m 10s) [production]
12:39 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw2375.codfw.wmnet with OS bullseye [production]
12:37 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:37 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:35 <volans@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
12:33 <volans@cumin2002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
12:33 <volans@cumin2002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
12:33 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2374.codfw.wmnet with reason: host reimage [production]
12:30 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2373.codfw.wmnet with reason: host reimage [production]
12:30 <jnuche@deploy2002> jnuche: Continuing with sync [production]
12:30 <jnuche@deploy2002> jnuche: Backport for [[gerrit:1009231|Add missing function argument to titleWithoutPrefix call (T359290)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
12:28 <jnuche@deploy2002> Started scap: Backport for [[gerrit:1009231|Add missing function argument to titleWithoutPrefix call (T359290)]] [production]
12:27 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2376.codfw.wmnet with reason: host reimage [production]
12:26 <jiji@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply [production]
12:24 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2371.codfw.wmnet with reason: host reimage [production]
12:22 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2372.codfw.wmnet with reason: host reimage [production]
12:20 <cgoubert@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2375.codfw.wmnet with reason: host reimage [production]
12:18 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2372.codfw.wmnet with reason: host reimage [production]
12:18 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2376.codfw.wmnet with reason: host reimage [production]
12:18 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2374.codfw.wmnet with reason: host reimage [production]
12:18 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2373.codfw.wmnet with reason: host reimage [production]
12:18 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2124 (T352010)', diff saved to https://phabricator.wikimedia.org/P58581 and previous config saved to /var/cache/conftool/dbconfig/20240306-121800-ladsgroup.json [production]
12:18 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2371.codfw.wmnet with reason: host reimage [production]
12:17 <cgoubert@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2375.codfw.wmnet with reason: host reimage [production]
12:17 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2124.codfw.wmnet with reason: Maintenance [production]
12:17 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2124.codfw.wmnet with reason: Maintenance [production]
12:10 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:10 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:02 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw2376.codfw.wmnet with OS bullseye [production]
12:02 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw2375.codfw.wmnet with OS bullseye [production]
12:02 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw2374.codfw.wmnet with OS bullseye [production]
12:02 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw2373.codfw.wmnet with OS bullseye [production]
12:02 <cgoubert@cumin2002> START - Cookbook sre.hosts.reimage for host mw2372.codfw.wmnet with OS bullseye [production]