401-450 of 10000 results (117ms)
2024-10-30 ยง
16:06 <pfischer@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:06 <pfischer@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:06 <pfischer@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:06 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1050.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:04 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
16:04 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1049.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:04 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1084831|Fix bug in BlockManager::getUniqueBlocks (T378563)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:02 <pfischer@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:02 <pfischer@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:01 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1084831|Fix bug in BlockManager::getUniqueBlocks (T378563)]] [production]
16:01 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-presto1017.eqiad.wmnet with reason: host reimage [production]
15:59 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1049.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:57 <stevemunene@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on an-presto1017.eqiad.wmnet with reason: host reimage [production]
15:57 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1048.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:56 <pfischer@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:55 <pfischer@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:55 <pfischer@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:54 <pfischer@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:52 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1048.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:50 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1047.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:47 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:47 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:45 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1047.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:44 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1046.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:43 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-presto1017.eqiad.wmnet with OS bullseye [production]
15:39 <moritzm> re-enable Puppet fleet-wide after puppetserver2001 maintenance [production]
15:39 <moritzm> re-enable Puppet fleet-wide for puppetserver2001 maintenance [production]
15:39 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1046.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:38 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1045.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:36 <ejegg> Standalone SmashPig upgraded from eaa176f7 to be47dddd [production]
15:35 <pfischer@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:35 <pfischer@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:35 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:35 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:32 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1045.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:32 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:31 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on puppetserver2001.codfw.wmnet with reason: puppetserver2001 maintenance [production]
15:29 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 1:00:00 on puppetserver2001.codfw.wmnet with reason: puppetserver2001 maintenance [production]
15:27 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:27 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:26 <moritzm> disable Puppet fleet-wide for puppetserver2001 maintenance [production]
15:25 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-presto1016.eqiad.wmnet with OS bullseye [production]
15:25 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:24 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:23 <stevemunene@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-presto1017.eqiad.wmnet with OS bullseye [production]
15:07 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-presto1017.eqiad.wmnet with OS bullseye [production]
15:06 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on an-presto1020.eqiad.wmnet with reason: reimaging the hosts to bullseye [production]
15:06 <stevemunene@cumin1002> START - Cookbook sre.hosts.downtime for 5 days, 0:00:00 on an-presto1020.eqiad.wmnet with reason: reimaging the hosts to bullseye [production]
15:05 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on an-presto[1017-1019].eqiad.wmnet with reason: reimaging the hosts to bullseye [production]