7451-7500 of 10000 results (140ms)
2024-10-08 ยง
15:03 <brennen@deploy2002> Finished deploy [phabricator/deployment@40a63c9]: test deploy phab2002 for T376720 (duration: 00m 26s) [production]
15:03 <brennen@deploy2002> Started deploy [phabricator/deployment@40a63c9]: test deploy phab2002 for T376720 [production]
15:02 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phab.wmfusercontent.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab.wmfusercontent.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on phabricator.wikimedia.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phabricator.wikimedia.org with reason: version upgrade [production]
15:02 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2002.codfw.wmnet with reason: version upgrade [production]
15:02 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab2002.codfw.wmnet with reason: version upgrade [production]
15:01 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: version upgrade [production]
15:01 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on phab1004.eqiad.wmnet with reason: version upgrade [production]
14:58 <papaul> mr1-magru ongoing maintenance [production]
14:56 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:56 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudlb2004-dev to codfw - jhancock@cumin2002" [production]
14:56 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudlb2004-dev to codfw - jhancock@cumin2002" [production]
14:49 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
14:47 <sergi0> deployment-prep: `sgimeno@deployment-mwmaint03:~$ foreachwiki userOptions.php --delete --old=1 growthexperiments-tour-newimpact-discovery` (T376461) [production]
14:41 <moritzm> installing python-aiosmtpd security updates [production]
14:35 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2010.codfw.wmnet [production]
14:34 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2010.codfw.wmnet [production]
14:34 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1010.eqiad.wmnet [production]
14:30 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2010.codfw.wmnet [production]
14:30 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudlb2004-dev.codfw.wmnet with OS bookworm [production]
14:23 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1010.eqiad.wmnet [production]
14:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:22 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1009.eqiad.wmnet [production]
14:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc2001 [production]
14:22 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host mc-misc2001 [production]
14:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:19 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
14:17 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:17 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:16 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:16 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:15 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudlb2004-dev'] [production]
14:15 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudlb2004-dev [production]
14:15 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudlb2004-dev [production]
14:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc2001 [production]
14:13 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host mc-misc2001 [production]
14:10 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1009.eqiad.wmnet [production]
14:08 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:08 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding mc-misc2001 to codfw - jhancock@cumin2002" [production]
14:08 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding mc-misc2001 to codfw - jhancock@cumin2002" [production]
14:05 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
14:03 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve2009.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
13:59 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ml-serve2009.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
13:53 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1078415|Stop setting wgAbuseFilterActorTableSchemaMigrationStage (T188180)]] (duration: 07m 03s) [production]
13:52 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-staging2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
13:49 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ml-staging2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
13:49 <zabe@deploy2002> zabe: Continuing with sync [production]
13:48 <zabe@deploy2002> zabe: Backport for [[gerrit:1078415|Stop setting wgAbuseFilterActorTableSchemaMigrationStage (T188180)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]