201-250 of 10000 results (88ms)
2024-10-08 ยง
13:03 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1078396|hawiki: Add temporary tagline for Vector-2022 (T376049)]] [production]
12:58 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:58 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:57 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dbproxy2008.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:57 <Amir1> dropping povwatch_log on all.dblist (T54924 and T376627) [production]
12:55 <jmm@cumin2002> END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host ganeti2036.codfw.wmnet [production]
12:53 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host dbproxy2008.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:53 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dbproxy2007.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:50 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host dbproxy2007.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:49 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1078645|Remove flow from techconductwiki (T332022)]] (duration: 09m 27s) [production]
12:47 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dbproxy2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:45 <moritzm> installing lua5.4 bugfix updates [production]
12:44 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
12:43 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host dbproxy2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:42 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dbproxy2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:42 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1078645|Remove flow from techconductwiki (T332022)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
12:39 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1078645|Remove flow from techconductwiki (T332022)]] [production]
12:39 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host dbproxy2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:36 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-conf1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:33 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host an-conf1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:32 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-conf1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:31 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2036.codfw.wmnet [production]
12:29 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host an-conf1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:29 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2036.codfw.wmnet [production]
12:28 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2036.codfw.wmnet [production]
12:26 <moritzm> remove ganeti2009 from active nodes T376594 [production]
12:25 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1008.eqiad.wmnet [production]
12:23 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2009.codfw.wmnet [production]
12:19 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestage2001.codfw.wmnet with OS bookworm [production]
12:15 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1008.eqiad.wmnet [production]
12:13 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1007.eqiad.wmnet [production]
12:01 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestage2001.codfw.wmnet with reason: host reimage [production]
11:56 <jayme@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on kubestage2001.codfw.wmnet with reason: host reimage [production]
11:52 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1007.eqiad.wmnet [production]
11:43 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1006.eqiad.wmnet [production]
11:35 <jayme@cumin1002> START - Cookbook sre.hosts.reimage for host kubestage2001.codfw.wmnet with OS bookworm [production]
11:33 <jayme@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2001.codfw.wmnet [production]
11:30 <jayme@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2001.codfw.wmnet [production]
11:30 <jayme@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2002.codfw.wmnet [production]
11:30 <jayme@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2002.codfw.wmnet [production]
11:29 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host cloudcephosd1006.eqiad.wmnet [production]
11:28 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestage2002.codfw.wmnet with OS bookworm [production]
11:16 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-conf1004.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:13 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host an-conf1004.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:09 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestage2002.codfw.wmnet with reason: host reimage [production]
11:06 <jayme@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on kubestage2002.codfw.wmnet with reason: host reimage [production]
10:55 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2009.codfw.wmnet [production]
10:55 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2009.codfw.wmnet [production]
10:53 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2009.codfw.wmnet [production]
10:53 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2009.codfw.wmnet [production]