6251-6300 of 10000 results (116ms)
2024-04-30 §
14:21 <moritzm> installing Java 8 security updates [production]
14:21 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7004.magru.wmnet with reason: will be reimaged soon [production]
14:21 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7004.magru.wmnet with reason: will be reimaged soon [production]
14:19 <btullis@cumin1002> START - Cookbook sre.hosts.reimage for host cephosd1002.eqiad.wmnet with OS bullseye [production]
14:19 <dcausse@deploy1002> Finished deploy [airflow-dags/search@ab19bcd]: wdqs: deduplicate side-output events (T362508) (duration: 00m 29s) [production]
14:19 <dcausse@deploy1002> Started deploy [airflow-dags/search@ab19bcd]: wdqs: deduplicate side-output events (T362508) [production]
14:16 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7001.magru.wmnet with reason: host reimage [production]
14:15 <sukhe@cumin1002> START - Cookbook sre.hosts.reimage for host cp7011.magru.wmnet with OS bullseye [production]
14:13 <fabfur@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7001.magru.wmnet with reason: host reimage [production]
14:10 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.copy (exit_code=99) Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
14:10 <arnaudb@cumin1002> START - Cookbook sre.mysql.copy Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
14:10 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7009.magru.wmnet with reason: host reimage [production]
14:07 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp[7002-7003].magru.wmnet with reason: will be reimaged soon [production]
14:07 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7009.magru.wmnet with reason: host reimage [production]
14:06 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp[7002-7003].magru.wmnet with reason: will be reimaged soon [production]
14:06 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:1024407|Turn on ParserMigration extension everywhere]], [[gerrit:1024408|Quiet ParserMigration notice for 30 days after acknowledgement]] (duration: 23m 40s) [production]
14:03 <sukhe@cumin1002> START - Cookbook sre.hosts.reimage for host cp7010.magru.wmnet with OS bullseye [production]
13:54 <urbanecm@deploy1002> urbanecm and cscott: Continuing with sync [production]
13:54 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti7004.magru.wmnet with OS bookworm [production]
13:53 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti7003.magru.wmnet with OS bookworm [production]
13:53 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
13:51 <sukhe@cumin1002> START - Cookbook sre.hosts.reimage for host dns7001.wikimedia.org with OS bullseye [production]
13:47 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jmm@cumin2002" [production]
13:47 <urbanecm@deploy1002> urbanecm and cscott: Backport for [[gerrit:1024407|Turn on ParserMigration extension everywhere]], [[gerrit:1024408|Quiet ParserMigration notice for 30 days after acknowledgement]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:44 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1233.eqiad.wmnet [production]
13:43 <fabfur@cumin1002> START - Cookbook sre.hosts.reimage for host cp7001.magru.wmnet with OS bullseye [production]
13:42 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:1024407|Turn on ParserMigration extension everywhere]], [[gerrit:1024408|Quiet ParserMigration notice for 30 days after acknowledgement]] [production]
13:41 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:1025727|[itwiki] Create a new 'arbcom' usergroup (T363805)]] (duration: 20m 09s) [production]
13:39 <sukhe@cumin1002> START - Cookbook sre.hosts.reimage for host cp7009.magru.wmnet with OS bullseye [production]
13:35 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1233.eqiad.wmnet [production]
13:35 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1222.eqiad.wmnet [production]
13:35 <sukhe@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp7009.magru.wmnet with OS bullseye [production]
13:28 <urbanecm@deploy1002> superpes and urbanecm: Continuing with sync [production]
13:27 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1222.eqiad.wmnet [production]
13:27 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti7003.magru.wmnet with reason: host reimage [production]
13:26 <urbanecm@deploy1002> superpes and urbanecm: Backport for [[gerrit:1025727|[itwiki] Create a new 'arbcom' usergroup (T363805)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:26 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1197.eqiad.wmnet [production]
13:26 <sfaci@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic-next: apply [production]
13:26 <sfaci@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic-next: apply [production]
13:25 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.copy (exit_code=99) Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
13:25 <arnaudb@cumin1002> START - Cookbook sre.mysql.copy Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
13:23 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti7003.magru.wmnet with reason: host reimage [production]
13:22 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.copy (exit_code=99) Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
13:22 <arnaudb@cumin1002> START - Cookbook sre.mysql.copy Will create a clone of db2114.codfw.wmnet onto db1125.eqiad.wmnet [production]
13:21 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:1025727|[itwiki] Create a new 'arbcom' usergroup (T363805)]] [production]
13:21 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.copy (exit_code=99) Will create a clone of db1125.eqiad.wmnet onto db2114.codfw.wmnet [production]
13:20 <arnaudb@cumin1002> START - Cookbook sre.mysql.copy Will create a clone of db1125.eqiad.wmnet onto db2114.codfw.wmnet [production]
13:19 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1197.eqiad.wmnet [production]
13:15 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.copy (exit_code=99) Will create a clone of db1125.eqiad.wmnet onto db2114.codfw.wmnet [production]
13:15 <arnaudb@cumin1002> START - Cookbook sre.mysql.copy Will create a clone of db1125.eqiad.wmnet onto db2114.codfw.wmnet [production]