651-700 of 10000 results (77ms)
2023-11-06 §
08:36 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2189.codfw.wmnet with reason: host reimage [production]
08:33 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2189.codfw.wmnet with reason: host reimage [production]
08:30 <godog> add +80G to prometheus/ops in eqiad [production]
08:25 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:971533|Structured mentor list: Make "no mentees" a proper weight (T347157 T347024)]] (duration: 23m 37s) [production]
08:15 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
08:15 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2189.codfw.wmnet with OS bookworm [production]
08:14 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:971533|Structured mentor list: Make "no mentees" a proper weight (T347157 T347024)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:01 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:971533|Structured mentor list: Make "no mentees" a proper weight (T347157 T347024)]] [production]
2023-11-03 §
19:15 <cstone> payments-wiki upgraded from cf9f8e52 to 1d66a20f [production]
18:08 <jynus@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host backup2011.codfw.wmnet with OS bookworm [production]
17:18 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 29 days, 4:00:00 on cp4052.ulsfo.wmnet with reason: testing instance [production]
17:17 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 29 days, 4:00:00 on cp4052.ulsfo.wmnet with reason: testing instance [production]
16:46 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2011.codfw.wmnet with OS bookworm [production]
16:17 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
16:16 <jynus@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host backup2010.codfw.wmnet with OS bookworm [production]
15:57 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2188.codfw.wmnet with OS bookworm [production]
15:42 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:39 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:36 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2188.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:09 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp4052.ulsfo.wmnet with OS bookworm [production]
15:08 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
15:05 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
14:50 <topranks> moving cr1-codfw <-> ssw1-a1-codfw EBGP session to private1-b-codfw IPs T347191 [production]
14:40 <topranks> adding irb interface in private1-a-codfw vlan to ssw1-a1-codfw T347191 [production]
14:27 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
14:02 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudelastic1005.wikimedia.org [production]
13:50 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudelastic1005.wikimedia.org [production]
13:10 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:10 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:00 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1010.eqiad.wmnet with OS bookworm [production]
12:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1006.eqiad.wmnet [production]
12:48 <fnegri@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudnet1006.eqiad.wmnet [production]
12:45 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:42 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:17 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
12:17 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:33 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:30 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:24 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:21 <fnegri@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:13 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:08 <fnegri@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:07 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1011.eqiad.wmnet with OS bookworm [production]
10:53 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1011.eqiad.wmnet with reason: host reimage [production]