4751-4800 of 10000 results (113ms)
2023-11-03 §
15:42 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:39 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:36 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2188.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:09 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp4052.ulsfo.wmnet with OS bookworm [production]
15:08 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
15:05 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
14:50 <topranks> moving cr1-codfw <-> ssw1-a1-codfw EBGP session to private1-b-codfw IPs T347191 [production]
14:40 <topranks> adding irb interface in private1-a-codfw vlan to ssw1-a1-codfw T347191 [production]
14:27 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
14:02 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudelastic1005.wikimedia.org [production]
13:50 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudelastic1005.wikimedia.org [production]
13:10 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:10 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:00 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1010.eqiad.wmnet with OS bookworm [production]
12:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1006.eqiad.wmnet [production]
12:48 <fnegri@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudnet1006.eqiad.wmnet [production]
12:45 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:42 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:17 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
12:17 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:33 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:30 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:24 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:21 <fnegri@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:13 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:08 <fnegri@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:07 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1011.eqiad.wmnet with OS bookworm [production]
10:53 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1011.eqiad.wmnet with reason: host reimage [production]
10:50 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1011.eqiad.wmnet with reason: host reimage [production]
10:34 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1011.eqiad.wmnet with OS bookworm [production]
10:08 <mvernon@cumin1001> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe [production]
09:59 <mvernon@cumin1001> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe [production]
09:59 <Emperor> roll-restart swift frontends [production]
04:01 <eileen> civicrm upgraded from 84ec2957 to 5be02f1b [production]
01:23 <thcipriani@deploy2002> Finished scap: Backport for [[gerrit:971287|Disable namespaceDupes.php for now (T350443)]] (duration: 10m 29s) [production]
01:18 <thcipriani@deploy2002> thcipriani: Continuing with sync [production]
01:14 <thcipriani@deploy2002> thcipriani: Backport for [[gerrit:971287|Disable namespaceDupes.php for now (T350443)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
01:13 <thcipriani@deploy2002> Started scap: Backport for [[gerrit:971287|Disable namespaceDupes.php for now (T350443)]] [production]
2023-11-02 §
22:31 <Amir1> killed update collation on s5 [production]
22:13 <brett> import acme-chief 0.36-2 into bookworm-wikimedia repo [production]
21:22 <inflatador> bking@cumin2002 enabling elastic snapshots on eqiad clusters T348686 [production]
20:32 <mabualruz@deploy2002> Finished scap: Backport for [[gerrit:971244|Enable native math rendering mode on testwiki (T311620)]] (duration: 14m 06s) [production]
20:27 <mabualruz@deploy2002> mabualruz and physikerwelt: Continuing with sync [production]
20:20 <mabualruz@deploy2002> mabualruz and physikerwelt: Backport for [[gerrit:971244|Enable native math rendering mode on testwiki (T311620)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]