1-50 of 10000 results (67ms)
2023-11-03 ยง
19:15 <cstone> payments-wiki upgraded from cf9f8e52 to 1d66a20f [production]
18:08 <jynus@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host backup2011.codfw.wmnet with OS bookworm [production]
17:18 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 29 days, 4:00:00 on cp4052.ulsfo.wmnet with reason: testing instance [production]
17:17 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 29 days, 4:00:00 on cp4052.ulsfo.wmnet with reason: testing instance [production]
16:46 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2011.codfw.wmnet with OS bookworm [production]
16:17 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
16:16 <jynus@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host backup2010.codfw.wmnet with OS bookworm [production]
15:57 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2188.codfw.wmnet with OS bookworm [production]
15:42 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:39 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2188.codfw.wmnet with reason: host reimage [production]
15:36 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2188.codfw.wmnet with OS bookworm [production]
15:20 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db2188.codfw.wmnet with reason: reimage via T343674 [production]
15:09 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp4052.ulsfo.wmnet with OS bookworm [production]
15:08 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
15:05 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4052.ulsfo.wmnet with reason: host reimage [production]
14:50 <topranks> moving cr1-codfw <-> ssw1-a1-codfw EBGP session to private1-b-codfw IPs T347191 [production]
14:40 <topranks> adding irb interface in private1-a-codfw vlan to ssw1-a1-codfw T347191 [production]
14:27 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host cp4052.ulsfo.wmnet with OS bookworm [production]
14:02 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudelastic1005.wikimedia.org [production]
13:50 <bking@cumin2002> START - Cookbook sre.hosts.reboot-single for host cloudelastic1005.wikimedia.org [production]
13:10 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:10 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on debmonitor2003.codfw.wmnet with reason: setup in progress [production]
13:00 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1010.eqiad.wmnet with OS bookworm [production]
12:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1006.eqiad.wmnet [production]
12:48 <fnegri@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudnet1006.eqiad.wmnet [production]
12:45 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:42 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
12:17 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
12:17 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:54 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:49 <jynus@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host backup1010.eqiad.wmnet with OS bookworm [production]
11:33 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:30 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1010.eqiad.wmnet with reason: host reimage [production]
11:24 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:21 <fnegri@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudnet1006.eqiad.wmnet with reason: host reimage [production]
11:13 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1010.eqiad.wmnet with OS bookworm [production]
11:08 <fnegri@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bookworm [production]
11:07 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup1011.eqiad.wmnet with OS bookworm [production]
10:53 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup1011.eqiad.wmnet with reason: host reimage [production]
10:50 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on backup1011.eqiad.wmnet with reason: host reimage [production]
10:34 <jynus@cumin1001> START - Cookbook sre.hosts.reimage for host backup1011.eqiad.wmnet with OS bookworm [production]
10:08 <mvernon@cumin1001> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe [production]
09:59 <mvernon@cumin1001> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe [production]
09:59 <Emperor> roll-restart swift frontends [production]
04:01 <eileen> civicrm upgraded from 84ec2957 to 5be02f1b [production]
01:23 <thcipriani@deploy2002> Finished scap: Backport for [[gerrit:971287|Disable namespaceDupes.php for now (T350443)]] (duration: 10m 29s) [production]
01:18 <thcipriani@deploy2002> thcipriani: Continuing with sync [production]