3251-3300 of 10000 results (80ms)
2022-12-06 ยง
19:57 <cwhite@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on logstash1028.eqiad.wmnet with reason: host reimage [production]
19:56 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti5007.eqsin.wmnet with OS bullseye [production]
19:55 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti5006.eqsin.wmnet with OS bullseye [production]
19:45 <ejegg> payments-wiki upgraded from a875f2b9 to 1914b6c7 [production]
19:40 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1028.eqiad.wmnet with OS bullseye [production]
19:39 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti5005.eqsin.wmnet with reason: host reimage [production]
19:38 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logstash1027.eqiad.wmnet with OS bullseye [production]
19:37 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti5007.eqsin.wmnet with reason: host reimage [production]
19:35 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti5006.eqsin.wmnet with reason: host reimage [production]
19:32 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:865128|Avoid syntax error on hover in grade C browsers (T324514)]] (duration: 12m 43s) [production]
19:32 <robh@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti5007.eqsin.wmnet with reason: host reimage [production]
19:32 <robh@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti5005.eqsin.wmnet with reason: host reimage [production]
19:32 <robh@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti5006.eqsin.wmnet with reason: host reimage [production]
19:32 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['logstash1028'] [production]
19:22 <cwhite@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1028'] [production]
19:21 <cwhite@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['logstash1028'] [production]
19:21 <ladsgroup@deploy1002> ladsgroup and jdlrobson: Backport for [[gerrit:865128|Avoid syntax error on hover in grade C browsers (T324514)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
19:19 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:865128|Avoid syntax error on hover in grade C browsers (T324514)]] [production]
19:19 <demon@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.40.0-wmf.13 refs T320518 [production]
19:16 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logstash1027.eqiad.wmnet with reason: host reimage [production]
19:14 <cwhite@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1028'] [production]
19:12 <cwhite@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on logstash1027.eqiad.wmnet with reason: host reimage [production]
19:03 <robh@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti5007.eqsin.wmnet with OS bullseye [production]
19:03 <robh@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti5006.eqsin.wmnet with OS bullseye [production]
19:03 <robh@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti5005.eqsin.wmnet with OS bullseye [production]
18:57 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti5006'] [production]
18:57 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti5007'] [production]
18:57 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ganeti5005'] [production]
18:56 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1027.eqiad.wmnet with OS bullseye [production]
18:55 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['logstash1027'] [production]
18:45 <cwhite@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1027'] [production]
18:45 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti5007'] [production]
18:45 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti5006'] [production]
18:44 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ganeti5005'] [production]
18:43 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['logstash1027'] [production]
18:42 <pt1979@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1027'] [production]
18:42 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dns5003'] [production]
18:42 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['lvs5006'] [production]
18:42 <robh@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['lvs5005'] [production]
18:42 <pt1979@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['logstash1027'] [production]
18:39 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2002.codfw.wmnet with OS bullseye [production]
18:33 <pt1979@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1027'] [production]
18:32 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['logstash1027'] [production]
18:31 <pt1979@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1027'] [production]
18:31 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dns5003'] [production]
18:31 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs5006'] [production]
18:31 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['lvs5005'] [production]
18:28 <robh@cumin2002> END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['logstash1028'] [production]
18:28 <robh@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['logstash1028'] [production]
18:27 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['logstash1028'] [production]