751-800 of 10000 results (69ms)
2023-10-27 §
11:08 <volans@cumin2002> END (PASS) - Cookbook sre.ganeti.resource-report (exit_code=0) [production]
11:08 <volans@cumin2002> START - Cookbook sre.ganeti.resource-report [production]
11:01 <jbond@cumin2002> END (PASS) - Cookbook sre.ganeti.resource-report (exit_code=0) [production]
11:01 <jbond@cumin2002> START - Cookbook sre.ganeti.resource-report [production]
11:00 <jiji@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
10:48 <jiji@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
10:48 <jiji@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
10:48 <jiji@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
10:45 <jiji@deploy2002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
10:45 <jiji@deploy2002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
10:44 <jiji@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
10:40 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1102.eqiad.wmnet with OS bullseye [production]
10:36 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1101.eqiad.wmnet with OS bullseye [production]
10:20 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cloudvirt-wdqs1001.eqiad.wmnet [production]
10:20 <taavi@cumin1001> START - Cookbook sre.hosts.remove-downtime for cloudvirt-wdqs1001.eqiad.wmnet [production]
10:17 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1101.eqiad.wmnet with reason: host reimage [production]
10:17 <jiji@deploy2002> helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
10:14 <fabfur@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1101.eqiad.wmnet with reason: host reimage [production]
10:14 <jiji@deploy2002> helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply [production]
10:14 <jiji@deploy2002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
10:13 <jiji@deploy2002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply [production]
09:59 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1101.eqiad.wmnet with OS bullseye [production]
09:59 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1101.eqiad.wmnet with OS bullseye [production]
09:34 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1101.eqiad.wmnet with OS bullseye [production]
09:19 <btullis@cumin1001> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) [production]
09:19 <btullis@cumin1001> Added views for new wiki: tlywiki T345169 [production]
09:02 <moritzm> deployment-prep app servers are now using ICU67/Unicode 13 [production]
08:49 <moritzm> uploaded libxml2 2.9.4+dfsg1-7+deb10u6+icu67+wmf1 to component/icu67 for buster-wikimedia (rebase of the ICU compat patches on top of the latest buster security update for libxml2) T345561 [production]
08:48 <btullis@cumin1001> START - Cookbook sre.wikireplicas.add-wiki [production]
08:41 <moritzm> downgrading dh-python on build2001 to the version which is in Bullseye. Before, 5.20230130~bpo11+1 was installed from bullseye-backports, but that version has dropped the python2 sequence we still need for some Buster builds [production]
08:25 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudmetrics1004.eqiad.wmnet with OS bookworm [production]
08:10 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudmetrics1004.eqiad.wmnet with reason: host reimage [production]
08:07 <taavi@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudmetrics1004.eqiad.wmnet with reason: host reimage [production]
07:55 <taavi@cumin1001> START - Cookbook sre.hosts.reimage for host cloudmetrics1004.eqiad.wmnet with OS bookworm [production]
07:54 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudmetrics1003.eqiad.wmnet with OS bookworm [production]
07:54 <ayounsi@cumin1001> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest1004.mgmt.eqiad.wmnet with reboot policy FORCED [production]
07:48 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudmetrics1004.eqiad.wmnet with reason: cloudmetrics1003 reimage [production]
07:48 <taavi@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudmetrics1004.eqiad.wmnet with reason: cloudmetrics1003 reimage [production]
07:39 <taavi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudmetrics1003.eqiad.wmnet with reason: host reimage [production]
07:36 <taavi@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudmetrics1003.eqiad.wmnet with reason: host reimage [production]
07:32 <ayounsi@cumin1001> START - Cookbook sre.hosts.provision for host sretest1004.mgmt.eqiad.wmnet with reboot policy FORCED [production]
07:24 <taavi@cumin1001> START - Cookbook sre.hosts.reimage for host cloudmetrics1003.eqiad.wmnet with OS bookworm [production]
06:12 <cmooney@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2003.codfw.wmnet with OS bullseye [production]
01:49 <cstone> civicrm upgraded from 70e0b88d to 74781efd [production]
2023-10-26 §
22:49 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns2006.wikimedia.org with OS bookworm [production]
22:10 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns2006.wikimedia.org with reason: host reimage [production]
22:07 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns2006.wikimedia.org with reason: host reimage [production]
21:47 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host dns2006.wikimedia.org with OS bookworm [production]
21:45 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
21:45 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]