6451-6500 of 10000 results (102ms)
2023-11-10 ยง
10:25 <moritzm> imported dh-php 0.35+wmf1+bullseye1 to component/php74 for bullseye-wikimedia [production]
10:16 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1109.eqiad.wmnet with OS bullseye [production]
10:16 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1109.eqiad.wmnet with OS bullseye [production]
10:10 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1109.eqiad.wmnet with OS bullseye [production]
10:09 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1109.eqiad.wmnet with OS bullseye [production]
10:05 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/ipoid: apply [production]
10:05 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/ipoid: apply [production]
10:02 <moritzm> imported php-excimer 1.0.2-1+wmf3+bullseye1 to component/php74 for bullseye-wikimedia [production]
10:02 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1109.eqiad.wmnet with OS bullseye [production]
10:01 <fabfur@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1109.eqiad.wmnet with OS bullseye [production]
09:57 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/ipoid: apply [production]
09:57 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/ipoid: apply [production]
09:54 <fabfur@cumin1001> START - Cookbook sre.hosts.reimage for host cp1109.eqiad.wmnet with OS bullseye [production]
09:29 <moritzm> imported wikidiff2 1.14.1-0+wmf1+bullseye1 to component/php74 for bullseye-wikimedia [production]
09:12 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1001.eqiad.wmnet [production]
09:09 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/ipoid: apply [production]
09:09 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/ipoid: apply [production]
09:07 <jelto@cumin1001> START - Cookbook sre.hosts.reboot-single for host vrts1001.eqiad.wmnet [production]
08:35 <moritzm> imported php-defaults 2:7.4+76+wmf1~bullseye1 to component/php74 for bullseye-wikimedia [production]
08:35 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/ipoid: apply [production]
08:34 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/ipoid: apply [production]
08:01 <moritzm> imported php7.4 1:7.4.33-1+0~20221108.73+debian10~1.gbpa00350a+wmf11u1 to component/php74 for bullseye-wikimedia [production]
07:34 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: insetup::search_platform [production]
07:01 <vgutierrez> cleaning up digicert-2022 update-ocsp config bits from cp servers [production]
06:29 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: insetup::search_platform [production]
03:20 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T348183)', diff saved to https://phabricator.wikimedia.org/P53289 and previous config saved to /var/cache/conftool/dbconfig/20231110-032053-arnaudb.json [production]
03:05 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P53288 and previous config saved to /var/cache/conftool/dbconfig/20231110-030547-arnaudb.json [production]
02:50 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P53287 and previous config saved to /var/cache/conftool/dbconfig/20231110-025041-arnaudb.json [production]
02:35 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T348183)', diff saved to https://phabricator.wikimedia.org/P53286 and previous config saved to /var/cache/conftool/dbconfig/20231110-023534-arnaudb.json [production]
02:23 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2180 (T348183)', diff saved to https://phabricator.wikimedia.org/P53285 and previous config saved to /var/cache/conftool/dbconfig/20231110-022351-arnaudb.json [production]
02:23 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2180.codfw.wmnet with reason: Maintenance [production]
02:23 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2180.codfw.wmnet with reason: Maintenance [production]
02:23 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2171:3316 (T348183)', diff saved to https://phabricator.wikimedia.org/P53284 and previous config saved to /var/cache/conftool/dbconfig/20231110-022330-arnaudb.json [production]
02:15 <tzatziki> removing 3 files for legal compliance [production]
02:08 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2171:3316', diff saved to https://phabricator.wikimedia.org/P53283 and previous config saved to /var/cache/conftool/dbconfig/20231110-020823-arnaudb.json [production]
01:58 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1114.eqiad.wmnet with OS bullseye [production]
01:53 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2171:3316', diff saved to https://phabricator.wikimedia.org/P53282 and previous config saved to /var/cache/conftool/dbconfig/20231110-015317-arnaudb.json [production]
01:42 <tzatziki> removing 16 files for legal compliance [production]
01:39 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1114.eqiad.wmnet with reason: host reimage [production]
01:38 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2171:3316 (T348183)', diff saved to https://phabricator.wikimedia.org/P53281 and previous config saved to /var/cache/conftool/dbconfig/20231110-013810-arnaudb.json [production]
01:36 <sukhe@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1114.eqiad.wmnet with reason: host reimage [production]
01:27 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1112.eqiad.wmnet with OS bullseye [production]
01:21 <sukhe@cumin1001> START - Cookbook sre.hosts.reimage for host cp1114.eqiad.wmnet with OS bullseye [production]
01:20 <sukhe@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1114.eqiad.wmnet with OS bullseye [production]
01:17 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2171:3316 (T348183)', diff saved to https://phabricator.wikimedia.org/P53280 and previous config saved to /var/cache/conftool/dbconfig/20231110-011712-arnaudb.json [production]
01:17 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
01:17 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
01:17 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2169:3316 (T348183)', diff saved to https://phabricator.wikimedia.org/P53279 and previous config saved to /var/cache/conftool/dbconfig/20231110-011701-arnaudb.json [production]
01:15 <sukhe@cumin1001> START - Cookbook sre.hosts.reimage for host cp1114.eqiad.wmnet with OS bullseye [production]
01:15 <sukhe@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1114.eqiad.wmnet with OS bullseye [production]