2101-2150 of 10000 results (70ms)
2023-08-28 ยง
07:18 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1143.eqiad.wmnet with reason: Maintenance [production]
07:18 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1143.eqiad.wmnet with reason: Maintenance [production]
07:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142 (T344589)', diff saved to https://phabricator.wikimedia.org/P51473 and previous config saved to /var/cache/conftool/dbconfig/20230828-071800-ladsgroup.json [production]
07:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T344589)', diff saved to https://phabricator.wikimedia.org/P51472 and previous config saved to /var/cache/conftool/dbconfig/20230828-071503-ladsgroup.json [production]
07:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103', diff saved to https://phabricator.wikimedia.org/P51471 and previous config saved to /var/cache/conftool/dbconfig/20230828-071117-ladsgroup.json [production]
07:11 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host bast5003.wikimedia.org [production]
07:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1203 (T344589)', diff saved to https://phabricator.wikimedia.org/P51470 and previous config saved to /var/cache/conftool/dbconfig/20230828-070847-ladsgroup.json [production]
07:08 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1203.eqiad.wmnet with reason: Maintenance [production]
07:08 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1203.eqiad.wmnet with reason: Maintenance [production]
07:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T344589)', diff saved to https://phabricator.wikimedia.org/P51469 and previous config saved to /var/cache/conftool/dbconfig/20230828-070823-ladsgroup.json [production]
07:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance es2026 (T344589)', diff saved to https://phabricator.wikimedia.org/P51468 and previous config saved to /var/cache/conftool/dbconfig/20230828-070453-ladsgroup.json [production]
07:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142', diff saved to https://phabricator.wikimedia.org/P51467 and previous config saved to /var/cache/conftool/dbconfig/20230828-070254-ladsgroup.json [production]
06:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling es2026 (T344589)', diff saved to https://phabricator.wikimedia.org/P51466 and previous config saved to /var/cache/conftool/dbconfig/20230828-065958-ladsgroup.json [production]
06:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on es2026.codfw.wmnet with reason: Maintenance [production]
06:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on es2026.codfw.wmnet with reason: Maintenance [production]
06:59 <moritzm> installing perf updates on bullseye hosts [production]
06:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103', diff saved to https://phabricator.wikimedia.org/P51465 and previous config saved to /var/cache/conftool/dbconfig/20230828-065611-ladsgroup.json [production]
06:55 <moritzm> installing nftables bugfix update from bullseye point release [production]
06:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P51464 and previous config saved to /var/cache/conftool/dbconfig/20230828-065316-ladsgroup.json [production]
06:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2110', diff saved to https://phabricator.wikimedia.org/P51463 and previous config saved to /var/cache/conftool/dbconfig/20230828-064948-ladsgroup.json [production]
06:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142', diff saved to https://phabricator.wikimedia.org/P51462 and previous config saved to /var/cache/conftool/dbconfig/20230828-064748-ladsgroup.json [production]
06:46 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
06:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
06:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103 (T343718)', diff saved to https://phabricator.wikimedia.org/P51461 and previous config saved to /var/cache/conftool/dbconfig/20230828-064105-ladsgroup.json [production]
06:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1193', diff saved to https://phabricator.wikimedia.org/P51460 and previous config saved to /var/cache/conftool/dbconfig/20230828-063810-ladsgroup.json [production]
06:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2110 (T344589)', diff saved to https://phabricator.wikimedia.org/P51459 and previous config saved to /var/cache/conftool/dbconfig/20230828-063442-ladsgroup.json [production]
06:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142 (T344589)', diff saved to https://phabricator.wikimedia.org/P51458 and previous config saved to /var/cache/conftool/dbconfig/20230828-063242-ladsgroup.json [production]
06:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2110 (T344589)', diff saved to https://phabricator.wikimedia.org/P51457 and previous config saved to /var/cache/conftool/dbconfig/20230828-062805-ladsgroup.json [production]
06:27 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
06:27 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
06:27 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2106 (T344589)', diff saved to https://phabricator.wikimedia.org/P51456 and previous config saved to /var/cache/conftool/dbconfig/20230828-062740-ladsgroup.json [production]
06:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1142 (T344589)', diff saved to https://phabricator.wikimedia.org/P51455 and previous config saved to /var/cache/conftool/dbconfig/20230828-062617-ladsgroup.json [production]
06:26 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1142.eqiad.wmnet with reason: Maintenance [production]
06:25 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1142.eqiad.wmnet with reason: Maintenance [production]
06:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141 (T344589)', diff saved to https://phabricator.wikimedia.org/P51454 and previous config saved to /var/cache/conftool/dbconfig/20230828-062552-ladsgroup.json [production]
06:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T344589)', diff saved to https://phabricator.wikimedia.org/P51453 and previous config saved to /var/cache/conftool/dbconfig/20230828-062304-ladsgroup.json [production]
06:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1193 (T344589)', diff saved to https://phabricator.wikimedia.org/P51452 and previous config saved to /var/cache/conftool/dbconfig/20230828-061651-ladsgroup.json [production]
06:16 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1193.eqiad.wmnet with reason: Maintenance [production]
06:16 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1193.eqiad.wmnet with reason: Maintenance [production]
06:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1192 (T344589)', diff saved to https://phabricator.wikimedia.org/P51451 and previous config saved to /var/cache/conftool/dbconfig/20230828-061627-ladsgroup.json [production]
06:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2106', diff saved to https://phabricator.wikimedia.org/P51450 and previous config saved to /var/cache/conftool/dbconfig/20230828-061233-ladsgroup.json [production]
06:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P51449 and previous config saved to /var/cache/conftool/dbconfig/20230828-061046-ladsgroup.json [production]
06:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2103 (T343718)', diff saved to https://phabricator.wikimedia.org/P51448 and previous config saved to /var/cache/conftool/dbconfig/20230828-060317-ladsgroup.json [production]
06:03 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
06:02 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
06:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P51447 and previous config saved to /var/cache/conftool/dbconfig/20230828-060121-ladsgroup.json [production]
05:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1178 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P51446 and previous config saved to /var/cache/conftool/dbconfig/20230828-055751-ladsgroup.json [production]
05:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2106', diff saved to https://phabricator.wikimedia.org/P51445 and previous config saved to /var/cache/conftool/dbconfig/20230828-055727-ladsgroup.json [production]
05:56 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:952202|Stop writing to old extlinks columns in s4 (T342683)]] (duration: 15m 36s) [production]
05:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P51444 and previous config saved to /var/cache/conftool/dbconfig/20230828-055539-ladsgroup.json [production]