7401-7450 of 10000 results (81ms)
2022-05-28 §
01:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1122 (T309311)', diff saved to https://phabricator.wikimedia.org/P28737 and previous config saved to /var/cache/conftool/dbconfig/20220528-013212-ladsgroup.json [production]
01:32 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1122.eqiad.wmnet with reason: Maintenance [production]
01:32 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1122.eqiad.wmnet with reason: Maintenance [production]
01:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1129 (T309311)', diff saved to https://phabricator.wikimedia.org/P28736 and previous config saved to /var/cache/conftool/dbconfig/20220528-013204-ladsgroup.json [production]
01:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1129', diff saved to https://phabricator.wikimedia.org/P28735 and previous config saved to /var/cache/conftool/dbconfig/20220528-011659-ladsgroup.json [production]
01:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1129', diff saved to https://phabricator.wikimedia.org/P28734 and previous config saved to /var/cache/conftool/dbconfig/20220528-010154-ladsgroup.json [production]
00:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1129 (T309311)', diff saved to https://phabricator.wikimedia.org/P28733 and previous config saved to /var/cache/conftool/dbconfig/20220528-004649-ladsgroup.json [production]
00:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1129 (T309311)', diff saved to https://phabricator.wikimedia.org/P28732 and previous config saved to /var/cache/conftool/dbconfig/20220528-002950-ladsgroup.json [production]
00:29 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1129.eqiad.wmnet with reason: Maintenance [production]
00:29 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1129.eqiad.wmnet with reason: Maintenance [production]
00:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182 (T309311)', diff saved to https://phabricator.wikimedia.org/P28731 and previous config saved to /var/cache/conftool/dbconfig/20220528-002942-ladsgroup.json [production]
00:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1136 (T298560)', diff saved to https://phabricator.wikimedia.org/P28730 and previous config saved to /var/cache/conftool/dbconfig/20220528-002804-ladsgroup.json [production]
00:28 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
00:27 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
00:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P28729 and previous config saved to /var/cache/conftool/dbconfig/20220528-001437-ladsgroup.json [production]
2022-05-27 §
23:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P28728 and previous config saved to /var/cache/conftool/dbconfig/20220527-235932-ladsgroup.json [production]
23:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182 (T309311)', diff saved to https://phabricator.wikimedia.org/P28727 and previous config saved to /var/cache/conftool/dbconfig/20220527-234427-ladsgroup.json [production]
23:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1182 (T309311)', diff saved to https://phabricator.wikimedia.org/P28726 and previous config saved to /var/cache/conftool/dbconfig/20220527-230040-ladsgroup.json [production]
23:00 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1182.eqiad.wmnet with reason: Maintenance [production]
23:00 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1182.eqiad.wmnet with reason: Maintenance [production]
22:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on 8 hosts with reason: Maintenance [production]
22:55 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on 8 hosts with reason: Maintenance [production]
22:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
22:55 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2104.codfw.wmnet with reason: Maintenance [production]
22:37 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
22:37 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
22:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28725 and previous config saved to /var/cache/conftool/dbconfig/20220527-223728-ladsgroup.json [production]
22:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T309311)', diff saved to https://phabricator.wikimedia.org/P28724 and previous config saved to /var/cache/conftool/dbconfig/20220527-222929-ladsgroup.json [production]
22:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3312', diff saved to https://phabricator.wikimedia.org/P28723 and previous config saved to /var/cache/conftool/dbconfig/20220527-222223-ladsgroup.json [production]
22:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T298560)', diff saved to https://phabricator.wikimedia.org/P28722 and previous config saved to /var/cache/conftool/dbconfig/20220527-221810-ladsgroup.json [production]
22:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P28721 and previous config saved to /var/cache/conftool/dbconfig/20220527-221424-ladsgroup.json [production]
22:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3312', diff saved to https://phabricator.wikimedia.org/P28720 and previous config saved to /var/cache/conftool/dbconfig/20220527-220718-ladsgroup.json [production]
22:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P28719 and previous config saved to /var/cache/conftool/dbconfig/20220527-220305-ladsgroup.json [production]
21:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P28718 and previous config saved to /var/cache/conftool/dbconfig/20220527-215919-ladsgroup.json [production]
21:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28717 and previous config saved to /var/cache/conftool/dbconfig/20220527-215213-ladsgroup.json [production]
21:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P28716 and previous config saved to /var/cache/conftool/dbconfig/20220527-214800-ladsgroup.json [production]
21:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T309311)', diff saved to https://phabricator.wikimedia.org/P28715 and previous config saved to /var/cache/conftool/dbconfig/20220527-214414-ladsgroup.json [production]
21:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1168 (T309311)', diff saved to https://phabricator.wikimedia.org/P28714 and previous config saved to /var/cache/conftool/dbconfig/20220527-213957-ladsgroup.json [production]
21:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
21:39 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
21:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T309311)', diff saved to https://phabricator.wikimedia.org/P28713 and previous config saved to /var/cache/conftool/dbconfig/20220527-213949-ladsgroup.json [production]
21:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T298560)', diff saved to https://phabricator.wikimedia.org/P28712 and previous config saved to /var/cache/conftool/dbconfig/20220527-213255-ladsgroup.json [production]
21:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1105:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28711 and previous config saved to /var/cache/conftool/dbconfig/20220527-213028-ladsgroup.json [production]
21:30 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1105.eqiad.wmnet with reason: Maintenance [production]
21:30 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1105.eqiad.wmnet with reason: Maintenance [production]
21:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28710 and previous config saved to /var/cache/conftool/dbconfig/20220527-213020-ladsgroup.json [production]
21:30 <wfan> payments-wiki change from 59c7239e to 225d946e [production]
21:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P28709 and previous config saved to /var/cache/conftool/dbconfig/20220527-212444-ladsgroup.json [production]
21:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312', diff saved to https://phabricator.wikimedia.org/P28708 and previous config saved to /var/cache/conftool/dbconfig/20220527-211515-ladsgroup.json [production]
21:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P28707 and previous config saved to /var/cache/conftool/dbconfig/20220527-210939-ladsgroup.json [production]