2901-2950 of 10000 results (67ms)
2022-05-27 ยง
21:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28717 and previous config saved to /var/cache/conftool/dbconfig/20220527-215213-ladsgroup.json [production]
21:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P28716 and previous config saved to /var/cache/conftool/dbconfig/20220527-214800-ladsgroup.json [production]
21:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T309311)', diff saved to https://phabricator.wikimedia.org/P28715 and previous config saved to /var/cache/conftool/dbconfig/20220527-214414-ladsgroup.json [production]
21:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1168 (T309311)', diff saved to https://phabricator.wikimedia.org/P28714 and previous config saved to /var/cache/conftool/dbconfig/20220527-213957-ladsgroup.json [production]
21:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
21:39 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
21:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T309311)', diff saved to https://phabricator.wikimedia.org/P28713 and previous config saved to /var/cache/conftool/dbconfig/20220527-213949-ladsgroup.json [production]
21:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T298560)', diff saved to https://phabricator.wikimedia.org/P28712 and previous config saved to /var/cache/conftool/dbconfig/20220527-213255-ladsgroup.json [production]
21:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1105:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28711 and previous config saved to /var/cache/conftool/dbconfig/20220527-213028-ladsgroup.json [production]
21:30 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1105.eqiad.wmnet with reason: Maintenance [production]
21:30 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1105.eqiad.wmnet with reason: Maintenance [production]
21:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28710 and previous config saved to /var/cache/conftool/dbconfig/20220527-213020-ladsgroup.json [production]
21:30 <wfan> payments-wiki change from 59c7239e to 225d946e [production]
21:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P28709 and previous config saved to /var/cache/conftool/dbconfig/20220527-212444-ladsgroup.json [production]
21:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312', diff saved to https://phabricator.wikimedia.org/P28708 and previous config saved to /var/cache/conftool/dbconfig/20220527-211515-ladsgroup.json [production]
21:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P28707 and previous config saved to /var/cache/conftool/dbconfig/20220527-210939-ladsgroup.json [production]
21:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312', diff saved to https://phabricator.wikimedia.org/P28706 and previous config saved to /var/cache/conftool/dbconfig/20220527-210010-ladsgroup.json [production]
20:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T309311)', diff saved to https://phabricator.wikimedia.org/P28705 and previous config saved to /var/cache/conftool/dbconfig/20220527-205434-ladsgroup.json [production]
20:50 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1180 (T309311)', diff saved to https://phabricator.wikimedia.org/P28704 and previous config saved to /var/cache/conftool/dbconfig/20220527-205017-ladsgroup.json [production]
20:50 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
20:50 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
20:50 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T309311)', diff saved to https://phabricator.wikimedia.org/P28703 and previous config saved to /var/cache/conftool/dbconfig/20220527-205009-ladsgroup.json [production]
20:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28702 and previous config saved to /var/cache/conftool/dbconfig/20220527-204505-ladsgroup.json [production]
20:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P28701 and previous config saved to /var/cache/conftool/dbconfig/20220527-203504-ladsgroup.json [production]
20:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P28700 and previous config saved to /var/cache/conftool/dbconfig/20220527-201959-ladsgroup.json [production]
20:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T309311)', diff saved to https://phabricator.wikimedia.org/P28699 and previous config saved to /var/cache/conftool/dbconfig/20220527-200453-ladsgroup.json [production]
20:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3315 (T60674)', diff saved to https://phabricator.wikimedia.org/P28698 and previous config saved to /var/cache/conftool/dbconfig/20220527-200344-ladsgroup.json [production]
20:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1165 (T309311)', diff saved to https://phabricator.wikimedia.org/P28697 and previous config saved to /var/cache/conftool/dbconfig/20220527-200037-ladsgroup.json [production]
20:00 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
20:00 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
20:00 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
20:00 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
20:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316 (T309311)', diff saved to https://phabricator.wikimedia.org/P28696 and previous config saved to /var/cache/conftool/dbconfig/20220527-200023-ladsgroup.json [production]
19:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1146:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28695 and previous config saved to /var/cache/conftool/dbconfig/20220527-195539-ladsgroup.json [production]
19:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
19:55 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
19:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28694 and previous config saved to /var/cache/conftool/dbconfig/20220527-195531-ladsgroup.json [production]
19:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3315', diff saved to https://phabricator.wikimedia.org/P28693 and previous config saved to /var/cache/conftool/dbconfig/20220527-194839-ladsgroup.json [production]
19:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316', diff saved to https://phabricator.wikimedia.org/P28692 and previous config saved to /var/cache/conftool/dbconfig/20220527-194518-ladsgroup.json [production]
19:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312', diff saved to https://phabricator.wikimedia.org/P28691 and previous config saved to /var/cache/conftool/dbconfig/20220527-194026-ladsgroup.json [production]
19:33 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3315', diff saved to https://phabricator.wikimedia.org/P28690 and previous config saved to /var/cache/conftool/dbconfig/20220527-193334-ladsgroup.json [production]
19:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316', diff saved to https://phabricator.wikimedia.org/P28689 and previous config saved to /var/cache/conftool/dbconfig/20220527-193013-ladsgroup.json [production]
19:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312', diff saved to https://phabricator.wikimedia.org/P28688 and previous config saved to /var/cache/conftool/dbconfig/20220527-192521-ladsgroup.json [production]
19:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3315 (T60674)', diff saved to https://phabricator.wikimedia.org/P28687 and previous config saved to /var/cache/conftool/dbconfig/20220527-191829-ladsgroup.json [production]
19:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316 (T309311)', diff saved to https://phabricator.wikimedia.org/P28686 and previous config saved to /var/cache/conftool/dbconfig/20220527-191508-ladsgroup.json [production]
19:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1113:3315 (T60674)', diff saved to https://phabricator.wikimedia.org/P28685 and previous config saved to /var/cache/conftool/dbconfig/20220527-191047-ladsgroup.json [production]
19:10 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
19:10 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
19:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1110 (T60674)', diff saved to https://phabricator.wikimedia.org/P28684 and previous config saved to /var/cache/conftool/dbconfig/20220527-191039-ladsgroup.json [production]
19:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312 (T309311)', diff saved to https://phabricator.wikimedia.org/P28683 and previous config saved to /var/cache/conftool/dbconfig/20220527-191015-ladsgroup.json [production]