301-350 of 10000 results (48ms)
2022-04-17 ยง
04:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T298565)', diff saved to https://phabricator.wikimedia.org/P24795 and previous config saved to /var/cache/conftool/dbconfig/20220417-042815-ladsgroup.json [production]
04:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T298565)', diff saved to https://phabricator.wikimedia.org/P24794 and previous config saved to /var/cache/conftool/dbconfig/20220417-042129-ladsgroup.json [production]
04:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P24793 and previous config saved to /var/cache/conftool/dbconfig/20220417-041310-ladsgroup.json [production]
04:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1113:3316 (T298565)', diff saved to https://phabricator.wikimedia.org/P24792 and previous config saved to /var/cache/conftool/dbconfig/20220417-040956-ladsgroup.json [production]
04:09 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
04:09 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
04:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T298565)', diff saved to https://phabricator.wikimedia.org/P24791 and previous config saved to /var/cache/conftool/dbconfig/20220417-040948-ladsgroup.json [production]
03:58 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P24790 and previous config saved to /var/cache/conftool/dbconfig/20220417-035805-ladsgroup.json [production]
03:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P24789 and previous config saved to /var/cache/conftool/dbconfig/20220417-035443-ladsgroup.json [production]
03:43 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T298565)', diff saved to https://phabricator.wikimedia.org/P24788 and previous config saved to /var/cache/conftool/dbconfig/20220417-034300-ladsgroup.json [production]
03:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P24787 and previous config saved to /var/cache/conftool/dbconfig/20220417-033938-ladsgroup.json [production]
03:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1146:3314 (T298565)', diff saved to https://phabricator.wikimedia.org/P24786 and previous config saved to /var/cache/conftool/dbconfig/20220417-033104-ladsgroup.json [production]
03:31 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
03:31 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
03:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149 (T298565)', diff saved to https://phabricator.wikimedia.org/P24785 and previous config saved to /var/cache/conftool/dbconfig/20220417-033056-ladsgroup.json [production]
03:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T298565)', diff saved to https://phabricator.wikimedia.org/P24784 and previous config saved to /var/cache/conftool/dbconfig/20220417-032433-ladsgroup.json [production]
03:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149', diff saved to https://phabricator.wikimedia.org/P24783 and previous config saved to /var/cache/conftool/dbconfig/20220417-031551-ladsgroup.json [production]
03:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1168 (T298565)', diff saved to https://phabricator.wikimedia.org/P24782 and previous config saved to /var/cache/conftool/dbconfig/20220417-031117-ladsgroup.json [production]
03:11 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
03:11 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
03:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T298565)', diff saved to https://phabricator.wikimedia.org/P24781 and previous config saved to /var/cache/conftool/dbconfig/20220417-031109-ladsgroup.json [production]
03:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149', diff saved to https://phabricator.wikimedia.org/P24780 and previous config saved to /var/cache/conftool/dbconfig/20220417-030045-ladsgroup.json [production]
02:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P24779 and previous config saved to /var/cache/conftool/dbconfig/20220417-025604-ladsgroup.json [production]
02:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149 (T298565)', diff saved to https://phabricator.wikimedia.org/P24778 and previous config saved to /var/cache/conftool/dbconfig/20220417-024540-ladsgroup.json [production]
02:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P24777 and previous config saved to /var/cache/conftool/dbconfig/20220417-024059-ladsgroup.json [production]
02:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1149 (T298565)', diff saved to https://phabricator.wikimedia.org/P24776 and previous config saved to /var/cache/conftool/dbconfig/20220417-023403-ladsgroup.json [production]
02:34 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1149.eqiad.wmnet with reason: Maintenance [production]
02:33 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1149.eqiad.wmnet with reason: Maintenance [production]
02:33 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1148 (T298565)', diff saved to https://phabricator.wikimedia.org/P24775 and previous config saved to /var/cache/conftool/dbconfig/20220417-023354-ladsgroup.json [production]
02:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T298565)', diff saved to https://phabricator.wikimedia.org/P24774 and previous config saved to /var/cache/conftool/dbconfig/20220417-022554-ladsgroup.json [production]
02:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1165 (T298565)', diff saved to https://phabricator.wikimedia.org/P24773 and previous config saved to /var/cache/conftool/dbconfig/20220417-022143-ladsgroup.json [production]
02:21 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
02:21 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
02:21 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
02:21 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
02:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T298565)', diff saved to https://phabricator.wikimedia.org/P24772 and previous config saved to /var/cache/conftool/dbconfig/20220417-022124-ladsgroup.json [production]
02:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1148', diff saved to https://phabricator.wikimedia.org/P24771 and previous config saved to /var/cache/conftool/dbconfig/20220417-021849-ladsgroup.json [production]
02:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P24770 and previous config saved to /var/cache/conftool/dbconfig/20220417-020619-ladsgroup.json [production]
02:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1148', diff saved to https://phabricator.wikimedia.org/P24769 and previous config saved to /var/cache/conftool/dbconfig/20220417-020344-ladsgroup.json [production]
01:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P24768 and previous config saved to /var/cache/conftool/dbconfig/20220417-015114-ladsgroup.json [production]
01:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1148 (T298565)', diff saved to https://phabricator.wikimedia.org/P24767 and previous config saved to /var/cache/conftool/dbconfig/20220417-014839-ladsgroup.json [production]
01:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1148 (T298565)', diff saved to https://phabricator.wikimedia.org/P24766 and previous config saved to /var/cache/conftool/dbconfig/20220417-013713-ladsgroup.json [production]
01:37 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1148.eqiad.wmnet with reason: Maintenance [production]
01:37 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1148.eqiad.wmnet with reason: Maintenance [production]
01:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147 (T298565)', diff saved to https://phabricator.wikimedia.org/P24765 and previous config saved to /var/cache/conftool/dbconfig/20220417-013705-ladsgroup.json [production]
01:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T298565)', diff saved to https://phabricator.wikimedia.org/P24764 and previous config saved to /var/cache/conftool/dbconfig/20220417-013609-ladsgroup.json [production]
01:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147', diff saved to https://phabricator.wikimedia.org/P24763 and previous config saved to /var/cache/conftool/dbconfig/20220417-012200-ladsgroup.json [production]
01:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147', diff saved to https://phabricator.wikimedia.org/P24762 and previous config saved to /var/cache/conftool/dbconfig/20220417-010655-ladsgroup.json [production]
00:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147 (T298565)', diff saved to https://phabricator.wikimedia.org/P24761 and previous config saved to /var/cache/conftool/dbconfig/20220417-005150-ladsgroup.json [production]
00:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1147 (T298565)', diff saved to https://phabricator.wikimedia.org/P24760 and previous config saved to /var/cache/conftool/dbconfig/20220417-004013-ladsgroup.json [production]