4451-4500 of 10000 results (79ms)
2022-05-30 ยง
23:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1147 (T60674)', diff saved to https://phabricator.wikimedia.org/P29162 and previous config saved to /var/cache/conftool/dbconfig/20220530-234929-ladsgroup.json [production]
23:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
23:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
23:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29161 and previous config saved to /var/cache/conftool/dbconfig/20220530-234921-ladsgroup.json [production]
23:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1118 (T60674)', diff saved to https://phabricator.wikimedia.org/P29160 and previous config saved to /var/cache/conftool/dbconfig/20220530-233834-ladsgroup.json [production]
23:38 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1118.eqiad.wmnet with reason: Maintenance [production]
23:38 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1118.eqiad.wmnet with reason: Maintenance [production]
23:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29159 and previous config saved to /var/cache/conftool/dbconfig/20220530-233826-ladsgroup.json [production]
23:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P29158 and previous config saved to /var/cache/conftool/dbconfig/20220530-233443-ladsgroup.json [production]
23:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P29157 and previous config saved to /var/cache/conftool/dbconfig/20220530-233416-ladsgroup.json [production]
23:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134', diff saved to https://phabricator.wikimedia.org/P29156 and previous config saved to /var/cache/conftool/dbconfig/20220530-232321-ladsgroup.json [production]
23:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T60674)', diff saved to https://phabricator.wikimedia.org/P29155 and previous config saved to /var/cache/conftool/dbconfig/20220530-231938-ladsgroup.json [production]
23:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P29154 and previous config saved to /var/cache/conftool/dbconfig/20220530-231911-ladsgroup.json [production]
23:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1168 (T60674)', diff saved to https://phabricator.wikimedia.org/P29153 and previous config saved to /var/cache/conftool/dbconfig/20220530-231731-ladsgroup.json [production]
23:17 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
23:17 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
23:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29152 and previous config saved to /var/cache/conftool/dbconfig/20220530-231723-ladsgroup.json [production]
23:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134', diff saved to https://phabricator.wikimedia.org/P29151 and previous config saved to /var/cache/conftool/dbconfig/20220530-230816-ladsgroup.json [production]
23:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29150 and previous config saved to /var/cache/conftool/dbconfig/20220530-230406-ladsgroup.json [production]
23:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P29149 and previous config saved to /var/cache/conftool/dbconfig/20220530-230217-ladsgroup.json [production]
22:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29148 and previous config saved to /var/cache/conftool/dbconfig/20220530-225311-ladsgroup.json [production]
22:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P29147 and previous config saved to /var/cache/conftool/dbconfig/20220530-224712-ladsgroup.json [production]
22:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29146 and previous config saved to /var/cache/conftool/dbconfig/20220530-223640-ladsgroup.json [production]
22:36 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1134.eqiad.wmnet with reason: Maintenance [production]
22:36 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1134.eqiad.wmnet with reason: Maintenance [production]
22:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T60674)', diff saved to https://phabricator.wikimedia.org/P29145 and previous config saved to /var/cache/conftool/dbconfig/20220530-223632-ladsgroup.json [production]
22:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29144 and previous config saved to /var/cache/conftool/dbconfig/20220530-223207-ladsgroup.json [production]
22:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29143 and previous config saved to /var/cache/conftool/dbconfig/20220530-223121-ladsgroup.json [production]
22:31 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
22:31 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
22:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29142 and previous config saved to /var/cache/conftool/dbconfig/20220530-223000-ladsgroup.json [production]
22:30 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
22:29 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
22:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29141 and previous config saved to /var/cache/conftool/dbconfig/20220530-222952-ladsgroup.json [production]
22:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29140 and previous config saved to /var/cache/conftool/dbconfig/20220530-222127-ladsgroup.json [production]
22:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P29139 and previous config saved to /var/cache/conftool/dbconfig/20220530-221447-ladsgroup.json [production]
22:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29138 and previous config saved to /var/cache/conftool/dbconfig/20220530-220622-ladsgroup.json [production]
22:01 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on 12 hosts with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on 12 hosts with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121 (T60674)', diff saved to https://phabricator.wikimedia.org/P29137 and previous config saved to /var/cache/conftool/dbconfig/20220530-220136-ladsgroup.json [production]
21:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P29136 and previous config saved to /var/cache/conftool/dbconfig/20220530-215942-ladsgroup.json [production]
21:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T60674)', diff saved to https://phabricator.wikimedia.org/P29135 and previous config saved to /var/cache/conftool/dbconfig/20220530-215116-ladsgroup.json [production]
21:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127 (T60674)', diff saved to https://phabricator.wikimedia.org/P29134 and previous config saved to /var/cache/conftool/dbconfig/20220530-214932-ladsgroup.json [production]
21:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121', diff saved to https://phabricator.wikimedia.org/P29133 and previous config saved to /var/cache/conftool/dbconfig/20220530-214631-ladsgroup.json [production]
21:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29132 and previous config saved to /var/cache/conftool/dbconfig/20220530-214437-ladsgroup.json [production]
21:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29131 and previous config saved to /var/cache/conftool/dbconfig/20220530-214230-ladsgroup.json [production]
21:42 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
21:42 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]