3151-3200 of 10000 results (59ms)
2022-05-30 ยง
22:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29142 and previous config saved to /var/cache/conftool/dbconfig/20220530-223000-ladsgroup.json [production]
22:30 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
22:29 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
22:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29141 and previous config saved to /var/cache/conftool/dbconfig/20220530-222952-ladsgroup.json [production]
22:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29140 and previous config saved to /var/cache/conftool/dbconfig/20220530-222127-ladsgroup.json [production]
22:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P29139 and previous config saved to /var/cache/conftool/dbconfig/20220530-221447-ladsgroup.json [production]
22:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29138 and previous config saved to /var/cache/conftool/dbconfig/20220530-220622-ladsgroup.json [production]
22:01 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on 12 hosts with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on 12 hosts with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2110.codfw.wmnet with reason: Maintenance [production]
22:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121 (T60674)', diff saved to https://phabricator.wikimedia.org/P29137 and previous config saved to /var/cache/conftool/dbconfig/20220530-220136-ladsgroup.json [production]
21:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P29136 and previous config saved to /var/cache/conftool/dbconfig/20220530-215942-ladsgroup.json [production]
21:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T60674)', diff saved to https://phabricator.wikimedia.org/P29135 and previous config saved to /var/cache/conftool/dbconfig/20220530-215116-ladsgroup.json [production]
21:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127 (T60674)', diff saved to https://phabricator.wikimedia.org/P29134 and previous config saved to /var/cache/conftool/dbconfig/20220530-214932-ladsgroup.json [production]
21:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121', diff saved to https://phabricator.wikimedia.org/P29133 and previous config saved to /var/cache/conftool/dbconfig/20220530-214631-ladsgroup.json [production]
21:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29132 and previous config saved to /var/cache/conftool/dbconfig/20220530-214437-ladsgroup.json [production]
21:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1165 (T60674)', diff saved to https://phabricator.wikimedia.org/P29131 and previous config saved to /var/cache/conftool/dbconfig/20220530-214230-ladsgroup.json [production]
21:42 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
21:42 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
21:42 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
21:42 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
21:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29130 and previous config saved to /var/cache/conftool/dbconfig/20220530-214216-ladsgroup.json [production]
21:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1135 (T60674)', diff saved to https://phabricator.wikimedia.org/P29129 and previous config saved to /var/cache/conftool/dbconfig/20220530-213449-ladsgroup.json [production]
21:34 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1135.eqiad.wmnet with reason: Maintenance [production]
21:34 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1135.eqiad.wmnet with reason: Maintenance [production]
21:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127', diff saved to https://phabricator.wikimedia.org/P29128 and previous config saved to /var/cache/conftool/dbconfig/20220530-213427-ladsgroup.json [production]
21:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121', diff saved to https://phabricator.wikimedia.org/P29127 and previous config saved to /var/cache/conftool/dbconfig/20220530-213126-ladsgroup.json [production]
21:27 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316', diff saved to https://phabricator.wikimedia.org/P29126 and previous config saved to /var/cache/conftool/dbconfig/20220530-212711-ladsgroup.json [production]
21:21 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1140.eqiad.wmnet with reason: Maintenance [production]
21:20 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1140.eqiad.wmnet with reason: Maintenance [production]
21:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29125 and previous config saved to /var/cache/conftool/dbconfig/20220530-212051-ladsgroup.json [production]
21:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127', diff saved to https://phabricator.wikimedia.org/P29124 and previous config saved to /var/cache/conftool/dbconfig/20220530-211922-ladsgroup.json [production]
21:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1121 (T60674)', diff saved to https://phabricator.wikimedia.org/P29123 and previous config saved to /var/cache/conftool/dbconfig/20220530-211621-ladsgroup.json [production]
21:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316', diff saved to https://phabricator.wikimedia.org/P29122 and previous config saved to /var/cache/conftool/dbconfig/20220530-211206-ladsgroup.json [production]
21:05 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106', diff saved to https://phabricator.wikimedia.org/P29121 and previous config saved to /var/cache/conftool/dbconfig/20220530-210546-ladsgroup.json [production]
21:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1127 (T60674)', diff saved to https://phabricator.wikimedia.org/P29120 and previous config saved to /var/cache/conftool/dbconfig/20220530-210416-ladsgroup.json [production]
20:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1096:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29119 and previous config saved to /var/cache/conftool/dbconfig/20220530-205701-ladsgroup.json [production]
20:50 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106', diff saved to https://phabricator.wikimedia.org/P29118 and previous config saved to /var/cache/conftool/dbconfig/20220530-205041-ladsgroup.json [production]
20:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1096:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29117 and previous config saved to /var/cache/conftool/dbconfig/20220530-204924-ladsgroup.json [production]
20:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1096.eqiad.wmnet with reason: Maintenance [production]
20:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1096.eqiad.wmnet with reason: Maintenance [production]
20:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1127 (T60674)', diff saved to https://phabricator.wikimedia.org/P29116 and previous config saved to /var/cache/conftool/dbconfig/20220530-204432-ladsgroup.json [production]
20:44 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1127.eqiad.wmnet with reason: Maintenance [production]
20:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1127.eqiad.wmnet with reason: Maintenance [production]
20:43 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1005.eqiad.wmnet with reason: Maintenance [production]
20:43 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1005.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1121 (T60674)', diff saved to https://phabricator.wikimedia.org/P29115 and previous config saved to /var/cache/conftool/dbconfig/20220530-204137-ladsgroup.json [production]
20:41 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]