4951-5000 of 10000 results (67ms)
2022-05-31 §
02:30 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
02:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
02:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
02:07 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
02:04 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
02:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
02:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
01:58 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147 (T60674)', diff saved to https://phabricator.wikimedia.org/P29172 and previous config saved to /var/cache/conftool/dbconfig/20220531-015850-ladsgroup.json [production]
01:43 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147', diff saved to https://phabricator.wikimedia.org/P29171 and previous config saved to /var/cache/conftool/dbconfig/20220531-014345-ladsgroup.json [production]
01:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147', diff saved to https://phabricator.wikimedia.org/P29170 and previous config saved to /var/cache/conftool/dbconfig/20220531-012840-ladsgroup.json [production]
01:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1147 (T60674)', diff saved to https://phabricator.wikimedia.org/P29169 and previous config saved to /var/cache/conftool/dbconfig/20220531-011335-ladsgroup.json [production]
00:39 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1133.eqiad.wmnet with reason: Maintenance [production]
00:39 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1133.eqiad.wmnet with reason: Maintenance [production]
00:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118 (T60674)', diff saved to https://phabricator.wikimedia.org/P29168 and previous config saved to /var/cache/conftool/dbconfig/20220531-003947-ladsgroup.json [production]
00:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118', diff saved to https://phabricator.wikimedia.org/P29167 and previous config saved to /var/cache/conftool/dbconfig/20220531-002442-ladsgroup.json [production]
00:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118', diff saved to https://phabricator.wikimedia.org/P29166 and previous config saved to /var/cache/conftool/dbconfig/20220531-000937-ladsgroup.json [production]
00:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T60674)', diff saved to https://phabricator.wikimedia.org/P29165 and previous config saved to /var/cache/conftool/dbconfig/20220531-000452-ladsgroup.json [production]
2022-05-30 §
23:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118 (T60674)', diff saved to https://phabricator.wikimedia.org/P29164 and previous config saved to /var/cache/conftool/dbconfig/20220530-235432-ladsgroup.json [production]
23:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P29163 and previous config saved to /var/cache/conftool/dbconfig/20220530-234947-ladsgroup.json [production]
23:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1147 (T60674)', diff saved to https://phabricator.wikimedia.org/P29162 and previous config saved to /var/cache/conftool/dbconfig/20220530-234929-ladsgroup.json [production]
23:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
23:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
23:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29161 and previous config saved to /var/cache/conftool/dbconfig/20220530-234921-ladsgroup.json [production]
23:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1118 (T60674)', diff saved to https://phabricator.wikimedia.org/P29160 and previous config saved to /var/cache/conftool/dbconfig/20220530-233834-ladsgroup.json [production]
23:38 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1118.eqiad.wmnet with reason: Maintenance [production]
23:38 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1118.eqiad.wmnet with reason: Maintenance [production]
23:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29159 and previous config saved to /var/cache/conftool/dbconfig/20220530-233826-ladsgroup.json [production]
23:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168', diff saved to https://phabricator.wikimedia.org/P29158 and previous config saved to /var/cache/conftool/dbconfig/20220530-233443-ladsgroup.json [production]
23:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P29157 and previous config saved to /var/cache/conftool/dbconfig/20220530-233416-ladsgroup.json [production]
23:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134', diff saved to https://phabricator.wikimedia.org/P29156 and previous config saved to /var/cache/conftool/dbconfig/20220530-232321-ladsgroup.json [production]
23:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1168 (T60674)', diff saved to https://phabricator.wikimedia.org/P29155 and previous config saved to /var/cache/conftool/dbconfig/20220530-231938-ladsgroup.json [production]
23:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P29154 and previous config saved to /var/cache/conftool/dbconfig/20220530-231911-ladsgroup.json [production]
23:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1168 (T60674)', diff saved to https://phabricator.wikimedia.org/P29153 and previous config saved to /var/cache/conftool/dbconfig/20220530-231731-ladsgroup.json [production]
23:17 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
23:17 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
23:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29152 and previous config saved to /var/cache/conftool/dbconfig/20220530-231723-ladsgroup.json [production]
23:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134', diff saved to https://phabricator.wikimedia.org/P29151 and previous config saved to /var/cache/conftool/dbconfig/20220530-230816-ladsgroup.json [production]
23:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29150 and previous config saved to /var/cache/conftool/dbconfig/20220530-230406-ladsgroup.json [production]
23:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P29149 and previous config saved to /var/cache/conftool/dbconfig/20220530-230217-ladsgroup.json [production]
22:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29148 and previous config saved to /var/cache/conftool/dbconfig/20220530-225311-ladsgroup.json [production]
22:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P29147 and previous config saved to /var/cache/conftool/dbconfig/20220530-224712-ladsgroup.json [production]
22:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1134 (T60674)', diff saved to https://phabricator.wikimedia.org/P29146 and previous config saved to /var/cache/conftool/dbconfig/20220530-223640-ladsgroup.json [production]
22:36 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1134.eqiad.wmnet with reason: Maintenance [production]
22:36 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1134.eqiad.wmnet with reason: Maintenance [production]
22:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T60674)', diff saved to https://phabricator.wikimedia.org/P29145 and previous config saved to /var/cache/conftool/dbconfig/20220530-223632-ladsgroup.json [production]
22:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29144 and previous config saved to /var/cache/conftool/dbconfig/20220530-223207-ladsgroup.json [production]
22:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1146:3314 (T60674)', diff saved to https://phabricator.wikimedia.org/P29143 and previous config saved to /var/cache/conftool/dbconfig/20220530-223121-ladsgroup.json [production]
22:31 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
22:31 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
22:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1180 (T60674)', diff saved to https://phabricator.wikimedia.org/P29142 and previous config saved to /var/cache/conftool/dbconfig/20220530-223000-ladsgroup.json [production]