1001-1050 of 10000 results (56ms)
2022-05-30 ยง
20:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29112 and previous config saved to /var/cache/conftool/dbconfig/20220530-203536-ladsgroup.json [production]
20:29 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
20:29 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
20:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29111 and previous config saved to /var/cache/conftool/dbconfig/20220530-202923-ladsgroup.json [production]
20:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29110 and previous config saved to /var/cache/conftool/dbconfig/20220530-202618-ladsgroup.json [production]
20:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29109 and previous config saved to /var/cache/conftool/dbconfig/20220530-202243-ladsgroup.json [production]
20:20 <SandraEbele> Restarted ooze job pageview-druid-daily-coord [production]
20:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29108 and previous config saved to /var/cache/conftool/dbconfig/20220530-201934-ladsgroup.json [production]
20:19 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29107 and previous config saved to /var/cache/conftool/dbconfig/20220530-201921-ladsgroup.json [production]
20:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29106 and previous config saved to /var/cache/conftool/dbconfig/20220530-201418-ladsgroup.json [production]
20:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29105 and previous config saved to /var/cache/conftool/dbconfig/20220530-201113-ladsgroup.json [production]
20:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29104 and previous config saved to /var/cache/conftool/dbconfig/20220530-200738-ladsgroup.json [production]
20:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29103 and previous config saved to /var/cache/conftool/dbconfig/20220530-200416-ladsgroup.json [production]
19:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29102 and previous config saved to /var/cache/conftool/dbconfig/20220530-195913-ladsgroup.json [production]
19:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141 (T60674)', diff saved to https://phabricator.wikimedia.org/P29101 and previous config saved to /var/cache/conftool/dbconfig/20220530-195608-ladsgroup.json [production]
19:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29100 and previous config saved to /var/cache/conftool/dbconfig/20220530-195233-ladsgroup.json [production]
19:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29099 and previous config saved to /var/cache/conftool/dbconfig/20220530-194910-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29098 and previous config saved to /var/cache/conftool/dbconfig/20220530-194436-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance [production]
19:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29097 and previous config saved to /var/cache/conftool/dbconfig/20220530-194428-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29096 and previous config saved to /var/cache/conftool/dbconfig/20220530-194408-ladsgroup.json [production]
19:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29095 and previous config saved to /var/cache/conftool/dbconfig/20220530-194158-ladsgroup.json [production]
19:42 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
19:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
19:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29094 and previous config saved to /var/cache/conftool/dbconfig/20220530-194150-ladsgroup.json [production]
19:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29093 and previous config saved to /var/cache/conftool/dbconfig/20220530-193405-ladsgroup.json [production]
19:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29092 and previous config saved to /var/cache/conftool/dbconfig/20220530-192923-ladsgroup.json [production]
19:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P29091 and previous config saved to /var/cache/conftool/dbconfig/20220530-192645-ladsgroup.json [production]
19:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29090 and previous config saved to /var/cache/conftool/dbconfig/20220530-191808-ladsgroup.json [production]
19:18 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance [production]
19:18 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance [production]
19:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311 (T60674)', diff saved to https://phabricator.wikimedia.org/P29089 and previous config saved to /var/cache/conftool/dbconfig/20220530-191800-ladsgroup.json [production]
19:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29088 and previous config saved to /var/cache/conftool/dbconfig/20220530-191418-ladsgroup.json [production]
19:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P29087 and previous config saved to /var/cache/conftool/dbconfig/20220530-191140-ladsgroup.json [production]
19:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311', diff saved to https://phabricator.wikimedia.org/P29086 and previous config saved to /var/cache/conftool/dbconfig/20220530-190255-ladsgroup.json [production]
18:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29085 and previous config saved to /var/cache/conftool/dbconfig/20220530-185913-ladsgroup.json [production]
18:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29084 and previous config saved to /var/cache/conftool/dbconfig/20220530-185635-ladsgroup.json [production]
18:53 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29083 and previous config saved to /var/cache/conftool/dbconfig/20220530-185149-ladsgroup.json [production]
18:51 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
18:51 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance [production]
18:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1131 (T60674)', diff saved to https://phabricator.wikimedia.org/P29082 and previous config saved to /var/cache/conftool/dbconfig/20220530-185140-ladsgroup.json [production]
18:49 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:49 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311', diff saved to https://phabricator.wikimedia.org/P29081 and previous config saved to /var/cache/conftool/dbconfig/20220530-184750-ladsgroup.json [production]