951-1000 of 10000 results (51ms)
2022-05-30 ยง
20:43 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1005.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1121 (T60674)', diff saved to https://phabricator.wikimedia.org/P29115 and previous config saved to /var/cache/conftool/dbconfig/20220530-204137-ladsgroup.json [production]
20:41 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1015,1019,1021].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1121.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1121.eqiad.wmnet with reason: Maintenance [production]
20:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141 (T60674)', diff saved to https://phabricator.wikimedia.org/P29114 and previous config saved to /var/cache/conftool/dbconfig/20220530-204123-ladsgroup.json [production]
20:38 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on 8 hosts with reason: Maintenance [production]
20:38 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on 8 hosts with reason: Maintenance [production]
20:38 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2129.codfw.wmnet with reason: Maintenance [production]
20:37 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2129.codfw.wmnet with reason: Maintenance [production]
20:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29113 and previous config saved to /var/cache/conftool/dbconfig/20220530-203748-ladsgroup.json [production]
20:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29112 and previous config saved to /var/cache/conftool/dbconfig/20220530-203536-ladsgroup.json [production]
20:29 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
20:29 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
20:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29111 and previous config saved to /var/cache/conftool/dbconfig/20220530-202923-ladsgroup.json [production]
20:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29110 and previous config saved to /var/cache/conftool/dbconfig/20220530-202618-ladsgroup.json [production]
20:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29109 and previous config saved to /var/cache/conftool/dbconfig/20220530-202243-ladsgroup.json [production]
20:20 <SandraEbele> Restarted ooze job pageview-druid-daily-coord [production]
20:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29108 and previous config saved to /var/cache/conftool/dbconfig/20220530-201934-ladsgroup.json [production]
20:19 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance [production]
20:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29107 and previous config saved to /var/cache/conftool/dbconfig/20220530-201921-ladsgroup.json [production]
20:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29106 and previous config saved to /var/cache/conftool/dbconfig/20220530-201418-ladsgroup.json [production]
20:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29105 and previous config saved to /var/cache/conftool/dbconfig/20220530-201113-ladsgroup.json [production]
20:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29104 and previous config saved to /var/cache/conftool/dbconfig/20220530-200738-ladsgroup.json [production]
20:04 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29103 and previous config saved to /var/cache/conftool/dbconfig/20220530-200416-ladsgroup.json [production]
19:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29102 and previous config saved to /var/cache/conftool/dbconfig/20220530-195913-ladsgroup.json [production]
19:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141 (T60674)', diff saved to https://phabricator.wikimedia.org/P29101 and previous config saved to /var/cache/conftool/dbconfig/20220530-195608-ladsgroup.json [production]
19:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29100 and previous config saved to /var/cache/conftool/dbconfig/20220530-195233-ladsgroup.json [production]
19:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29099 and previous config saved to /var/cache/conftool/dbconfig/20220530-194910-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29098 and previous config saved to /var/cache/conftool/dbconfig/20220530-194436-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance [production]
19:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29097 and previous config saved to /var/cache/conftool/dbconfig/20220530-194428-ladsgroup.json [production]
19:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29096 and previous config saved to /var/cache/conftool/dbconfig/20220530-194408-ladsgroup.json [production]
19:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29095 and previous config saved to /var/cache/conftool/dbconfig/20220530-194158-ladsgroup.json [production]
19:42 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
19:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance [production]
19:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29094 and previous config saved to /var/cache/conftool/dbconfig/20220530-194150-ladsgroup.json [production]
19:34 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29093 and previous config saved to /var/cache/conftool/dbconfig/20220530-193405-ladsgroup.json [production]
19:29 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29092 and previous config saved to /var/cache/conftool/dbconfig/20220530-192923-ladsgroup.json [production]
19:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P29091 and previous config saved to /var/cache/conftool/dbconfig/20220530-192645-ladsgroup.json [production]
19:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29090 and previous config saved to /var/cache/conftool/dbconfig/20220530-191808-ladsgroup.json [production]
19:18 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance [production]
19:18 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance [production]
19:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311 (T60674)', diff saved to https://phabricator.wikimedia.org/P29089 and previous config saved to /var/cache/conftool/dbconfig/20220530-191800-ladsgroup.json [production]
19:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29088 and previous config saved to /var/cache/conftool/dbconfig/20220530-191418-ladsgroup.json [production]