|
2022-05-30
ยง
|
| 20:26 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29110 and previous config saved to /var/cache/conftool/dbconfig/20220530-202618-ladsgroup.json |
[production] |
| 20:22 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29109 and previous config saved to /var/cache/conftool/dbconfig/20220530-202243-ladsgroup.json |
[production] |
| 20:20 |
<SandraEbele> |
Restarted ooze job pageview-druid-daily-coord |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1106 (T60674)', diff saved to https://phabricator.wikimedia.org/P29108 and previous config saved to /var/cache/conftool/dbconfig/20220530-201934-ladsgroup.json |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on clouddb[1013,1017,1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1106.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:19 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29107 and previous config saved to /var/cache/conftool/dbconfig/20220530-201921-ladsgroup.json |
[production] |
| 20:14 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29106 and previous config saved to /var/cache/conftool/dbconfig/20220530-201418-ladsgroup.json |
[production] |
| 20:11 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1141', diff saved to https://phabricator.wikimedia.org/P29105 and previous config saved to /var/cache/conftool/dbconfig/20220530-201113-ladsgroup.json |
[production] |
| 20:07 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P29104 and previous config saved to /var/cache/conftool/dbconfig/20220530-200738-ladsgroup.json |
[production] |
| 20:04 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29103 and previous config saved to /var/cache/conftool/dbconfig/20220530-200416-ladsgroup.json |
[production] |
| 19:59 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P29102 and previous config saved to /var/cache/conftool/dbconfig/20220530-195913-ladsgroup.json |
[production] |
| 19:56 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1141 (T60674)', diff saved to https://phabricator.wikimedia.org/P29101 and previous config saved to /var/cache/conftool/dbconfig/20220530-195608-ladsgroup.json |
[production] |
| 19:52 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29100 and previous config saved to /var/cache/conftool/dbconfig/20220530-195233-ladsgroup.json |
[production] |
| 19:49 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1119', diff saved to https://phabricator.wikimedia.org/P29099 and previous config saved to /var/cache/conftool/dbconfig/20220530-194910-ladsgroup.json |
[production] |
| 19:44 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1098:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29098 and previous config saved to /var/cache/conftool/dbconfig/20220530-194436-ladsgroup.json |
[production] |
| 19:44 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:44 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:44 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29097 and previous config saved to /var/cache/conftool/dbconfig/20220530-194428-ladsgroup.json |
[production] |
| 19:44 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29096 and previous config saved to /var/cache/conftool/dbconfig/20220530-194408-ladsgroup.json |
[production] |
| 19:42 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1136 (T60674)', diff saved to https://phabricator.wikimedia.org/P29095 and previous config saved to /var/cache/conftool/dbconfig/20220530-194158-ladsgroup.json |
[production] |
| 19:42 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:41 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1136.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:41 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29094 and previous config saved to /var/cache/conftool/dbconfig/20220530-194150-ladsgroup.json |
[production] |
| 19:34 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29093 and previous config saved to /var/cache/conftool/dbconfig/20220530-193405-ladsgroup.json |
[production] |
| 19:29 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29092 and previous config saved to /var/cache/conftool/dbconfig/20220530-192923-ladsgroup.json |
[production] |
| 19:26 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P29091 and previous config saved to /var/cache/conftool/dbconfig/20220530-192645-ladsgroup.json |
[production] |
| 19:18 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1119 (T60674)', diff saved to https://phabricator.wikimedia.org/P29090 and previous config saved to /var/cache/conftool/dbconfig/20220530-191808-ladsgroup.json |
[production] |
| 19:18 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:18 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1119.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:18 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1099:3311 (T60674)', diff saved to https://phabricator.wikimedia.org/P29089 and previous config saved to /var/cache/conftool/dbconfig/20220530-191800-ladsgroup.json |
[production] |
| 19:14 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1113:3316', diff saved to https://phabricator.wikimedia.org/P29088 and previous config saved to /var/cache/conftool/dbconfig/20220530-191418-ladsgroup.json |
[production] |
| 19:11 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P29087 and previous config saved to /var/cache/conftool/dbconfig/20220530-191140-ladsgroup.json |
[production] |
| 19:02 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1099:3311', diff saved to https://phabricator.wikimedia.org/P29086 and previous config saved to /var/cache/conftool/dbconfig/20220530-190255-ladsgroup.json |
[production] |
| 18:59 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29085 and previous config saved to /var/cache/conftool/dbconfig/20220530-185913-ladsgroup.json |
[production] |
| 18:56 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29084 and previous config saved to /var/cache/conftool/dbconfig/20220530-185635-ladsgroup.json |
[production] |
| 18:53 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:51 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1113:3316 (T60674)', diff saved to https://phabricator.wikimedia.org/P29083 and previous config saved to /var/cache/conftool/dbconfig/20220530-185149-ladsgroup.json |
[production] |
| 18:51 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:51 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1113.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:51 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1131 (T60674)', diff saved to https://phabricator.wikimedia.org/P29082 and previous config saved to /var/cache/conftool/dbconfig/20220530-185140-ladsgroup.json |
[production] |
| 18:49 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:49 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:47 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1099:3311', diff saved to https://phabricator.wikimedia.org/P29081 and previous config saved to /var/cache/conftool/dbconfig/20220530-184750-ladsgroup.json |
[production] |
| 18:45 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:44 |
<urbanecm> |
Clear IP signup throttle for 193.86.226.2 (T309395) |
[production] |
| 18:43 |
<urbanecm@deploy1002> |
Synchronized wmf-config/throttle.php: 6bd5783cd86a74c36d475267974384482b2e534f: throttle: Add new throttle rule + remove expired ones (T309395) (duration: 03m 18s) |
[production] |
| 18:39 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1170:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29080 and previous config saved to /var/cache/conftool/dbconfig/20220530-183926-ladsgroup.json |
[production] |