|
2021-01-25
§
|
| 08:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 50%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13942 and previous config saved to /var/cache/conftool/dbconfig/20210125-081708-root.json |
[production] |
| 08:02 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 25%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13941 and previous config saved to /var/cache/conftool/dbconfig/20210125-080204-root.json |
[production] |
| 07:33 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1142 for kernel upgrade', diff saved to https://phabricator.wikimedia.org/P13940 and previous config saved to /var/cache/conftool/dbconfig/20210125-073322-marostegui.json |
[production] |
| 06:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Add x2 eqiad to dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13939 and previous config saved to /var/cache/conftool/dbconfig/20210125-064419-marostegui.json |
[production] |
| 06:43 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Populate x2 eqiad hosts into dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13938 and previous config saved to /var/cache/conftool/dbconfig/20210125-064305-marostegui.json |
[production] |
|
2021-01-23
§
|
| 22:21 |
<volker-e@deploy1001> |
Finished deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) (duration: 00m 06s) |
[production] |
| 22:21 |
<volker-e@deploy1001> |
Started deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) |
[production] |
| 04:05 |
<ryankemper> |
Depooled `wdqs1013` (it has ~50 mins of lag to catch up on, and also the bad gateway above) |
[production] |
| 04:03 |
<ryankemper> |
Restarted `wdqs-blazegraph` on `wdqs1013`: `sudo systemctl restart wdqs-blazegraph` |
[production] |
| 01:52 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2332.codfw.wmnet |
[production] |
| 01:52 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2328.codfw.wmnet |
[production] |
| 01:51 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2332.codfw.wmnet |
[production] |
| 01:51 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2328.codfw.wmnet |
[production] |
| 01:50 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2330.codfw.wmnet |
[production] |
| 01:50 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2334.codfw.wmnet |
[production] |
| 01:48 |
<foks> |
reset user email for Davey2010 |
[production] |
| 01:44 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1413.eqiad.wmnet |
[production] |
| 01:43 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1268.eqiad.wmnet |
[production] |
| 01:41 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2330.codfw.wmnet |
[production] |
| 01:41 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2334.codfw.wmnet |
[production] |
| 01:40 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1268.eqiad.wmnet |
[production] |
| 01:39 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1413.eqiad.wmnet |
[production] |
| 00:46 |
<legoktm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Switch enwiki to use enwiki20 "Option A" logo variant (T272526) (duration: 00m 57s) |
[production] |
| 00:36 |
<legoktm@deploy1001> |
Synchronized static/images/project-logos/: Add enwiki20 "Option A" fixed logos (T272526) (duration: 00m 59s) |
[production] |
|
2021-01-22
§
|
| 22:41 |
<reedy@deploy1001> |
Synchronized invalid.json: (no justification provided) (duration: 00m 58s) |
[production] |
| 20:07 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:05 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:05 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2330.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:05 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2332.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:03 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2328.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:01 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1413.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:01 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2334.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:00 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1413.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:00 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2328.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:00 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2330.codfw.wmnet with reason: REIMAGE |
[production] |
| 20:00 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2332.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:59 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2334.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:39 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2356.codfw.wmnet |
[production] |
| 19:38 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2354.codfw.wmnet |
[production] |
| 19:38 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2352.codfw.wmnet |
[production] |
| 19:36 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw2350.codfw.wmnet |
[production] |
| 19:35 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2352.codfw.wmnet |
[production] |
| 19:35 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2350.codfw.wmnet |
[production] |
| 19:35 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2354.codfw.wmnet |
[production] |
| 19:34 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2356.codfw.wmnet |
[production] |
| 19:15 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2350.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:13 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2352.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:11 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2354.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:10 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2350.codfw.wmnet with reason: REIMAGE |
[production] |
| 19:09 |
<mutante> |
releases1002 systemctl reset-failed |
[production] |