2951-3000 of 10000 results (35ms)
2021-01-25 §
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Add x2 eqiad to dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13939 and previous config saved to /var/cache/conftool/dbconfig/20210125-064419-marostegui.json [production]
06:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Populate x2 eqiad hosts into dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13938 and previous config saved to /var/cache/conftool/dbconfig/20210125-064305-marostegui.json [production]
2021-01-23 §
22:21 <volker-e@deploy1001> Finished deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) (duration: 00m 06s) [production]
22:21 <volker-e@deploy1001> Started deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) [production]
04:05 <ryankemper> Depooled `wdqs1013` (it has ~50 mins of lag to catch up on, and also the bad gateway above) [production]
04:03 <ryankemper> Restarted `wdqs-blazegraph` on `wdqs1013`: `sudo systemctl restart wdqs-blazegraph` [production]
01:52 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2332.codfw.wmnet [production]
01:52 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2328.codfw.wmnet [production]
01:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2332.codfw.wmnet [production]
01:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2328.codfw.wmnet [production]
01:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2330.codfw.wmnet [production]
01:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2334.codfw.wmnet [production]
01:48 <foks> reset user email for Davey2010 [production]
01:44 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1413.eqiad.wmnet [production]
01:43 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1268.eqiad.wmnet [production]
01:41 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2330.codfw.wmnet [production]
01:41 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2334.codfw.wmnet [production]
01:40 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1268.eqiad.wmnet [production]
01:39 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1413.eqiad.wmnet [production]
00:46 <legoktm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch enwiki to use enwiki20 "Option A" logo variant (T272526) (duration: 00m 57s) [production]
00:36 <legoktm@deploy1001> Synchronized static/images/project-logos/: Add enwiki20 "Option A" fixed logos (T272526) (duration: 00m 59s) [production]
2021-01-22 §
22:41 <reedy@deploy1001> Synchronized invalid.json: (no justification provided) (duration: 00m 58s) [production]
20:07 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE [production]
20:05 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE [production]
20:05 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2330.codfw.wmnet with reason: REIMAGE [production]
20:05 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2332.codfw.wmnet with reason: REIMAGE [production]
20:03 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2328.codfw.wmnet with reason: REIMAGE [production]
20:01 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1413.eqiad.wmnet with reason: REIMAGE [production]
20:01 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2334.codfw.wmnet with reason: REIMAGE [production]
20:00 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1413.eqiad.wmnet with reason: REIMAGE [production]
20:00 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2328.codfw.wmnet with reason: REIMAGE [production]
20:00 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2330.codfw.wmnet with reason: REIMAGE [production]
20:00 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2332.codfw.wmnet with reason: REIMAGE [production]
19:59 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2334.codfw.wmnet with reason: REIMAGE [production]
19:39 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2356.codfw.wmnet [production]
19:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2354.codfw.wmnet [production]
19:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2352.codfw.wmnet [production]
19:36 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2350.codfw.wmnet [production]
19:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2352.codfw.wmnet [production]
19:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2350.codfw.wmnet [production]
19:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2354.codfw.wmnet [production]
19:34 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2356.codfw.wmnet [production]
19:15 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2350.codfw.wmnet with reason: REIMAGE [production]
19:13 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2352.codfw.wmnet with reason: REIMAGE [production]
19:11 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2354.codfw.wmnet with reason: REIMAGE [production]
19:10 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2350.codfw.wmnet with reason: REIMAGE [production]
19:09 <mutante> releases1002 systemctl reset-failed [production]
19:09 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2356.codfw.wmnet with reason: REIMAGE [production]
19:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2352.codfw.wmnet with reason: REIMAGE [production]
19:08 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2354.codfw.wmnet with reason: REIMAGE [production]