|
2020-07-31
§
|
| 03:14 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 03:12 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 02:57 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 02:55 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 00:47 |
<tstarling@deploy1001> |
Synchronized wmf-config/CommonSettings.php: disable lilypond execution again (duration: 01m 10s) |
[production] |
| 00:07 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.2/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 06s) |
[production] |
| 00:06 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.1/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 10s) |
[production] |
| 00:00 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2015.codfw.wmnet |
[production] |
|
2020-07-30
§
|
| 23:56 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 23:56 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 23:07 |
<marxarelli> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/616177 |
[releng] |
| 23:02 |
<marxarelli> |
created 6 new jenkins jobs to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/616177 |
[releng] |
| 22:59 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2014.codfw.wmnet |
[production] |
| 22:34 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 22:34 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 22:27 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 22:27 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 22:12 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: Revert group2 wikis to 1.36.0-wmf.1 |
[production] |
| 21:52 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.2 |
[production] |
| 21:52 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 21:51 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 21:51 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 21:51 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 21:45 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2013.codfw.wmnet |
[production] |
| 21:41 |
<mutante> |
revoking and resigning puppet cert for xhgui2001.codfw.wmnet T259206 |
[production] |
| 21:40 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.2/extensions/GrowthExperiments/: T258609 (duration: 01m 06s) |
[production] |
| 21:40 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 21:40 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 21:39 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.2/skins/MinervaNeue/: T258939 (duration: 01m 08s) |
[production] |
| 21:30 |
<mutante> |
reinstalling xhgui2001 |
[production] |
| 21:27 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 21:27 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 21:27 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 21:27 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 21:10 |
<ryankemper@deploy1001> |
Finished deploy [wdqs/wdqs@e797cf0]: 0.3.42 (duration: 24m 41s) |
[production] |
| 20:45 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2012.codfw.wmnet |
[production] |
| 20:45 |
<ryankemper@deploy1001> |
Started deploy [wdqs/wdqs@e797cf0]: 0.3.42 |
[production] |
| 20:45 |
<dpifke> |
Fixed merge conflicts in beta puppetmaster. |
[releng] |
| 20:40 |
<bstorm> |
upgrading the singleuser image to test shuffling around some of the pip installs |
[paws] |
| 20:23 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 20:23 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 20:09 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 20:09 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 20:08 |
<mutante> |
[wtp2012:~] $ sudo rm -rf /srv/deployment/parsoid/deploy-cache |
[production] |
| 19:56 |
<bstorm> |
Reimported the maj_articles_recents table on the replica and started replication again T257273 |
[tools.totoazero] |
| 19:41 |
<mutante> |
wikistats-dancing-goat - cron service was broken for unknown reason - systemctl start cron - brought it back |
[wikistats] |
| 19:24 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2011.codfw.wmnet |
[production] |
| 19:14 |
<mforns> |
finished refinery deploy (for v0.0.132) |
[analytics] |
| 19:13 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: Revert group2 wikis to 1.36.0-wmf.1 |
[production] |
| 19:10 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.2 |
[production] |