|
2019-12-18
ยง
|
| 13:58 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'citoid' for release 'production' . |
[production] |
| 13:57 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'blubberoid' for release 'production' . |
[production] |
| 13:38 |
<moritzm> |
installing dbus security updates for stretch |
[production] |
| 13:30 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: train: Rolling Wikitech back to 1.35.0-wmf.10 T233859 |
[production] |
| 13:11 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: train: Rolling Commons back to 1.35.0-wmf.10 T233859 |
[production] |
| 13:04 |
<jforrester@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.11 (duration: 01m 01s) |
[production] |
| 13:03 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.11 |
[production] |
| 13:02 |
<moritzm> |
installing ruby2.5 security updates |
[production] |
| 12:56 |
<jbond42> |
enable puppet fleet wide |
[production] |
| 12:55 |
<arturo> |
[codfw1dev] created a new subnet neutron object to hold the new CIDR for floating IPs (cloud-codfw1dev-floating - 185.15.57.0/29) T239347 |
[admin] |
| 12:52 |
<jbond42> |
disable puppet fleet wide to restart apache on puppetmasters |
[production] |
| 12:52 |
<akosiaris> |
pool wikifeeds eqiad. For some reason it was depooled |
[production] |
| 12:50 |
<akosiaris@cumin1001> |
conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=(wikifeeds) |
[production] |
| 12:48 |
<wmde-fisch@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/Popups: SWAT: [[gerrit:559010|Fix initial preferences for newly created user accounts (T240947)]] (duration: 01m 02s) |
[production] |
| 12:35 |
<wmde-fisch@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/Popups: SWAT: [[gerrit:559010|Fix initial preferences for newly created user accounts (T240947)]] (duration: 01m 03s) |
[production] |
| 12:21 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:558239|Add a bit for forcing LC caching backend in cli mode (T105683)]] (duration: 01m 03s) |
[production] |
| 11:49 |
<arturo> |
introduce placeholder DNS records for toolforge.org domain. No services are provided under this domain yet for end users, this is just us testing (SSL, proxy stuff etc). This may be reverted anytime. |
[tools] |
| 11:28 |
<moritzm> |
installing ruby2.3 security updates |
[production] |
| 11:27 |
<jbond42> |
installing apache update on basion servers |
[production] |
| 11:26 |
<moritzm> |
installing spamassassin security updates on fermium/lists |
[production] |
| 11:16 |
<marostegui> |
Upgrade db2081, db2082 |
[production] |
| 11:14 |
<moritzm> |
installing spamassassin security updates on mendelevium/OTRS |
[production] |
| 10:47 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/VisualEditor/includes/ApiVisualEditor.php: T240961: Fix unchecked array access in ApiVisualEditor (duration: 01m 02s) |
[production] |
| 10:16 |
<akosiaris> |
depooling eventgate.*|mathoid|citoid|restrouter|sessionstore|echostore|zotero|termbox|wikifeeds|cxserver|blubberoid) from codfw kubernetes |
[production] |
| 10:16 |
<akosiaris@cumin1001> |
conftool action : set/pooled=false; selector: name=codfw,dnsdisc=(eventgate.*|mathoid|citoid|restrouter|sessionstore|echostore|zotero|termbox|wikifeeds|cxserver|blubberoid) |
[production] |
| 10:10 |
<marostegui> |
Upgrade db2083 |
[production] |
| 10:09 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/GrowthExperiments/includes: T240444 Make PageViewInfo a soft dependency (duration: 01m 04s) |
[production] |
| 10:06 |
<akosiaris@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 10:06 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 10:05 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:04 |
<akosiaris@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:04 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:04 |
<akosiaris@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:04 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:00 |
<akosiaris> |
populate new calico stores for codfw T239835 |
[production] |
| 09:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool es1011', diff saved to https://phabricator.wikimedia.org/P9937 and previous config saved to /var/cache/conftool/dbconfig/20191218-095710-marostegui.json |
[production] |
| 09:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9936 and previous config saved to /var/cache/conftool/dbconfig/20191218-094540-marostegui.json |
[production] |
| 09:37 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9935 and previous config saved to /var/cache/conftool/dbconfig/20191218-093720-marostegui.json |
[production] |
| 09:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool es1011', diff saved to https://phabricator.wikimedia.org/P9934 and previous config saved to /var/cache/conftool/dbconfig/20191218-092625-marostegui.json |
[production] |
| 09:24 |
<elukey> |
execute 'megacli -LDSetProp WT -LAll -aAll' on analytics1057 - T239045 |
[production] |
| 09:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool es1011 for upgrade', diff saved to https://phabricator.wikimedia.org/P9933 and previous config saved to /var/cache/conftool/dbconfig/20191218-092228-marostegui.json |
[production] |
| 09:18 |
<ema> |
repool cp3050 after ats-be restart |
[production] |
| 08:59 |
<vgutierrez> |
restarting ats-be on cp3050 |
[production] |
| 08:58 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . |
[production] |
| 08:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool es1016', diff saved to https://phabricator.wikimedia.org/P9931 and previous config saved to /var/cache/conftool/dbconfig/20191218-082226-marostegui.json |
[production] |