|
2017-01-05
ยง
|
| 17:57 |
<robh> |
shutting down mw2075-2089 for decom per T154621 |
[production] |
| 17:35 |
<robh> |
diabling puppet on mw2075-2089 to decommission them today. |
[production] |
| 17:15 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on ruthenium, einsteinium (icinga), etherpad1001, rhodium, | einsteinium: upgrade python packages, kernel | xenon: apt-get autoremove, upgrade python- arcconf, libs... |
[production] |
| 17:07 |
<mutante> |
scandium (zuul merger), upgrade exim, python-requests, kernel version |
[production] |
| 17:06 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on kraz, wdqs2003, wezen, zosma, tegmen, rutherfordium. upgrade kernel and python-requests on zosma |
[production] |
| 16:59 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on all-db-noncore, all-mw-eqiad, restbase-eqiad, kafka-main |
[production] |
| 16:52 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on notebook, lvs-canary, lvs, mw-maintenance, all-mw-codfw |
[production] |
| 16:33 |
<mutante> |
cobalt upgrading exim packages |
[production] |
| 16:28 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on mw-api, swift-fe, swift-be, sca, scb, misc-analytics |
[production] |
| 16:21 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on db-core-eqiad, db-misc-servers, videoscaler |
[production] |
| 15:59 |
<moritzm> |
upgrading firejail on thumbor servers |
[production] |
| 15:44 |
<chasemp> |
labstore1005 systemctl disable create-dbusers |
[production] |
| 15:01 |
<mobrovac> |
restbase restarting for firejail upgrade |
[production] |
| 14:46 |
<moritzm> |
upgrading firejail on image scalers |
[production] |
| 14:19 |
<moritzm> |
upgrading firejail on restbase production hosts |
[production] |
| 14:15 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.7/extensions/ContentTranslation: Workaround to fix restoration for truncated section ids - T154279 (duration: 02m 10s) |
[production] |
| 14:10 |
<moritzm> |
upgrading firejail on restbase staging hosts |
[production] |
| 13:46 |
<moritzm> |
installing audiofile security updates |
[production] |
| 13:09 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@c5d239b]: Restart for firejail upgrade (duration: 00m 46s) |
[production] |
| 13:08 |
<mobrovac@tin> |
Starting deploy [trending-edits/deploy@c5d239b]: Restart for firejail upgrade |
[production] |
| 13:07 |
<mobrovac@tin> |
Finished deploy [electron-render/deploy@b2a820e]: Restart for firejail upgrade (duration: 05m 29s) |
[production] |
| 13:02 |
<mobrovac@tin> |
Starting deploy [electron-render/deploy@b2a820e]: Restart for firejail upgrade |
[production] |
| 13:01 |
<mobrovac@tin> |
Finished deploy [electron-render/deploy@b2a820e]: Restart for firejail upgrade (duration: 03m 40s) |
[production] |
| 12:57 |
<mobrovac@tin> |
Starting deploy [electron-render/deploy@b2a820e]: Restart for firejail upgrade |
[production] |
| 12:45 |
<mobrovac@tin> |
Finished deploy [mobileapps/deploy@c39bd1f]: Restart for firejail upgrade (duration: 04m 05s) |
[production] |
| 12:41 |
<mobrovac@tin> |
Starting deploy [mobileapps/deploy@c39bd1f]: Restart for firejail upgrade |
[production] |
| 12:41 |
<mobrovac@tin> |
Finished deploy [mathoid/deploy@79fdd56]: Restart for firejail upgrade (duration: 00m 41s) |
[production] |
| 12:40 |
<mobrovac@tin> |
Starting deploy [mathoid/deploy@79fdd56]: Restart for firejail upgrade |
[production] |
| 12:40 |
<mobrovac@tin> |
Finished deploy [graphoid/deploy@151f26c]: Restart for firejail upgrade (duration: 00m 43s) |
[production] |
| 12:39 |
<mobrovac@tin> |
Starting deploy [graphoid/deploy@151f26c]: Restart for firejail upgrade |
[production] |
| 12:38 |
<mobrovac@tin> |
Finished deploy [cxserver/deploy@0279029]: Restart for firejail upgrade (duration: 00m 39s) |
[production] |
| 12:37 |
<mobrovac@tin> |
Starting deploy [cxserver/deploy@0279029]: Restart for firejail upgrade |
[production] |
| 12:36 |
<mobrovac@tin> |
Finished deploy [citoid/deploy@da96f4b]: (no message) (duration: 01m 06s) |
[production] |
| 12:35 |
<mobrovac@tin> |
Starting deploy [citoid/deploy@da96f4b]: (no message) |
[production] |
| 12:24 |
<moritzm> |
installing firejail security updates on scb |
[production] |
| 11:13 |
<akosiaris> |
rebooting bast3001, T154603 |
[production] |
| 11:11 |
<moritzm> |
uploaded firejail 0.9.44+wmf2 for jessie-wikimedia to carbon |
[production] |
| 07:54 |
<elukey> |
chown www-data:www-data all the root:adm hhvm log files on mw eqiad hosts (T132324) |
[production] |
| 07:11 |
<marostegui> |
Compressing revision tables across all the wikis - db1038 - T154465 |
[production] |
| 07:09 |
<marostegui> |
Compressing pagelinks tables across all the wikis - db1044 - T153826 |
[production] |
| 07:08 |
<marostegui> |
Compressing revision tables across all the wikis - db1015 - T153739 |
[production] |
| 07:07 |
<marostegui> |
Compressing pagelinks tables across all the wikis - db1044 - T150438 |
[production] |
| 06:15 |
<bd808> |
sudo -u l10nupdate rm /var/lock/scap on tin to clean up lock left by bad l10nupdate locking attempt |
[production] |
| 05:49 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on swift-fe-codfw, swift-be-codfw, ALL remaining mw |
[production] |
| 05:44 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on db-core-codfw, etcd, graphite, kafka-analytics-canary, kafka-analytics, logstash |
[production] |
| 05:39 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on prometheus, aqs, db-es |
[production] |
| 05:35 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on cp-eqiad, memcached-eqiad |
[production] |
| 01:48 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on redis-codfw (rdb2005 needed manual) and all of dc-ulsfo, dc-esams |
[production] |
| 01:41 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on ganeti, cp-ulsfo, wdqs, thumbor, db-es-codfw |
[production] |
| 01:36 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on parsoid, maps, cp-esams |
[production] |