|
2017-01-05
ยง
|
| 23:46 |
<godog> |
fix root-owned files on puppetmaster1001:/var/lib/git/operations/private/ causing /srv/private post-commit hook to fail |
[production] |
| 23:18 |
<mutante> |
switching eqiad ganglia aggregator - running puppet on install1001 - disabling on carbon, re-enabling puppet across eqiad |
[production] |
| 23:05 |
<mutante> |
temp disabling puppet on all eqiad hosts via salt - during ganglia aggregator switch |
[production] |
| 22:51 |
<demon@tin> |
Synchronized php-1.29.0-wmf.7/extensions/Echo/includes/api: silence api warnings (duration: 02m 46s) |
[production] |
| 22:40 |
<demon@tin> |
Synchronized php-1.29.0-wmf.7/extensions/VisualEditor: silence some api warnings (duration: 02m 48s) |
[production] |
| 22:22 |
<demon@tin> |
Synchronized php-1.29.0-wmf.7/extensions/CodeReview/api/ApiQueryCodeComments.php: silence some warnings (duration: 02m 46s) |
[production] |
| 21:59 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on all remaning ones in codfw (all-codfw) |
[production] |
| 21:53 |
<ejegg> |
updated payments wiki from 21ea9bc4a46c96f84685b33ef06fd1b4c40e797e to 1f9ea809b3c32060222f4f6a70e725c433fe15b7 |
[production] |
| 21:53 |
<mutante> |
mx1001 - upgrading exim4 packages, exim4-daemon-heavy, forcing puppet run |
[production] |
| 21:35 |
<mutante> |
mx2001 - upgrading exim4 packages, daemon-heavey, forcing puppet run |
[production] |
| 21:22 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.7 |
[production] |
| 20:58 |
<mutante> |
mendelevium (OTRS) - upgrade exim4 packages, force puppet run |
[production] |
| 20:45 |
<mutante> |
iridium (phabricator) - upgrade exim4 packages, force puppet run |
[production] |
| 20:29 |
<demon@tin> |
Synchronized docroot/wikipedia.org: removing junk 15 stuff (duration: 04m 50s) |
[production] |
| 20:18 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.7 |
[production] |
| 20:07 |
<demon@tin> |
Synchronized docroot: Ok last docroot thing for today I promise (duration: 05m 00s) |
[production] |
| 19:52 |
<demon@tin> |
Synchronized docroot: Final bit of this round of docroot cleanup (duration: 05m 00s) |
[production] |
| 19:44 |
<thcipriani@tin> |
Finished scap: SemanticForms l10n cache rebuild for 1.29.0-wmf.7 (duration: 39m 21s) |
[production] |
| 19:35 |
<mutante> |
mira - upgrade exim, python-requests, linux-image |
[production] |
| 19:29 |
<mutante> |
rolled out exim4 upgrades (DSA 3747-1) on contint1001/2001, dbmonitor1001/2001, tungsten, seaborgium, hassium, labstore* |
[production] |
| 19:05 |
<thcipriani@tin> |
Started scap: SemanticForms l10n cache rebuild for 1.29.0-wmf.7 |
[production] |
| 18:34 |
<mutante> |
fermium (lists server) - upgrading exim packages, exim4-daemon-heavy, forcing puppet run |
[production] |
| 18:29 |
<yurik@tin> |
Finished deploy [graphoid/deploy@d20b00e]: (no message) (duration: 03m 11s) |
[production] |
| 18:26 |
<yurik@tin> |
Starting deploy [graphoid/deploy@d20b00e]: (no message) |
[production] |
| 18:25 |
<arlolra> |
Updated Parsoid to 974dd5b3 (T143183, T102134, T113044) |
[production] |
| 18:25 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on prometheus, mwlog, pollux, labmon, lithium, hassaleh, dubnium, graphite1002, tin, serpens, bromine, dataset1001 |
[production] |
| 18:16 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@465f9c4]: Updating Parsoid to 974dd5b3 (duration: 10m 46s) |
[production] |
| 18:15 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on puppetmaster, yubiauth, oresrdb, (oresrdb1001 - Unknown installation error.. eh.. this is new) |
[production] |
| 18:05 |
<arlolra@tin> |
Starting deploy [parsoid/deploy@465f9c4]: Updating Parsoid to 974dd5b3 |
[production] |
| 17:57 |
<robh> |
shutting down mw2075-2089 for decom per T154621 |
[production] |
| 17:35 |
<robh> |
diabling puppet on mw2075-2089 to decommission them today. |
[production] |
| 17:15 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on ruthenium, einsteinium (icinga), etherpad1001, rhodium, | einsteinium: upgrade python packages, kernel | xenon: apt-get autoremove, upgrade python- arcconf, libs... |
[production] |
| 17:07 |
<mutante> |
scandium (zuul merger), upgrade exim, python-requests, kernel version |
[production] |
| 17:06 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on kraz, wdqs2003, wezen, zosma, tegmen, rutherfordium. upgrade kernel and python-requests on zosma |
[production] |
| 16:59 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on all-db-noncore, all-mw-eqiad, restbase-eqiad, kafka-main |
[production] |
| 16:52 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on notebook, lvs-canary, lvs, mw-maintenance, all-mw-codfw |
[production] |
| 16:33 |
<mutante> |
cobalt upgrading exim packages |
[production] |
| 16:28 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on mw-api, swift-fe, swift-be, sca, scb, misc-analytics |
[production] |
| 16:21 |
<mutante> |
rolling out exim4 upgrades (DSA 3747-1) on db-core-eqiad, db-misc-servers, videoscaler |
[production] |
| 15:59 |
<moritzm> |
upgrading firejail on thumbor servers |
[production] |
| 15:44 |
<chasemp> |
labstore1005 systemctl disable create-dbusers |
[production] |
| 15:01 |
<mobrovac> |
restbase restarting for firejail upgrade |
[production] |
| 14:46 |
<moritzm> |
upgrading firejail on image scalers |
[production] |
| 14:19 |
<moritzm> |
upgrading firejail on restbase production hosts |
[production] |
| 14:15 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.7/extensions/ContentTranslation: Workaround to fix restoration for truncated section ids - T154279 (duration: 02m 10s) |
[production] |
| 14:10 |
<moritzm> |
upgrading firejail on restbase staging hosts |
[production] |
| 13:46 |
<moritzm> |
installing audiofile security updates |
[production] |
| 13:09 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@c5d239b]: Restart for firejail upgrade (duration: 00m 46s) |
[production] |
| 13:08 |
<mobrovac@tin> |
Starting deploy [trending-edits/deploy@c5d239b]: Restart for firejail upgrade |
[production] |
| 13:07 |
<mobrovac@tin> |
Finished deploy [electron-render/deploy@b2a820e]: Restart for firejail upgrade (duration: 05m 29s) |
[production] |