|
2016-02-01
§
|
| 15:48 |
<bblack> |
restarted pybal on lvs1004 (lvs1003 above was a bad log message!) |
[production] |
| 15:42 |
<bblack> |
restarted pybal on lvs1003 |
[production] |
| 15:13 |
<bblack> |
cp3042 repooled |
[production] |
| 15:10 |
<ema> |
restarting hhvm on mw1057 |
[production] |
| 14:33 |
<chasemp> |
labstore1002 cfg scheduling |
[production] |
| 14:04 |
<godog> |
set ms-be1019 swift weight to 4000 |
[production] |
| 13:33 |
<moritzm> |
rolling reboot of xenon/cerium/praseodymium for kernel update (and updating to new openjdk-8) |
[production] |
| 12:40 |
<_joe_> |
depooling cp3042 from esams uploads |
[production] |
| 12:15 |
<_joe_> |
backing up tin homes before reimaging |
[production] |
| 11:59 |
<moritzm> |
rolling reboot of ms-be1016 to ms-be1021 for kernel update |
[production] |
| 11:39 |
<moritzm> |
uploaded openjdk-8 8u72-b15-1~bpo8+1 for jessie-wikimedia to carbon |
[production] |
| 11:34 |
<moritzm> |
uploaded openssl 1.0.2f for jessie-wikimedia to carbon |
[production] |
| 11:19 |
<godog> |
repool restbase1007 |
[production] |
| 10:32 |
<godog> |
reboot ms-be1010, xfs |
[production] |
| 10:27 |
<jynus> |
partitioning revision and logging for db2037 and db2044 (s4) |
[production] |
| 00:04 |
<tstarling@mira> |
Synchronized php-1.27.0-wmf.11/includes: (no message) (duration: 01m 31s) |
[production] |
|
2016-01-31
§
|
| 23:58 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.11/extensions/VisualEditor/extension.json: https://gerrit.wikimedia.org/r/#/c/267617/ (duration: 01m 28s) |
[production] |
| 22:31 |
<ori> |
restarted parsoid-rt-client.service |
[production] |
| 22:14 |
<ori> |
Updated parsoid on ruthenium and restarted parsoid-rt-client on ruthenium, per subbu's request. |
[production] |
| 22:03 |
<bd808> |
backfilled missing data in https://tools.wmflabs.org/sal/production from https://wikitech.wikimedia.org/wiki/Server_Admin_Log |
[production] |
| 21:37 |
<bd808> |
https://tools.wmflabs.org/sal/production missing data from 2016-01-30 until now |
[production] |
| 16:01 |
<tgr> |
changed wikiversions.php on mw1017 to serve wmf.10 for SessionManager-related debugging |
[production] |
| 05:35 |
<legoktm> |
restarted extensions/CentralAuth/maintenance/resetGlobalUserTokens.php |
[production] |
| 02:32 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sun Jan 31 02:32:12 UTC 2016 (duration 7m 11s) |
[production] |
| 02:25 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.10) (duration: 10m 14s) |
[production] |
|
2016-01-30
§
|
| 23:20 |
<bd808@mira> |
rebuilt wikiversions.php and synchronized wikiversions files: Revert all wikis to 1.27.0-wmf.10 (again) |
[production] |
| 23:01 |
<bd808@mira> |
Synchronized wmf-config/InitialiseSettings.php: Revert Enable debug level session logging to fluorine (17bfb06) (duration: 01m 28s) |
[production] |
| 22:36 |
<bd808@mira> |
Synchronized wmf-config/InitialiseSettings.php: Enable debug level session logging to fluorine (5ac9412) (duration: 01m 26s) |
[production] |
| 18:43 |
<_joe_> |
updated visualdiff, restarted parsoid-vd |
[production] |
| 13:00 |
<_joe_> |
discard preserved cache on ms-be2003, powercycle |
[production] |
| 03:40 |
<Krenair> |
Deleted old /srv/mediawiki/php-1.27.0-wmf.[1-5] directories across the cluster to match the deployment tree, T124567 |
[production] |
| 02:31 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Jan 30 02:31:56 UTC 2016 (duration 7m 2s) |
[production] |
| 02:24 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.11) (duration: 10m 24s) |
[production] |
| 00:08 |
<bd808@mira> |
Synchronized php-1.27.0-wmf.11/includes/session/SessionBackend.php: Remove proposed fix for T125267 (duration: 01m 33s) |
[production] |
|
2016-01-29
§
|
| 23:53 |
<jynus> |
restarted db1018 replication (and its codfw slaves) after a (somewhat) failed maintenance |
[production] |
| 23:41 |
<mutante> |
ruthenium - restart parsoid-rt-client, parsoid-vd-client |
[production] |
| 23:37 |
<mutante> |
ruthenium - git pull origin in /srv/visualdiff/ |
[production] |
| 23:22 |
<bd808@mira> |
Synchronized php-1.27.0-wmf.11/includes/session/SessionBackend.php: Testing proposed fix for T125267 (duration: 01m 26s) |
[production] |
| 22:50 |
<jynus> |
powercycling cp3042 to test it is really the broken one |
[production] |
| 22:37 |
<jynus> |
powercycle cp3049, not 42 |
[production] |
| 22:37 |
<jynus> |
powercycle cp3042 |
[production] |
| 22:27 |
<mutante> |
cp3042 - md0: unknown partition table |
[production] |
| 22:23 |
<mutante> |
powercycled cp1049 |
[production] |
| 22:06 |
<mutante> |
powercycle cp3049 |
[production] |
| 21:13 |
<mutante> |
bromine - stop and remove rsync service |
[production] |
| 20:16 |
<aaron@mira> |
Synchronized wmf-config/CommonSettings.php: Use the logical redis definition for GettingStarted (duration: 01m 26s) |
[production] |
| 19:36 |
<jynus> |
reinstall db1018 |
[production] |
| 18:11 |
<jynus> |
creating special partitioning for db2037 and db2044 (ETA:5 days, lag) |
[production] |
| 18:01 |
<jynus> |
creating special partitioning for db2034 and db2042 (ETA:5 days, lag) |
[production] |
| 17:51 |
<bd808@mira> |
Synchronized wmf-config/InitialiseSettings.php: Stop the first survey in fawiki and eswiki (f89621d) (duration: 01m 25s) |
[production] |