|
2015-05-04
§
|
| 21:03 |
<Coren> |
checking raid consistency from labstore1002 |
[production] |
| 21:03 |
<ottomata> |
rebooting analytics1037 |
[production] |
| 20:27 |
<Coren> |
Starting NFS server switch - graceful labstore1001 shutdown. |
[production] |
| 20:11 |
<gwicke> |
deployed restbase v0.6.0 / 76583a07 |
[production] |
| 19:56 |
<ori> |
Synchronized wmf-config/InitialiseSettings.php: I62dffd271: wmgUseBits: false for nl and dewiki (duration: 00m 11s) |
[production] |
| 19:24 |
<ori> |
Synchronized w/5xx.php: (no message) (duration: 00m 14s) |
[production] |
| 19:12 |
<awight> |
update crm from 514e7ea41acd14e1565b31b76621ea840d209e07 to 2a2336655737a2cd1d3cc24624d1e8475e4cf039 |
[production] |
| 19:12 |
<ori> |
Synchronized multiversion: I2d93ede75: Remove FormatJson from mediawiki-config (duration: 00m 13s) |
[production] |
| 18:51 |
<ori> |
Synchronized multiversion/FormatJson.php: Ice8f1796c: Update FormatJson to 532337e6ff from mediawiki/core (duration: 00m 12s) |
[production] |
| 18:44 |
<cscott> |
updated Parsoid to version b53a7272 |
[production] |
| 18:26 |
<ori> |
Synchronized wmf-config: I81df3a614, I02b06f8e2, I366561a0f: Use MWWikiversions::readDbListFile to read dblist files; Allow computed dblist expressions; Add group1.dblist (duration: 00m 14s) |
[production] |
| 17:53 |
<legoktm> |
running delete-wmf-tags (https://phabricator.wikimedia.org/P531) on all extension repos |
[production] |
| 16:58 |
<andrewbogott> |
reimaging/renaming virt1011 -> labvirt1007 |
[production] |
| 15:40 |
<thcipriani> |
Synchronized php-1.26wmf4/extensions/ContentTranslation: Update ContentTranslation to 0bd91b6 [[gerrit:208607]] (duration: 00m 30s) |
[production] |
| 15:32 |
<thcipriani> |
Synchronized php-1.26wmf3/extensions/ContentTranslation: Sync-dir for ContentTranslation to 6f81619 [[gerrit:208605]] (duration: 00m 18s) |
[production] |
| 15:23 |
<thcipriani> |
Synchronized php-1.26wmf3/extensions/ContentTranslation/modules/tools/ext.cx.tools.formatter.js: Update ContentTranslation to 6f81619 [[gerrit:208605]] (duration: 00m 25s) |
[production] |
| 15:17 |
<ottomata> |
starting upgrade of Analytics Cluster to CDH 5.4: https://phabricator.wikimedia.org/T97453 |
[production] |
| 15:05 |
<andrewbogott> |
halting virt1011 pending its rename to labvirt1007 |
[production] |
| 14:51 |
<godog> |
halt fluorine to fix console and swap sda |
[production] |
| 14:50 |
<paravoid> |
draining ulsfo, network troubles (internal network packet loss) |
[production] |
| 13:49 |
<paravoid> |
draining all traffic from the Giglinx/Zayo link to ulsfo |
[production] |
| 05:56 |
<Tim> |
on terbium: running populateEditCount-fixup.php on all wikis |
[production] |
| 05:53 |
<tstarling> |
Synchronized php-1.26wmf4/extensions/SecurePoll: Iae874c0403a8362929362ca645f4aca18feb0269 (duration: 00m 19s) |
[production] |
| 05:52 |
<tstarling> |
Synchronized php-1.26wmf3/extensions/SecurePoll: Iae874c0403a8362929362ca645f4aca18feb0269 (duration: 00m 22s) |
[production] |
| 05:36 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon May 4 05:35:29 UTC 2015 (duration 35m 28s) |
[production] |
| 02:49 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-04 02:48:16+00:00 |
[production] |
| 02:44 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 07m 33s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-04 02:26:00+00:00 |
[production] |
| 02:22 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 58s) |
[production] |
| 01:13 |
<bd808> |
Started logstash cluster relocating indices off of logstash100[1-3] to logstash100[4-6] |
[production] |
|
2015-05-03
§
|
| 19:28 |
<yuvipanda> |
chown www-data: /var/log/mediawiki/refreshLinks/s3@3.log and s2@2.log for Reedy |
[production] |
| 16:23 |
<hoo> |
Synchronized wmf-config/: Re-enable global renames (duration: 00m 12s) |
[production] |
| 15:17 |
<_joe_> |
restarted jobchron, not jobcron, this time for real |
[production] |
| 14:37 |
<bblack> |
dewiki jobqueue:*:rootjob wipe complete |
[production] |
| 14:37 |
<bblack> |
enwiki + commonswiki jobqueue:*:rootjob wipe complete |
[production] |
| 14:19 |
<bblack> |
deleting :rootjob: entries for enwiki from redis too |
[production] |
| 14:16 |
<bblack> |
deleting :rootjob: entries for commonswiki from redis |
[production] |
| 13:54 |
<_joe_> |
restarting jobcron on the jobrunners |
[production] |
| 13:27 |
<hoo> |
Synchronized wmf-config/: Temporary disable global renames (duration: 00m 16s) |
[production] |
| 12:47 |
<_joe_> |
restarting redis server on rdb1001, lagging on the most basic queries |
[production] |
| 12:38 |
<_joe_> |
deploying I969fe8d329c1bcbb919a54cb225200ba0e006a03 to the jobrunners trying to make them work again |
[production] |
| 05:14 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun May 3 05:13:13 UTC 2015 (duration 13m 12s) |
[production] |
| 04:28 |
<springle> |
xtrabackup clone db1049 to db1070 |
[production] |
| 04:01 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1070 (duration: 00m 16s) |
[production] |
| 02:48 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-03 02:47:30+00:00 |
[production] |
| 02:47 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1068, warm up (duration: 00m 15s) |
[production] |
| 02:44 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 07m 11s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-03 02:26:02+00:00 |
[production] |
| 02:22 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 11s) |
[production] |