|
2015-05-04
§
|
| 14:50 |
<paravoid> |
draining ulsfo, network troubles (internal network packet loss) |
[production] |
| 13:49 |
<paravoid> |
draining all traffic from the Giglinx/Zayo link to ulsfo |
[production] |
| 05:56 |
<Tim> |
on terbium: running populateEditCount-fixup.php on all wikis |
[production] |
| 05:53 |
<tstarling> |
Synchronized php-1.26wmf4/extensions/SecurePoll: Iae874c0403a8362929362ca645f4aca18feb0269 (duration: 00m 19s) |
[production] |
| 05:52 |
<tstarling> |
Synchronized php-1.26wmf3/extensions/SecurePoll: Iae874c0403a8362929362ca645f4aca18feb0269 (duration: 00m 22s) |
[production] |
| 05:36 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon May 4 05:35:29 UTC 2015 (duration 35m 28s) |
[production] |
| 02:49 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-04 02:48:16+00:00 |
[production] |
| 02:44 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 07m 33s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-04 02:26:00+00:00 |
[production] |
| 02:22 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 58s) |
[production] |
| 01:13 |
<bd808> |
Started logstash cluster relocating indices off of logstash100[1-3] to logstash100[4-6] |
[production] |
|
2015-05-03
§
|
| 19:28 |
<yuvipanda> |
chown www-data: /var/log/mediawiki/refreshLinks/s3@3.log and s2@2.log for Reedy |
[production] |
| 16:23 |
<hoo> |
Synchronized wmf-config/: Re-enable global renames (duration: 00m 12s) |
[production] |
| 15:17 |
<_joe_> |
restarted jobchron, not jobcron, this time for real |
[production] |
| 14:37 |
<bblack> |
dewiki jobqueue:*:rootjob wipe complete |
[production] |
| 14:37 |
<bblack> |
enwiki + commonswiki jobqueue:*:rootjob wipe complete |
[production] |
| 14:19 |
<bblack> |
deleting :rootjob: entries for enwiki from redis too |
[production] |
| 14:16 |
<bblack> |
deleting :rootjob: entries for commonswiki from redis |
[production] |
| 13:54 |
<_joe_> |
restarting jobcron on the jobrunners |
[production] |
| 13:27 |
<hoo> |
Synchronized wmf-config/: Temporary disable global renames (duration: 00m 16s) |
[production] |
| 12:47 |
<_joe_> |
restarting redis server on rdb1001, lagging on the most basic queries |
[production] |
| 12:38 |
<_joe_> |
deploying I969fe8d329c1bcbb919a54cb225200ba0e006a03 to the jobrunners trying to make them work again |
[production] |
| 05:14 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun May 3 05:13:13 UTC 2015 (duration 13m 12s) |
[production] |
| 04:28 |
<springle> |
xtrabackup clone db1049 to db1070 |
[production] |
| 04:01 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1070 (duration: 00m 16s) |
[production] |
| 02:48 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-03 02:47:30+00:00 |
[production] |
| 02:47 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1068, warm up (duration: 00m 15s) |
[production] |
| 02:44 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 07m 11s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-03 02:26:02+00:00 |
[production] |
| 02:22 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 11s) |
[production] |
|
2015-05-02
§
|
| 22:16 |
<ori> |
Deployed change I3bc87f3a5 to fix UBN! bug T97912. Bug was affecting ability to translate messages needed for running upcoming board election. |
[production] |
| 22:16 |
<ori> |
Synchronized php-1.26wmf4/extensions/Translate/api/ApiQueryMessageGroups.php: I3bc87f3a5: ApiQueryMessageGroups: mark '_canchange' and '_name' as non-API-metadata (duration: 00m 30s) |
[production] |
| 22:09 |
<ori> |
Synchronized php-1.26wmf3/extensions/Translate/api/ApiQueryMessageGroups.php: I3bc87f3a5: ApiQueryMessageGroups: mark '_canchange' and '_name' as non-API-metadata (duration: 00m 31s) |
[production] |
| 20:25 |
<windowcat> |
Updated jobrunners to c95d565e242e6fa3706c088ddab1cc6f716408e1 |
[production] |
| 19:31 |
<springle> |
xtrabackup clone db2048, db2049, db2050, db2051, db2052, db2053, db2054 from codfw masters |
[production] |
| 19:10 |
<springle> |
upgrade db1068 trusty, xtrabackup clone from db1056 |
[production] |
| 19:03 |
<ottomata> |
resinstalling analytics1004 and analytics1010 as trusty |
[production] |
| 06:08 |
<yuvipanda> |
signed puppet certs manually on virt1000 |
[production] |
| 05:19 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat May 2 05:18:29 UTC 2015 (duration 18m 28s) |
[production] |
| 03:24 |
<ori> |
Granted self admin rights on metawiki temporarily to debug a CentralNotice issue. |
[production] |
| 02:53 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-02 02:52:36+00:00 |
[production] |
| 02:48 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 07m 01s) |
[production] |
| 02:32 |
<catrope> |
Synchronized php-1.26wmf3/extensions/WikiEditor: Fix data gathering bug (duration: 00m 25s) |
[production] |
| 02:32 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-02 02:31:00+00:00 |
[production] |
| 02:27 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 11s) |
[production] |
| 02:16 |
<catrope> |
Synchronized php-1.26wmf4/extensions/WikiEditor: Fix data gathering bug (duration: 00m 15s) |
[production] |
| 00:02 |
<ori> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 16s) |
[production] |