|
2014-10-29
§
|
| 23:00 |
<mutante> |
restarting nginx on cp1044 |
[production] |
| 22:11 |
<AaronSchulz> |
Re-running setZoneAccess.php for swift |
[production] |
| 22:04 |
<Krinkle> |
git-deploy: Deploying integration/slave-scripts a6a23ac1ec |
[production] |
| 20:28 |
<subbu> |
reverted parsoid to version 617e9e61b625f25d79dfaab08830c396537be632 (due to stuck processes) |
[production] |
| 20:16 |
<reedy> |
Synchronized wmf-config/mc-labs.php: noop for prod (duration: 00m 17s) |
[production] |
| 20:07 |
<arlolra> |
updated Parsoid to version 4e21bdb6fccc377468fd3d1cbc656fb64464ea78 |
[production] |
| 19:45 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) |
[production] |
| 19:39 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) |
[production] |
| 19:26 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) |
[production] |
| 19:17 |
<ori> |
upgraded HHVM to 3.3.0+dfsg1-1+wm1 |
[production] |
| 18:58 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf6 |
[production] |
| 18:57 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf5 |
[production] |
| 18:47 |
<reedy> |
Finished scap: testwiki to 1.25wmf6 and build l10n cache (duration: 28m 30s) |
[production] |
| 18:18 |
<reedy> |
Started scap: testwiki to 1.25wmf6 and build l10n cache |
[production] |
| 17:24 |
<cmjohnson> |
shutting down to replace ssds in elastic1002,1007,1014 |
[production] |
| 17:07 |
<ori> |
Synchronized wmf-config/CommonSettings.php: I8dd62e2cc: Re-enable hhvm beta feature on Wikidata (duration: 00m 06s) |
[production] |
| 16:20 |
<manybubbles> |
elastic101[7-9] look good to me - adding them to the cluster |
[production] |
| 16:17 |
<manybubbles> |
shutting down elasticsearch on elastic1002 - its empty and ready to have its disk upgraded/hyper threading enabled |
[production] |
| 16:05 |
<manybubbles> |
ignore my last log message about 1017 - typod |
[production] |
| 16:05 |
<manybubbles> |
shutting down elasticsearch on elastic1007 - its empty and ready to have its disk upgraded/hyper threading enabled |
[production] |
| 16:04 |
<manybubbles> |
shutting down elasticsearch on elastic1014 - its empty and ready to have its disk upgraded/hyper threading enabled |
[production] |
| 16:04 |
<manybubbles> |
shutting down elasticsearch on elastic1017 - its empty and ready to have its disk upgraded/hyper threading enabled |
[production] |
| 15:39 |
<manybubbles> |
start moving shards back to elastic1001 and elastic1008 now that they are up with hyperthreading on |
[production] |
| 15:37 |
<Reedy> |
deleted php-1.24wmf21 from mediawiki-installation |
[production] |
| 15:36 |
<Reedy> |
deleted php-1.24wmf20 from mediawiki-installation |
[production] |
| 15:35 |
<Reedy> |
deleted php-1.24wmf19 from mediawiki-installation |
[production] |
| 15:35 |
<akosiaris> |
uploaded apertium-apy_0.1+svn~57689-1 on apt.wikimedia.org |
[production] |
| 15:23 |
<manybubbles> |
unbanned elastic1013 now that it is back with hyper threading on |
[production] |
| 15:21 |
<reedy> |
Purged l10n cache for 1.25wmf3 |
[production] |
| 15:20 |
<reedy> |
Purged l10n cache for 1.25wmf2 |
[production] |
| 15:19 |
<bd808> |
Restarted logstash on logstash1002 to fix OCG and hadoop log events not being recorded |
[production] |
| 15:15 |
<bd808> |
Restarted logstash on logstash1001. No MW events were being added to the index. |
[production] |
| 15:10 |
<anomie> |
Synchronized wmf-config/throttle.php: SWAT: Raise account creation throttle at cawiki temporarily [[gerrit:169708]] (duration: 00m 09s) |
[production] |
| 15:07 |
<anomie> |
Synchronized php-1.25wmf5/extensions/Wikidata: SWAT: Fix WikiData "add links" widget JS error [[gerrit:169700]] (duration: 00m 15s) |
[production] |
| 15:07 |
<Reedy> |
Killed old (pre 1.25) l10nupdate cache dirs from tin:/var/lib/l10nupdate |
[production] |
| 15:00 |
<manybubbles> |
started moving shard off of elastic1001, elastic1008, and elastic1013 so we can bounce them to enable hyper threading |
[production] |
| 14:55 |
<manybubbles> |
started rolling shards back to elastic1001, elastic1008, and elastic1013 after hard drive upgrade |
[production] |
| 14:21 |
<ottomata> |
set request.required.acks = 2 for all varnishkafkas |
[production] |
| 13:22 |
<manybubbles> |
lowered replication on logstash's template for new indexes from 3 way to 2 way |
[production] |
| 13:20 |
<demon> |
Synchronized wmf-config/lucene-production.php: unbreak lsearchd for commons, enwikitionary, etc (duration: 00m 04s) |
[production] |
| 13:11 |
<manybubbles> |
lowered redundancy on logstash from 3 way to 2 way |
[production] |
| 13:01 |
<cmjohnson> |
powering down/replacing elastic1017 and elastic1018 |
[production] |
| 12:59 |
<cmjohnson> |
disabling puppet on elastic1017 and 1018 |
[production] |
| 12:01 |
<cmjohnson> |
elastic1001, elastic1008 and elastic1013 powering down to replace ssds RT7779 |
[production] |
| 12:01 |
<springle> |
xtrabackup clone db1007 to db2029 |
[production] |
| 07:16 |
<ori> |
repooled mw1189 w/patched hhvm (<https://phabricator.wikimedia.org/T820#16428>) |
[production] |
| 03:39 |
<ori> |
upgraded mw1114 to custom package with patch from https://phabricator.wikimedia.org/T820#16428 applied |
[production] |