2801-2850 of 10000 results (28ms)
2014-10-30 §
10:15 <_joe_> load test ended [production]
09:48 <_joe_> load testing the hhvm appserver pool as well [production]
08:17 <_joe_> powercycling mw1189, enabling hyperthreading [production]
08:04 <_joe_> doing the same with mw1189, to see how different appserver generations respond [production]
07:25 <_joe_> raising the weight of mw1114 in the api pool to test the throughput it can withstand [production]
04:47 <ori> enabled heap profiling on mw1189 [production]
2014-10-29 §
23:42 <ejegg> updated tool from 19928683a8112e9aadd71ba47f199885ba517a02 to 419fb7aa32c6d0776056968378e358ee01985565 [production]
23:38 <maxsem> Synchronized php-1.25wmf6/extensions/MobileFrontend/: (no message) (duration: 00m 07s) [production]
23:35 <maxsem> Synchronized php-1.25wmf5/extensions/MobileFrontend/: (no message) (duration: 00m 04s) [production]
23:13 <catrope> Synchronized php-1.25wmf6/extensions/VisualEditor: SWAT (duration: 00m 04s) [production]
23:00 <mutante> restarting nginx on cp1044 [production]
22:11 <AaronSchulz> Re-running setZoneAccess.php for swift [production]
22:04 <Krinkle> git-deploy: Deploying integration/slave-scripts a6a23ac1ec [production]
20:28 <subbu> reverted parsoid to version 617e9e61b625f25d79dfaab08830c396537be632 (due to stuck processes) [production]
20:16 <reedy> Synchronized wmf-config/mc-labs.php: noop for prod (duration: 00m 17s) [production]
20:07 <arlolra> updated Parsoid to version 4e21bdb6fccc377468fd3d1cbc656fb64464ea78 [production]
19:45 <reedy> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) [production]
19:39 <reedy> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 16s) [production]
19:26 <reedy> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 15s) [production]
19:17 <ori> upgraded HHVM to 3.3.0+dfsg1-1+wm1 [production]
18:58 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf6 [production]
18:57 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf5 [production]
18:47 <reedy> Finished scap: testwiki to 1.25wmf6 and build l10n cache (duration: 28m 30s) [production]
18:18 <reedy> Started scap: testwiki to 1.25wmf6 and build l10n cache [production]
17:24 <cmjohnson> shutting down to replace ssds in elastic1002,1007,1014 [production]
17:07 <ori> Synchronized wmf-config/CommonSettings.php: I8dd62e2cc: Re-enable hhvm beta feature on Wikidata (duration: 00m 06s) [production]
16:20 <manybubbles> elastic101[7-9] look good to me - adding them to the cluster [production]
16:17 <manybubbles> shutting down elasticsearch on elastic1002 - its empty and ready to have its disk upgraded/hyper threading enabled [production]
16:05 <manybubbles> ignore my last log message about 1017 - typod [production]
16:05 <manybubbles> shutting down elasticsearch on elastic1007 - its empty and ready to have its disk upgraded/hyper threading enabled [production]
16:04 <manybubbles> shutting down elasticsearch on elastic1014 - its empty and ready to have its disk upgraded/hyper threading enabled [production]
16:04 <manybubbles> shutting down elasticsearch on elastic1017 - its empty and ready to have its disk upgraded/hyper threading enabled [production]
15:39 <manybubbles> start moving shards back to elastic1001 and elastic1008 now that they are up with hyperthreading on [production]
15:37 <Reedy> deleted php-1.24wmf21 from mediawiki-installation [production]
15:36 <Reedy> deleted php-1.24wmf20 from mediawiki-installation [production]
15:35 <Reedy> deleted php-1.24wmf19 from mediawiki-installation [production]
15:35 <akosiaris> uploaded apertium-apy_0.1+svn~57689-1 on apt.wikimedia.org [production]
15:23 <manybubbles> unbanned elastic1013 now that it is back with hyper threading on [production]
15:21 <reedy> Purged l10n cache for 1.25wmf3 [production]
15:20 <reedy> Purged l10n cache for 1.25wmf2 [production]
15:19 <bd808> Restarted logstash on logstash1002 to fix OCG and hadoop log events not being recorded [production]
15:15 <bd808> Restarted logstash on logstash1001. No MW events were being added to the index. [production]
15:10 <anomie> Synchronized wmf-config/throttle.php: SWAT: Raise account creation throttle at cawiki temporarily [[gerrit:169708]] (duration: 00m 09s) [production]
15:07 <anomie> Synchronized php-1.25wmf5/extensions/Wikidata: SWAT: Fix WikiData "add links" widget JS error [[gerrit:169700]] (duration: 00m 15s) [production]
15:07 <Reedy> Killed old (pre 1.25) l10nupdate cache dirs from tin:/var/lib/l10nupdate [production]
15:00 <manybubbles> started moving shard off of elastic1001, elastic1008, and elastic1013 so we can bounce them to enable hyper threading [production]
14:55 <manybubbles> started rolling shards back to elastic1001, elastic1008, and elastic1013 after hard drive upgrade [production]
14:21 <ottomata> set request.required.acks = 2 for all varnishkafkas [production]
13:22 <manybubbles> lowered replication on logstash's template for new indexes from 3 way to 2 way [production]
13:20 <demon> Synchronized wmf-config/lucene-production.php: unbreak lsearchd for commons, enwikitionary, etc (duration: 00m 04s) [production]