3101-3150 of 10000 results (35ms)
2015-08-04 §
13:45 <_joe_> repooling mw1159,mw1160 [production]
13:21 <paravoid> rebooting asw-a-codfw, member 2 [production]
13:04 <Coren> labstore1001 rebooting (possibly a couple of times) during tests and reinstallation [production]
12:55 <hoo> Syncing to mw1160 failed (Host key verification failed.) [production]
12:50 <hoo> Synchronized php-1.26wmf16/extensions/Wikidata/: Update Wikibase: Fixes for JSON dump creation (duration: 00m 39s) [production]
12:06 <moritzm> updated canary appservers mw1017/mw1018 to updated pcre3 + hhvm restart [production]
12:03 <moritzm> added pcre3_8.31-2ubuntu2.1+wm1 to trusty-wikimedi (reroll of security update with our JIT enablement patch) [production]
11:48 <_joe_> killed ircecho to prevent furter icinga spam [production]
11:44 <jynus> schema update on Commons failed, expect some minor inestabilities until everything is fixed [production]
11:41 <_joe_> reimaging mw1159 to HAT [production]
11:01 <paravoid> upgrading junos on asw-a-codfw [production]
10:57 <jynus> Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 00m 13s) [production]
10:27 <godog> bootstrap cassandra on restbase1009 [production]
10:21 <akosiaris> enabling puppet on tin [production]
09:30 <jynus> rolling schema change on image table to all wikis [production]
08:07 <jynus> Synchronized wmf-config/db-eqiad.php: Increasing load for db1027 and db1015 (duration: 00m 12s) [production]
07:38 <@tin> ResourceLoader cache refresh completed at Tue Aug 4 07:38:01 UTC 2015 (duration 38m 0s) [production]
06:14 <_joe_> depooled mw1061 [production]
06:14 <legoktm> Synchronized wmf-config/InitialiseSettings.php: Disable Flow on Japanese Wikiversity (duration: 00m 13s) [production]
06:09 <legoktm> Synchronized wmf-config/InitialiseSettings.php: Disable Flow on English Wikiversity (duration: 00m 12s) [production]
06:07 <legoktm> sync to mw1061 failed [production]
06:07 <legoktm> Synchronized wmf-config/InitialiseSettings.php: Disable Flow on English Wikiversity (duration: 00m 12s) [production]
02:32 <@tin> LocalisationUpdate completed (1.26wmf16) at 2015-08-04 02:32:18+00:00 [production]
02:28 <l10nupdate> Synchronized php-1.26wmf16/cache/l10n: (no message) (duration: 09m 16s) [production]
02:18 <twentyafterfour> Finished scap: sync https://gerrit.wikimedia.org/r/#/c/229036/1 (duration: 25m 41s) [production]
01:52 <twentyafterfour> Started scap: sync https://gerrit.wikimedia.org/r/#/c/229036/1 [production]
2015-08-03 §
23:45 <ottomata> rebuilding kafka cluster [production]
23:21 <ebernhardson> Synchronized php-1.26wmf16/extensions/VisualEditor/: Bump visualeditor for swat in 1.26wmf16 (duration: 00m 13s) [production]
23:18 <ebernhardson> Synchronized php-1.26wmf16/extensions/WikimediaEvents/: Bump WikimediaEvents in SWAT for 1.26wmf16 (duration: 00m 12s) [production]
23:17 <ebernhardson> Synchronized php-1.26wmf16/extensions/Flow: Bump flow submodule in swat for 1.26wmf16 (duration: 00m 14s) [production]
23:05 <ebernhardson> Synchronized wmf-config/: (no message) (duration: 00m 13s) [production]
21:04 <bd808> Synchronized wmf-config/logging.php: Remove code duplication from monolog config (Ia960203) (duration: 00m 11s) [production]
20:26 <arlolra> updated Parsoid to version 38d0cdb13734a40bc2908e779e1a0cde158048f2 [production]
19:49 <aude> Synchronized php-1.26wmf16/extensions/Wikidata: Fix T104609 and fix/debug T107711 (duration: 00m 19s) [production]
19:21 <aude> Synchronized usagetracking.dblist: Enable usage tracking on enwiki (duration: 00m 12s) [production]
19:20 <aude> Synchronized wmf-config/InitialiseSettings.php: Add debug log group for T107711 (duration: 00m 12s) [production]
19:07 <ottomata> stopped a couple of kafka brokers. acknowldeging.. [production]
19:02 <bblack> https://gerrit.wikimedia.org/r/228882 reversion salted + nginx reloaded [production]
18:28 <gwicke> switched restbase1002 and restbase1003 to iojs as well [production]
17:36 <aude> Synchronized usagetracking.dblist: Enable usage tracking on zhwiki (duration: 00m 12s) [production]
17:21 <legoktm> Synchronized php-1.26wmf16/includes/Revision.php: https://gerrit.wikimedia.org/r/228853 (duration: 00m 12s) [production]
17:21 <ottomata> starting kafka partition reassignment to balance all partiions over to 3 new kafka brokers and off of analytics1021 [production]
17:21 <gwicke> switching from node 0.10 to iojs 2.5 on restbase1001 after load testing on xenon went well [production]
17:02 <legoktm> Synchronized wmf-config/logging.php: logging: Enable stacktrace printing (duration: 00m 12s) [production]
17:00 <hoo> Started dumpwikidatajson.sh on snapshot1003 to re-create today's dump [production]
16:55 <legoktm> Synchronized php-1.26wmf16/autoload.php: https://gerrit.wikimedia.org/r/#/c/228850/ (duration: 00m 12s) [production]
16:54 <legoktm> Synchronized php-1.26wmf16/includes/debug/logger/: https://gerrit.wikimedia.org/r/#/c/228850/ (duration: 00m 11s) [production]
16:49 <hoo> Removed today's Wikidata json dump (wikidata-20150803-all.json.gz) because it was incomplete due to the dataset problems earlier [production]
16:27 <paravoid> upgrading junos on cr2-codfw [production]
15:34 <bblack> wiping cp3034 disk cache (upload esams) for ipsec reload testing [production]