| 2015-08-04
      
      § | 
    
  | 11:48 | <_joe_> | killed ircecho to prevent furter icinga spam | [production] | 
            
  | 11:44 | <jynus> | schema update on Commons failed, expect some minor inestabilities until everything is fixed | [production] | 
            
  | 11:41 | <_joe_> | reimaging mw1159 to HAT | [production] | 
            
  | 11:01 | <paravoid> | upgrading junos on asw-a-codfw | [production] | 
            
  | 10:57 | <jynus> | Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 00m 13s) | [production] | 
            
  | 10:27 | <godog> | bootstrap cassandra on restbase1009 | [production] | 
            
  | 10:21 | <akosiaris> | enabling puppet on tin | [production] | 
            
  | 09:30 | <jynus> | rolling schema change on image table to all wikis | [production] | 
            
  | 08:07 | <jynus> | Synchronized wmf-config/db-eqiad.php: Increasing load for db1027 and db1015 (duration: 00m 12s) | [production] | 
            
  | 07:38 | <@tin> | ResourceLoader cache refresh completed at Tue Aug  4 07:38:01 UTC 2015 (duration 38m 0s) | [production] | 
            
  | 06:14 | <_joe_> | depooled mw1061 | [production] | 
            
  | 06:14 | <legoktm> | Synchronized wmf-config/InitialiseSettings.php: Disable Flow on Japanese Wikiversity (duration: 00m 13s) | [production] | 
            
  | 06:09 | <legoktm> | Synchronized wmf-config/InitialiseSettings.php: Disable Flow on English Wikiversity (duration: 00m 12s) | [production] | 
            
  | 06:07 | <legoktm> | sync to mw1061 failed | [production] | 
            
  | 06:07 | <legoktm> | Synchronized wmf-config/InitialiseSettings.php: Disable Flow on English Wikiversity (duration: 00m 12s) | [production] | 
            
  | 02:32 | <@tin> | LocalisationUpdate completed (1.26wmf16) at 2015-08-04 02:32:18+00:00 | [production] | 
            
  | 02:28 | <l10nupdate> | Synchronized php-1.26wmf16/cache/l10n: (no message) (duration: 09m 16s) | [production] | 
            
  | 02:18 | <twentyafterfour> | Finished scap: sync https://gerrit.wikimedia.org/r/#/c/229036/1 (duration: 25m 41s) | [production] | 
            
  | 01:52 | <twentyafterfour> | Started scap: sync https://gerrit.wikimedia.org/r/#/c/229036/1 | [production] | 
            
  
    | 2015-08-03
      
      § | 
    
  | 23:45 | <ottomata> | rebuilding kafka cluster | [production] | 
            
  | 23:21 | <ebernhardson> | Synchronized php-1.26wmf16/extensions/VisualEditor/: Bump visualeditor for swat in 1.26wmf16 (duration: 00m 13s) | [production] | 
            
  | 23:18 | <ebernhardson> | Synchronized php-1.26wmf16/extensions/WikimediaEvents/: Bump WikimediaEvents in SWAT for 1.26wmf16 (duration: 00m 12s) | [production] | 
            
  | 23:17 | <ebernhardson> | Synchronized php-1.26wmf16/extensions/Flow: Bump flow submodule in swat for 1.26wmf16 (duration: 00m 14s) | [production] | 
            
  | 23:05 | <ebernhardson> | Synchronized wmf-config/: (no message) (duration: 00m 13s) | [production] | 
            
  | 21:04 | <bd808> | Synchronized wmf-config/logging.php: Remove code duplication from monolog config (Ia960203) (duration: 00m 11s) | [production] | 
            
  | 20:26 | <arlolra> | updated Parsoid to version 38d0cdb13734a40bc2908e779e1a0cde158048f2 | [production] | 
            
  | 19:49 | <aude> | Synchronized php-1.26wmf16/extensions/Wikidata: Fix T104609 and fix/debug T107711 (duration: 00m 19s) | [production] | 
            
  | 19:21 | <aude> | Synchronized usagetracking.dblist: Enable usage tracking on enwiki (duration: 00m 12s) | [production] | 
            
  | 19:20 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Add debug log group for T107711 (duration: 00m 12s) | [production] | 
            
  | 19:07 | <ottomata> | stopped a couple of kafka brokers.  acknowldeging.. | [production] | 
            
  | 19:02 | <bblack> | https://gerrit.wikimedia.org/r/228882 reversion salted + nginx reloaded | [production] | 
            
  | 18:28 | <gwicke> | switched restbase1002 and restbase1003 to iojs as well | [production] | 
            
  | 17:36 | <aude> | Synchronized usagetracking.dblist: Enable usage tracking on zhwiki (duration: 00m 12s) | [production] | 
            
  | 17:21 | <legoktm> | Synchronized php-1.26wmf16/includes/Revision.php: https://gerrit.wikimedia.org/r/228853 (duration: 00m 12s) | [production] | 
            
  | 17:21 | <ottomata> | starting kafka partition reassignment to balance all partiions over to 3 new kafka brokers and off of analytics1021 | [production] | 
            
  | 17:21 | <gwicke> | switching from node 0.10 to iojs 2.5 on restbase1001 after load testing on xenon went well | [production] | 
            
  | 17:02 | <legoktm> | Synchronized wmf-config/logging.php: logging: Enable stacktrace printing (duration: 00m 12s) | [production] | 
            
  | 17:00 | <hoo> | Started dumpwikidatajson.sh on snapshot1003 to re-create today's dump | [production] | 
            
  | 16:55 | <legoktm> | Synchronized php-1.26wmf16/autoload.php: https://gerrit.wikimedia.org/r/#/c/228850/ (duration: 00m 12s) | [production] | 
            
  | 16:54 | <legoktm> | Synchronized php-1.26wmf16/includes/debug/logger/: https://gerrit.wikimedia.org/r/#/c/228850/ (duration: 00m 11s) | [production] | 
            
  | 16:49 | <hoo> | Removed today's Wikidata json dump (wikidata-20150803-all.json.gz) because it was incomplete due to the dataset problems earlier | [production] | 
            
  | 16:27 | <paravoid> | upgrading junos on cr2-codfw | [production] | 
            
  | 15:34 | <bblack> | wiping cp3034 disk cache (upload esams) for ipsec reload testing | [production] | 
            
  | 15:23 | <thcipriani> | Synchronized php-1.26wmf16/extensions/MultimediaViewer: SWAT: Track image load time with statsv (touch and re-sync) [[gerrit:228218]] (duration: 00m 12s) | [production] | 
            
  | 15:22 | <ottomata> | reinstalling analytics1013,1014 and 1020  with Jessie | [production] | 
            
  | 15:10 | <thcipriani> | Synchronized php-1.26wmf16/extensions/MultimediaViewer: SWAT: Track image load time with statsv [[gerrit:228218]] (duration: 00m 12s) | [production] | 
            
  | 14:59 | <aude> | Synchronized usagetracking.dblist: Enable usage tracking on trwiki (duration: 00m 12s) | [production] | 
            
  | 14:54 | <krenair> | Synchronized php-1.26wmf16/extensions/SemanticResultFormats: https://gerrit.wikimedia.org/r/#/c/228793/ (duration: 00m 13s) | [production] | 
            
  | 14:42 | <aude> | Synchronized usagetracking.dblist: Enable usage tracking on thwiki (duration: 00m 12s) | [production] | 
            
  | 14:33 | <mutante> | temp. stop puppet on dataset1001 | [production] |