| 2018-02-14
      
      § | 
    
  | 10:46 | <jynus> | dropping test databases from m5 T186585 | [production] | 
            
  | 10:42 | <marostegui> | Stop replication in sync on db1089 and db1067 - T162807 | [production] | 
            
  | 10:28 | <moritzm> | installing libvorbis security updates on trusty systems | [production] | 
            
  | 10:13 | <marostegui> | Deploy schema change on db1100 - T187089 T185128 T153182 | [production] | 
            
  | 10:11 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 01m 12s) | [production] | 
            
  | 10:02 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully repool db1096:3316,3315 (duration: 01m 12s) | [production] | 
            
  | 09:50 | <akosiaris> | set standard weight for all ores* hosts | [production] | 
            
  | 09:50 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1096:3316,3315 (duration: 01m 12s) | [production] | 
            
  | 09:49 | <akosiaris@puppetmaster1001> | conftool action : set/weight=10; selector: all (tags: ['dc=eqiad', 'cluster=ores', 'service=ores']) | [production] | 
            
  | 09:49 | <akosiaris@puppetmaster1001> | conftool action : set/weight=10; selector: all (tags: ['dc=codfw', 'cluster=ores', 'service=ores']) | [production] | 
            
  | 09:31 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1096:3316,3315 (duration: 01m 12s) | [production] | 
            
  | 09:20 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool slowly db1096:3316,3315 (duration: 01m 13s) | [production] | 
            
  | 09:08 | <marostegui> | Deploy schema change on s5 dbstore1002 https://phabricator.wikimedia.org/T187089 https://phabricator.wikimedia.org/T185128 https://phabricator.wikimedia.org/T153182 | [production] | 
            
  | 09:02 | <marostegui> | Stop MySQL on db1096:3315 and 3316 for mysql+kernel upgrade | [production] | 
            
  | 08:45 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Rebalance s8 (duration: 01m 13s) | [production] | 
            
  | 08:38 | <akosiaris> | pybal restart on lvs1003 to pickup https://gerrit.wikimedia.org/r/410398 | [production] | 
            
  | 08:29 | <akosiaris> | pybal restart on lvs1006, lvs1009, lvs1012 to pickup https://gerrit.wikimedia.org/r/410398 | [production] | 
            
  | 08:08 | <_joe_> | powercycled ganeti1008 | [production] | 
            
  | 07:04 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 (duration: 01m 12s) | [production] | 
            
  | 06:44 | <marostegui> | Stop replication in sync db1089 and db1067 - T162807 | [production] | 
            
  | 06:44 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1067 - T162807 (duration: 01m 12s) | [production] | 
            
  | 06:31 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db1096:3315 for alter table (duration: 01m 13s) | [production] | 
            
  | 06:30 | <marostegui> | Deploy schema change on db1096:3315 - T187089 T185128 T153182 | [production] | 
            
  | 05:55 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: updating sudo-dashboard (duration: 03m 13s) | [production] | 
            
  | 05:52 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: updating sudo-dashboard | [production] | 
            
  | 05:52 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: updating sudo-dashboard (duration: 00m 20s) | [production] | 
            
  | 05:51 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: updating sudo-dashboard | [production] | 
            
  | 02:25 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.20) (duration: 05m 39s) | [production] | 
            
  | 02:02 | <demon@tin> | Synchronized fonts/: removing executable bits, no-op (duration: 01m 15s) | [production] | 
            
  | 01:33 | <demon@tin> | Finished deploy [gerrit/gerrit@b234c85]: rm reviewers plugin (for now) (duration: 00m 11s) | [production] | 
            
  | 01:32 | <demon@tin> | Started deploy [gerrit/gerrit@b234c85]: rm reviewers plugin (for now) | [production] | 
            
  | 00:25 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:410358|Add uploader user group to mznwiki and make it automagically added]] T187187 (duration: 01m 12s) | [production] | 
            
  | 00:12 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:410353|Enable xkill on top wikis that use x aspect]] T187265 (duration: 01m 14s) | [production] | 
            
  
    | 2018-02-13
      
      § | 
    
  | 21:19 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: group0 wikis to 1.31.0-wmf.21 | [production] | 
            
  | 21:07 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: another try with static content (duration: 00m 49s) | [production] | 
            
  | 21:07 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: another try with static content | [production] | 
            
  | 21:06 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: another try with static content (duration: 00m 03s) | [production] | 
            
  | 21:06 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: another try with static content | [production] | 
            
  | 20:43 | <twentyafterfour@tin> | Finished scap: T183960 Build l10n cache & Deploy wmf/1.31.0-wmf.21 to test wikis (duration: 31m 01s) | [production] | 
            
  | 20:41 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: updated static content collection process (duration: 00m 21s) | [production] | 
            
  | 20:41 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: updated static content collection process | [production] | 
            
  | 20:26 | <jynus> | upgrading labsdb1010 database - proxies will complain for some time | [production] | 
            
  | 20:18 | <andrew@tin> | Finished deploy [horizon/deploy@c355366]: updated static content collection process (duration: 01m 17s) | [production] | 
            
  | 20:17 | <andrew@tin> | Started deploy [horizon/deploy@c355366]: updated static content collection process | [production] | 
            
  | 20:12 | <twentyafterfour@tin> | Started scap: T183960 Build l10n cache & Deploy wmf/1.31.0-wmf.21 to test wikis | [production] | 
            
  | 20:11 | <twentyafterfour> | Currently there are no blockers listed on T183960 and the train is leaving the station. | [production] | 
            
  | 20:05 | <twentyafterfour> | MediaWiki Train 1.31.0-wmf.21 branched, prepped and patched | Changelog uploaded to https://www.mediawiki.org/wiki/MediaWiki_1.31/wmf.21/Changelog | Blockers: T183960 | [production] | 
            
  | 19:03 | <jynus> | upgrade and restart db2042 | [production] | 
            
  | 18:53 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool db2042 (duration: 01m 58s) | [production] | 
            
  | 18:25 | <elukey> | Analytics Hadoop cluster upgrade to Java 8 about to start - complete cluster shutdown is needed - T166248 | [production] |