| 2018-04-19
      
      ยง | 
    
  | 15:52 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1082 after alter table (duration: 01m 16s) | [production] | 
            
  | 15:50 | <fdans@tin> | Finished deploy [analytics/refinery@5d0f63f]: deploying to launch page preview job (duration: 06m 34s) | [production] | 
            
  | 15:47 | <marostegui> | Deploy schema change on dbstore1002 (s5) - T191519 T188299 T190148 | [production] | 
            
  | 15:44 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Repool db2074 (duration: 01m 17s) | [production] | 
            
  | 15:44 | <fdans@tin> | Started deploy [analytics/refinery@5d0f63f]: deploying to launch page preview job | [production] | 
            
  | 15:42 | <sbisson@tin> | Finished deploy [kartotherian/deploy@0a5a3ef]: Deploy latest kartotherian with new i18n sources (take 3) (duration: 05m 22s) | [production] | 
            
  | 15:37 | <sbisson@tin> | Started deploy [kartotherian/deploy@0a5a3ef]: Deploy latest kartotherian with new i18n sources (take 3) | [production] | 
            
  | 15:36 | <sbisson@tin> | Finished deploy [kartotherian/deploy@89c4ca9]: Deploy latest kartotherian with new i18n sources (take 2) (duration: 03m 05s) | [production] | 
            
  | 15:33 | <sbisson@tin> | Started deploy [kartotherian/deploy@89c4ca9]: Deploy latest kartotherian with new i18n sources (take 2) | [production] | 
            
  | 15:16 | <sbisson@tin> | Finished deploy [kartotherian/deploy@74121d5]: Deploy latest kartotherian with new i18n sources (duration: 05m 19s) | [production] | 
            
  | 15:11 | <sbisson@tin> | Started deploy [kartotherian/deploy@74121d5]: Deploy latest kartotherian with new i18n sources | [production] | 
            
  | 14:48 | <Dereckson> | Erratum: read "[[User:Andrei Stroe]]" and not "[[User:Anderi Store]]" for the previous entry (T187184) | [production] | 
            
  | 14:47 | <Dereckson> | Create bureaucrat account for [[User:Anderi Store]] on romd.wikimedia (T187184) | [production] | 
            
  | 14:30 | <marostegui> | Star atop on db1114 without "-R" - T192551 | [production] | 
            
  | 14:29 | <marostegui> | Deploy schema change on db1082 (this will generate lag on s5 on labs hosts) - T191519 T188299 T190148 | [production] | 
            
  | 14:28 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1082 for alter table (duration: 01m 13s) | [production] | 
            
  | 14:19 | <ejegg> | re-enabled queue jobs | [production] | 
            
  | 14:14 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 after alter table (duration: 01m 16s) | [production] | 
            
  | 14:12 | <jynus> | starting reimage of db2074 | [production] | 
            
  | 13:56 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Repool db2075, depool db2074 (duration: 01m 16s) | [production] | 
            
  | 13:39 | <marostegui> | Stop atop on db1114 - T191996 | [production] | 
            
  | 13:33 | <marostegui> | Start atop on db1114 - T191996 | [production] | 
            
  | 13:30 | <Trey314159> | reindexing serbian wikis on elastic@eqiad (T189265) | [production] | 
            
  | 13:30 | <moritzm> | upgrading mw1334-mw1337 (job runners) to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build | [production] | 
            
  | 13:14 | <reedy@tin> | Synchronized wmf-config/InitialiseSettings.php: T192427 T189277 (duration: 01m 17s) | [production] | 
            
  | 12:58 | <jynus> | starting reimage of db2075 | [production] | 
            
  | 12:48 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool db2075 (duration: 01m 16s) | [production] | 
            
  | 11:55 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Repool db2076 (duration: 01m 16s) | [production] | 
            
  | 11:39 | <moritzm> | upgrading eqiad video scalers to  MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build | [production] | 
            
  | 11:24 | <marostegui> | Run check_private_data on labsdb - T183566 | [production] | 
            
  | 11:21 | <marostegui> | Sanitize lfnwiki - T183566 | [production] | 
            
  | 11:20 | <moritzm> | upgrading app servers mw1238-mw1258 to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build | [production] | 
            
  | 11:14 | <akosiaris@tin> | Synchronized wmf-config/ProductionServices.php: T181121 (duration: 01m 16s) | [production] | 
            
  | 11:09 | <akosiaris@tin> | Synchronized wmf-config/ProductionServices.php: (no justification provided) (duration: 01m 17s) | [production] | 
            
  | 11:05 | <marostegui> | Deploy schema change on db1113:3315 - T191519 T188299 T190148 | [production] | 
            
  | 11:03 | <jynus> | starting reimage of db2076 | [production] | 
            
  | 11:02 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 for alter table (duration: 01m 16s) | [production] | 
            
  | 11:01 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool db2076 (duration: 01m 18s) | [production] | 
            
  | 10:34 | <moritzm> | upgrading API servers mw1221-mw1235 to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build | [production] | 
            
  | 10:27 | <vgutierrez> | Repool (Re-enable BGP) lvs4005 - T191897 | [production] | 
            
  | 09:59 | <elukey> | complete migration of zookeeper on conf100[123] | [production] | 
            
  | 09:55 | <akosiaris> | reboot ganeti VMs on row_B in codfw for cache=none setting. T181121 | [production] | 
            
  | 09:54 | <vgutierrez> | Updating puppet compiler facts | [production] | 
            
  | 09:51 | <moritzm> | rolling restart of Cassandra on maps completed | [production] | 
            
  | 09:33 | <elukey> | upgrade zookeper on conf100[123] from 3.4.5 to 3.4.9 - T182924 | [production] | 
            
  | 09:31 | <akosiaris> | start a force puppet run in all of eqiad with a batch size of 30 | [production] | 
            
  | 09:29 | <akosiaris> | stop ircecho for a while, puppetdb1001 reboot was eventful | [production] | 
            
  | 09:17 | <akosiaris> | reboot puppetdb1001 for cache=none setting apply. T181121 | [production] | 
            
  | 09:14 | <moritzm> | installing Java security updates on maps* plus rolling restart of Cassandra to pick up new JRE | [production] | 
            
  | 09:06 | <vgutierrez> | Depool and reimage lvs4005 as stretch - T191897 | [production] |