| 
      
        2018-09-17
      
      §
     | 
  
    
  | 09:28 | 
  <marostegui> | 
  Deploy schema change on s7 eqiad master (db1062) - T187089 | 
  [production] | 
            
  | 09:16 | 
  <jynus> | 
  stop and reimage db1068 (may generate s4 lag) | 
  [production] | 
            
  | 08:43 | 
  <moritzm> | 
  installing postgresql security updates on maps* | 
  [production] | 
            
  | 08:29 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:460432|New throttle rule for enwiki event (T204243)]] (duration: 00m 49s) | 
  [production] | 
            
  | 08:07 | 
  <jynus> | 
  stop and reimage db1062 (may generate s7 lag) | 
  [production] | 
            
  | 07:46 | 
  <moritzm> | 
  repooled wtp1043 (T196886) | 
  [production] | 
            
  | 07:31 | 
  <godog> | 
  repair sdj on ms-be2040 - T199198 | 
  [production] | 
            
  | 07:29 | 
  <godog> | 
  force power on for ms-be2030 | 
  [production] | 
            
  | 07:24 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1092 and db1099:3318 - T201011 (duration: 00m 49s) | 
  [production] | 
            
  | 07:24 | 
  <marostegui> | 
  Deploy schema change on s8 - T201011 | 
  [production] | 
            
  | 07:18 | 
  <marostegui> | 
  Stop replication in sync on db1092 and db1099:3318 - T201011 | 
  [production] | 
            
  | 07:18 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1092 and db1099:3318 - T201011 (duration: 00m 49s) | 
  [production] | 
            
  | 07:01 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1094 and db1098:3317 - T201011 (duration: 00m 49s) | 
  [production] | 
            
  | 06:53 | 
  <marostegui> | 
  Stop replication in sync on db1094 and db1098:3317 - T201011 | 
  [production] | 
            
  | 06:53 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1094 and db1098:3317 - T201011 (duration: 01m 04s) | 
  [production] | 
            
  | 06:33 | 
  <marostegui> | 
  Deploy schema change on s7 (frwiktionary,metawiki) - T201011 | 
  [production] | 
            
  | 06:31 | 
  <marostegui> | 
  Deploy schema change on s4 - T201011 | 
  [production] | 
            
  | 06:03 | 
  <marostegui> | 
  Deploy schema change on s3 - T201011 | 
  [production] | 
            
  | 05:47 | 
  <marostegui> | 
  Deploy schema change on s3:testwikidatawiki directly on the master (db2043) - T201011 | 
  [production] | 
            
  | 05:36 | 
  <marostegui> | 
  Deploy schema change on s3:testwiki directly on the master (db2043) - T201011 | 
  [production] | 
            
  | 05:28 | 
  <marostegui> | 
  Deploy schema change on s1 eqiad master (db1067) - T67448 T114117 T51191 | 
  [production] | 
            
  | 02:46 | 
  <l10nupdate@deploy1001> | 
  ResourceLoader cache refresh completed at Mon Sep 17 02:46:18 UTC 2018 (duration 10m 52s) | 
  [production] | 
            
  | 02:35 | 
  <l10nupdate@deploy1001> | 
  scap sync-l10n completed (1.32.0-wmf.20) (duration: 14m 20s) | 
  [production] | 
            
  
    | 
      
        2018-09-14
      
      §
     | 
  
    
  | 21:19 | 
  <andrew@deploy1001> | 
  Finished deploy [horizon/deploy@56340cd]: Fix proxy creation in neutron regions (duration: 03m 31s) | 
  [production] | 
            
  | 21:16 | 
  <andrew@deploy1001> | 
  Started deploy [horizon/deploy@56340cd]: Fix proxy creation in neutron regions | 
  [production] | 
            
  | 21:03 | 
  <mutante> | 
  ACKed memory error alert on wtp2011 - existing ticket but fresh alert popped up 9h ago (T200678) | 
  [production] | 
            
  | 20:12 | 
  <ejegg> | 
  updated payments-wiki from 44b9409104 to 43923fadd9 | 
  [production] | 
            
  | 15:57 | 
  <jynus> | 
  set thread_pool_size to 64 at db2047 | 
  [production] | 
            
  | 14:42 | 
  <ema> | 
  lvs3002: restart pybal to remove misc-web T164609 | 
  [production] | 
            
  | 14:28 | 
  <ema> | 
  lvs2002: restart pybal to remove misc-web T164609 | 
  [production] | 
            
  | 14:23 | 
  <ema> | 
  lvs1002: restart pybal to remove misc-web T164609 | 
  [production] | 
            
  | 14:11 | 
  <jynus> | 
  shutting down db1062 for dc maintenance T204302 | 
  [production] | 
            
  | 13:58 | 
  <jynus> | 
  stop and restart db1118 for upgrade | 
  [production] | 
            
  | 12:51 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: T204127: Weight Adjust db2068 (duration: 00m 50s) | 
  [production] | 
            
  | 09:47 | 
  <banyek> | 
  operation stopping db1070 in preparation for reimage | 
  [production] | 
            
  | 08:45 | 
  <marostegui> | 
  Deploy schema change on s7 eqiad master (db1062) - T89737 | 
  [production] | 
            
  | 08:34 | 
  <mobrovac@deploy1001> | 
  Started restart [cpjobqueue/deploy@32a81be]: (no justification provided) | 
  [production] | 
            
  | 08:29 | 
  <moritzm> | 
  rebooting acamar for kernel tests | 
  [production] | 
            
  | 08:27 | 
  <elukey> | 
  reboot kafka100[1-3] (eventbus eqiad) for kernel upgrades | 
  [production] | 
            
  | 08:20 | 
  <jynus> | 
  stopping and restarting db1069 for upgrade (x1 eqiad master) | 
  [production] | 
            
  | 08:15 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: T204127: Weight Adjust db2068 (duration: 00m 50s) | 
  [production] | 
            
  | 07:49 | 
  <marostegui> | 
  Deploy schema change on s4 eqiad master (db1068) - T67448 T114117 T51191 | 
  [production] | 
            
  | 07:40 | 
  <moritzm> | 
  rebooting mwmaint1001 for kernel security update | 
  [production] | 
            
  | 07:28 | 
  <jynus> | 
  stopping db1062 mariadb in preparation for reimage | 
  [production] | 
            
  | 07:11 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: T204127: Weight Adjust db2068 (duration: 00m 50s) | 
  [production] | 
            
  | 05:34 | 
  <marostegui> | 
  Deploy schema change on s3 eqiad master - T187089 | 
  [production] |