| 2019-01-18
      
      § | 
    
  | 13:41 | <marostegui> | reload haproxy on dbproxy1004 | [production] | 
            
  | 13:18 | <godog> | start cassandra-a on restbase1016 - T212418 | [production] | 
            
  | 13:07 | <mbsantos@deploy1001> | Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) | [production] | 
            
  | 13:06 | <mbsantos@deploy1001> | Started deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed | [production] | 
            
  | 12:50 | <moritzm> | uploaded ferm 2.4-1+wmf1 to buster-wikimedia (T213527) | [production] | 
            
  | 11:46 | <moritzm> | copied prometheus-rsyslog-exporter from stretch-wikimedia to buster-wikimedia | [production] | 
            
  | 11:09 | <marostegui> | Deploy schema change on db2039 (s6 codfw master) - T210713 | [production] | 
            
  | 10:54 | <marostegui> | Deploy schema change on dbstore2001:3316 - T210713 | [production] | 
            
  | 10:42 | <jynus> | killing and removing data from db1118 | [production] | 
            
  | 10:41 | <marostegui> | Deploy schema change on db2076 - T210713 | [production] | 
            
  | 10:29 | <vgutierrez> | restarting pybal in lvs2002 - T214072 | [production] | 
            
  | 10:23 | <marostegui> | Deploy schema change on db2087:3316 - T210713 | [production] | 
            
  | 10:23 | <vgutierrez> | restarting pybal in lvs2005 - T214072 | [production] | 
            
  | 10:02 | <marostegui> | Add dbstore1003:3315 to zarcillo - T210478 | [production] | 
            
  | 09:58 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) | [production] | 
            
  | 09:57 | <marostegui> | Add dbstore1003:3315 to tendril - T210478 | [production] | 
            
  | 09:52 | <marostegui> | Deploy schema change on db2089 - T210713 | [production] | 
            
  | 09:35 | <marostegui> | Deploy schema change on db2067 - T210713 | [production] | 
            
  | 09:29 | <_joe_> | uploading python{,3}-pygerrit2 to stretch-wikimedia, T214149 | [production] | 
            
  | 09:23 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Add migrated wikis from s3 to s5 to codfw config T184805 (duration: 00m 45s) | [production] | 
            
  | 09:01 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after mysql upgrade (duration: 00m 46s) | [production] | 
            
  | 08:12 | <godog> | depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 | [production] | 
            
  | 07:31 | <moritzm> | rolling restart of AQS to pick up OpenSSL security updates for nodejs | [production] | 
            
  | 07:30 | <marostegui> | Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade | [production] | 
            
  | 07:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) | [production] | 
            
  | 07:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 - T210478 (duration: 00m 46s) | [production] | 
            
  | 07:16 | <moritzm> | installing OpenSSL security updates | [production] | 
            
  | 06:54 | <marostegui> | Drop table tag_summary from s7 - T212255 | [production] | 
            
  | 06:46 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1075 and db1103 after DC hw maintenance (duration: 00m 44s) | [production] | 
            
  | 06:46 | <marostegui> | Deploy schema change on dbstore1002:s3 - T85757 | [production] | 
            
  | 06:29 | <marostegui> | Deploy schema change on db1075 - T85757 | [production] | 
            
  | 06:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool DBs on A2 rack T213748 (duration: 00m 47s) | [production] | 
            
  | 00:00 | <ejegg> | updated payments-wiki from c455bbc6bb to 7d4cd165d9 | [production] | 
            
  
    | 2019-01-17
      
      § | 
    
  | 23:02 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try (duration: 02m 03s) | [production] | 
            
  | 23:00 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try | [production] | 
            
  | 20:06 | <dduvall@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.13 | [production] | 
            
  | 19:29 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: Make welcome survey C unescapable (T213958) (duration: 00m 52s) | [production] | 
            
  | 19:16 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Update groupOverrides for Serbian wikis (T213055, T213059, T213063, T213065, T213679, T213680, T213681, T213682, T213684, T213685, T213686, T213687, T213824, T213825, T213826, T213827, T213828, T213829, T213830, T213832) (duration: 00m 53s) | [production] | 
            
  | 19:02 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@f24d681]: Update recommendation api endpoints (duration: 20m 26s) | [production] | 
            
  | 18:42 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@f24d681]: Update recommendation api endpoints | [production] | 
            
  | 18:22 | <vgutierrez> | running ipvsadm -D -t 10.2.1.29:1968 in lvs2003 - T214041 | [production] | 
            
  | 18:19 | <vgutierrez> | running ipvsadm -D -t 10.2.1.29:1968 in lvs2006 - T214041 | [production] | 
            
  | 18:18 | <bmansurov@deploy1001> | Finished deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 (duration: 05m 36s) | [production] | 
            
  | 18:12 | <bmansurov@deploy1001> | Started deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 | [production] | 
            
  | 17:52 | <elukey> | re-enable eventlogging mysql clients and db1108's el replication after db1107 maintenance | [production] | 
            
  | 17:38 | <addshore@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs on wikidatawiki (5% of edits)  T204031 (duration: 00m 52s) | [production] | 
            
  | 17:25 | <dcausse> | restarting mjolnir services on all elastic* nodes | [production] | 
            
  | 17:19 | <dcausse@deploy1001> | Finished deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support (duration: 03m 42s) | [production] | 
            
  | 17:15 | <dcausse@deploy1001> | Started deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support | [production] | 
            
  | 16:57 | <jforrester@deploy1001> | Synchronized php-1.33.0-wmf.12/extensions/VisualEditor/modules/ve-mw/: T213922: Revert 48db45df7602 for wmf.12 (duration: 00m 52s) | [production] |