| 2018-12-10
      
      § | 
    
  | 10:42 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:478633| Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 10:41 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:478633| Bumping portals to master (T128546)]] (duration: 00m 52s) | [production] | 
            
  | 10:38 | <marostegui> | Deploy schema change on db1116:3318 T86338 T202167 | [production] | 
            
  | 10:36 | <marostegui> | Deploy schema change on dbstore1002:s8 T86338 T202167 | [production] | 
            
  | 10:35 | <marostegui> | Repool labsdb1011 T86338 | [production] | 
            
  | 09:07 | <marostegui> | Deploy schema change on s8 codfw master with replication (db2045) - lag will be generated on codfw - T202167 T86338 | [production] | 
            
  | 09:01 | <marostegui> | Depool labsdb1011 - T86338 | [production] | 
            
  | 08:58 | <moritzm> | installing chromium security updates on proton* | [production] | 
            
  | 08:57 | <marostegui> | Repool labsdb1010 - T86338 | [production] | 
            
  | 08:39 | <elukey> | roll restart of aqs on aqs100* to pick up new Druid backend settings | [production] | 
            
  | 08:36 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1121 T86338 T202167 (duration: 00m 51s) | [production] | 
            
  | 08:23 | <godog> | final round of weight addition to new ms-be codfw hosts - T209395 | [production] | 
            
  | 07:18 | <_joe_> | reenabling puppet given my changes were useless | [production] | 
            
  | 06:52 | <_joe_> | running puppet on the puppetmasters in codfw, twice, then restarting apache to ensure cleanup of any cache | [production] | 
            
  | 06:50 | <_joe_> | disabled puppet across the fleet for merge of hiera change | [production] | 
            
  | 06:47 | <marostegui> | Stop slave on s4 on labsdb1011 | [production] | 
            
  | 06:25 | <marostegui> | Deploy schema change on db1121 with replication (this will generate lag on labs) - T86338 T202167 | [production] | 
            
  | 06:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1121 T86338 T202167 (duration: 00m 49s) | [production] | 
            
  | 06:23 | <marostegui> | Reload haproxy on dbproxy1010 to depool labsdb1010 - T86338 | [production] | 
            
  | 02:53 | <urandom> | decommissioning cassandra-b, restbase2004 -- T210843 | [production] | 
            
  | 00:55 | <krinkle@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Ic07ff9acfbe17 - T211529, T205546 (duration: 00m 47s) | [production] | 
            
  
    | 2018-12-07
      
      § | 
    
  | 23:54 | <ejegg> | updated payments-wiki from b99cd0816e to b8acb95a2a | [production] | 
            
  | 23:41 | <urandom> | decommissioning cassandra-b, restbase2002 -- T210843 | [production] | 
            
  | 22:43 | <ejegg> | re-enabled Thank You mail sender | [production] | 
            
  | 22:31 | <ejegg> | updated fundraising CiviCRM from 3e5d74f17e to 8e18485697 | [production] | 
            
  | 22:29 | <ejegg> | Turned off Thank You mailing job for letter update | [production] | 
            
  | 17:47 | <herron> | rebooting logstash1006 for security updates | [production] | 
            
  | 17:17 | <bstorm_> | T207377 rebooted labstore1007 for kernel upgrades | [production] | 
            
  | 17:15 | <_joe_> | uploading php-tideways (rebuilt with php 7.2 support) to stretch-wikimedia thirdparty/php72 T206152 | [production] | 
            
  | 15:36 | <moritzm> | rebooting sarin/neodymium | [production] | 
            
  | 14:52 | <urandom> | decommissioning cassandra-a, restbase2002 -- T210843 | [production] | 
            
  | 14:21 | <godog> | more weight to new ms-be codfw hosts - T209395 | [production] | 
            
  | 13:37 | <moritzm> | rolling reboot of scb in codfw (along with nodejs update) | [production] | 
            
  | 12:18 | <moritzm> | installing nodejs security updates on stat/notebook | [production] | 
            
  | 12:05 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@44e0955]: Fix: Encode recommendation api title (duration: 21m 11s) | [production] | 
            
  | 11:43 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@44e0955]: Fix: Encode recommendation api title | [production] | 
            
  | 11:42 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title (duration: 00m 21s) | [production] | 
            
  | 11:42 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title | [production] | 
            
  | 11:41 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title (duration: 18m 58s) | [production] | 
            
  | 11:22 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title | [production] | 
            
  | 11:20 | <moritzm> | rolling upgrade of nginx on swift frontends | [production] | 
            
  | 11:19 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@31c44e8]: Fix: Encode recommendation api title (duration: 03m 49s) | [production] |