| 2018-02-09
      
      § | 
    
  | 13:33 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 01m 12s) | [production] | 
            
  | 13:33 | <demon@tin> | Finished deploy [gerrit/gerrit@9c0acf6]: updating gitiles plugin (duration: 00m 10s) | [production] | 
            
  | 13:33 | <demon@tin> | Started deploy [gerrit/gerrit@9c0acf6]: updating gitiles plugin | [production] | 
            
  | 10:51 | <marostegui> | Stop replication in sync on db1067 and db1089 - T162807 | [production] | 
            
  | 10:50 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1067 for data checksumming - T162807 (duration: 01m 11s) | [production] | 
            
  | 10:36 | <moritzm> | uploaded php-luasandbox 2.0.14~stretch2 for stretch-wikimedia to apt.wikimedia.org (this removes the php-luasandbox binary from our internal luasandbox build in favour of the php-luasandbox package maintained by legoktm from stretch-backports). As such the php-luasandbox source package we build internall now only provides the HHVM extension (and we can retire it entirely when migrating to PHP7) | [production] | 
            
  | 10:29 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully repool db1080 - T162807 (duration: 01m 11s) | [production] | 
            
  | 10:02 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1080 - T162807 (duration: 01m 12s) | [production] | 
            
  | 09:37 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1080 - T162807 (duration: 01m 11s) | [production] | 
            
  | 09:06 | <marostegui> | Fix data drifts on db1067 - T162807 | [production] | 
            
  | 08:45 | <demon@tin> | Synchronized wmf-config/: rm cleanchanges (duration: 01m 14s) | [production] | 
            
  | 08:44 | <demon@tin> | Synchronized multiversion/submodules.json: rm CleanChanges (duration: 01m 13s) | [production] | 
            
  | 07:57 | <marostegui> | Stop replication on labsdb1004 to fix replication issues | [production] | 
            
  | 07:50 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1080 - T162807 (duration: 01m 11s) | [production] | 
            
  | 07:39 | <elukey> | forced remount of /mnt/hdfs on stat1005 | [production] | 
            
  | 06:52 | <marostegui> | Fix replication on labsdb1010 - T186579 | [production] | 
            
  | 06:47 | <marostegui> | Fix data drifts, upgrade kernel, mariadb and socket path on db1080 - T162807 | [production] | 
            
  | 06:44 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1080 - T162807 (duration: 01m 12s) | [production] | 
            
  | 02:41 | <andrew@tin> | Finished deploy [horizon/deploy@60cac8e]: updating with designate dashboard (duration: 02m 42s) | [production] | 
            
  | 02:38 | <andrew@tin> | Started deploy [horizon/deploy@60cac8e]: updating with designate dashboard | [production] | 
            
  | 00:18 | <demon@tin> | rebuilt and synchronized wikiversions files: surprise, it broke. revert group1 back to wmf.20 | [production] | 
            
  | 00:16 | <demon@tin> | rebuilt and synchronized wikiversions files: group1 to wmf.20 *duck and cover* | [production] | 
            
  
    | 2018-02-08
      
      § | 
    
  | 23:49 | <ppchelko@tin> | Finished deploy [restbase/deploy@c0f0dcd]: Fix a type that prevented the mobile partial content to have an etag (duration: 15m 44s) | [production] | 
            
  | 23:33 | <ppchelko@tin> | Started deploy [restbase/deploy@c0f0dcd]: Fix a type that prevented the mobile partial content to have an etag | [production] | 
            
  | 22:37 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@75a2ebb]: Update mobileapps to e93ab95 (duration: 05m 07s) | [production] | 
            
  | 22:32 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@75a2ebb]: Update mobileapps to e93ab95 | [production] | 
            
  | 22:17 | <demon@tin> | rebuilt and synchronized wikiversions files: mw.org back to wmf.20 | [production] | 
            
  | 22:08 | <XioNoX> | rebooting cr1-eqsin | [production] | 
            
  | 21:59 | <andrew@tin> | Finished deploy [horizon/deploy@5e53829]: updating with designate dashboard -- take... six, I guess? (duration: 00m 03s) | [production] | 
            
  | 21:58 | <andrew@tin> | Started deploy [horizon/deploy@5e53829]: updating with designate dashboard -- take... six, I guess? | [production] | 
            
  | 21:53 | <ottomata> | finished upgrade of scb to librdkafka 0.11 and node-rdkafka 2 | [production] | 
            
  | 21:49 | <ppchelko@tin> | Finished deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Finally we're there (duration: 00m 49s) | [production] | 
            
  | 21:49 | <ppchelko@tin> | Started deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Finally we're there | [production] | 
            
  | 21:48 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@9adaa92]: Update node-rdkafka to 2.0+. Finally we're there (duration: 00m 35s) | [production] | 
            
  | 21:48 | <ppchelko@tin> | Started deploy [cpjobqueue/deploy@9adaa92]: Update node-rdkafka to 2.0+. Finally we're there | [production] | 
            
  | 21:48 | <otto@tin> | Finished deploy [eventstreams/deploy@7629e16]: upgrade to librdkafka 0.11 node-rdkafka 2 (duration: 00m 46s) | [production] | 
            
  | 21:47 | <otto@tin> | Started deploy [eventstreams/deploy@7629e16]: upgrade to librdkafka 0.11 node-rdkafka 2 | [production] | 
            
  | 21:40 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@9adaa92]: Update node-rdkafka to 2.0+. Canary (duration: 00m 15s) | [production] | 
            
  | 21:40 | <ppchelko@tin> | Started deploy [cpjobqueue/deploy@9adaa92]: Update node-rdkafka to 2.0+. Canary | [production] | 
            
  | 21:40 | <ppchelko@tin> | Finished deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary (duration: 00m 04s) | [production] | 
            
  | 21:40 | <ppchelko@tin> | Started deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary | [production] | 
            
  | 21:39 | <ppchelko@tin> | Finished deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary (duration: 00m 47s) | [production] | 
            
  | 21:38 | <otto@tin> | Finished deploy [eventstreams/deploy@7629e16]: upgrade to librdkafka 0.11 node-rdkafka 2 (duration: 00m 24s) | [production] | 
            
  | 21:38 | <ppchelko@tin> | Started deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary | [production] | 
            
  | 21:38 | <otto@tin> | Started deploy [eventstreams/deploy@7629e16]: upgrade to librdkafka 0.11 node-rdkafka 2 | [production] | 
            
  | 21:32 | <herron> | restarted rsyslogd services on lithium and wezen to clear rsyslog tls listener on port 6514 icinga alerts | [production] | 
            
  | 21:23 | <ppchelko@tin> | Finished deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary (duration: 00m 54s) | [production] | 
            
  | 21:23 | <otto@tin> | Finished deploy [eventstreams/deploy@7629e16]: (no justification provided) (duration: 01m 03s) | [production] | 
            
  | 21:23 | <ppchelko@tin> | Started deploy [changeprop/deploy@5fdc03a]: Update node-rdkafka to 2.0+. Canary | [production] | 
            
  | 21:22 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@9adaa92]: Update node-rdkafka to 2.0+. Canary (duration: 00m 25s) | [production] |