| 
      
        2019-02-18
      
      §
     | 
  
    
  | 09:50 | 
  <marostegui> | 
  Deploy schema change on db1105:3311 T210713 | 
  [production] | 
            
  | 09:50 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 T210713 (duration: 00m 46s) | 
  [production] | 
            
  | 09:46 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 T210713 (duration: 00m 46s) | 
  [production] | 
            
  | 09:28 | 
  <marostegui> | 
  Drop ep_* from s6 (ruwiki) - T174802 | 
  [production] | 
            
  | 09:16 | 
  <marostegui> | 
  Deploy schema change on db1099:3311 - T210713 | 
  [production] | 
            
  | 09:16 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 T210713 (duration: 00m 48s) | 
  [production] | 
            
  | 09:08 | 
  <marostegui> | 
  Deploy schema change on dbstore1003:3311 and dbstore1001:3311 - T210713 | 
  [production] | 
            
  | 08:27 | 
  <marostegui> | 
  Drop ep_* tables from s5 (srwiki) - T174802 | 
  [production] | 
            
  | 08:23 | 
  <marostegui> | 
  Deploy schema change on s1 codfw master (db2048), lag will be generated on s1 codfw - T210713 | 
  [production] | 
            
  | 07:07 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1119 after mysql upgrade (duration: 00m 46s) | 
  [production] | 
            
  | 06:53 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: repool db1119 into API service after mysql upgrade (duration: 00m 46s) | 
  [production] | 
            
  | 06:49 | 
  <marostegui> | 
  Reboot db2085 to disable debug mode on kernel T216273 | 
  [production] | 
            
  | 06:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1119 after mysql upgrade (duration: 00m 46s) | 
  [production] | 
            
  | 06:29 | 
  <marostegui> | 
  Stop MySQL on db1119 for mysql and kernel upgrade | 
  [production] | 
            
  | 06:29 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1119 for mysql upgrade (duration: 01m 01s) | 
  [production] | 
            
  | 05:55 | 
  <marostegui> | 
  Deploy schema change on s8 primary master (db1071) - T210713 | 
  [production] | 
            
  | 05:52 | 
  <marostegui> | 
  Set dbstore1002 on read only to start the migration T210478 T215589 | 
  [production] | 
            
  
    | 
      
        2019-02-15
      
      §
     | 
  
    
  | 20:40 | 
  <andrewbogott> | 
  enabled virtualization (all three settings) on cloudvirt1019 | 
  [production] | 
            
  | 19:41 | 
  <arturo> | 
  T193264 reimaging cloudvirt1019 to get mitaka/stretch | 
  [production] | 
            
  | 18:51 | 
  <arturo> | 
  T193264 icinga downtime cloudvirt1019 for 1 week | 
  [production] | 
            
  | 18:44 | 
  <bstorm_> | 
  stopped replication and then mariadb on labsdb1004 | 
  [production] | 
            
  | 16:52 | 
  <cdanis> | 
  correction, needed to increment version; adding backported rasdaemon 0.6.0-1.2+deb8u2 to jessie-wikimedia | 
  [production] | 
            
  | 16:48 | 
  <cdanis> | 
  adding backported rasdaemon 0.6.0-1.2+deb8u1 to jessie-wikimedia | 
  [production] | 
            
  | 16:29 | 
  <bblack> | 
  reprepro: uploaded gdnsd-3.0.0-1~wmf1 to stretch-wikimedia | 
  [production] | 
            
  | 15:45 | 
  <moritzm> | 
  rebooting auth1001 for kernel security update | 
  [production] | 
            
  | 14:50 | 
  <moritzm> | 
  installing unbound update from stretch point release | 
  [production] | 
            
  | 14:45 | 
  <moritzm> | 
  removed labvirt1012 from debmonitor (got renamed to cloudvirt1012) (T216190) | 
  [production] | 
            
  | 14:06 | 
  <moritzm> | 
  rebooting mwlog1001 for kernel security update | 
  [production] | 
            
  | 13:54 | 
  <moritzm> | 
  rebooting mwlog2001 for kernel security update | 
  [production] | 
            
  | 13:46 | 
  <jbond42> | 
  install tar security updates | 
  [production] | 
            
  | 13:19 | 
  <moritzm> | 
  rolling reboot of mwdebug servers in eqiad to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 13:12 | 
  <gtirloni> | 
  reboot cloudvirt1020 | 
  [production] | 
            
  | 13:11 | 
  <arturo> | 
  T216239 labvirt1019 has been drained of any workload | 
  [production] | 
            
  | 13:06 | 
  <moritzm> | 
  installing NSS security updates | 
  [production] | 
            
  | 12:42 | 
  <moritzm> | 
  installing squid3 security updates | 
  [production] | 
            
  | 12:30 | 
  <jynus> | 
  stop db2089 mysql instances for reboot testing T216240 | 
  [production] | 
            
  | 12:30 | 
  <arturo> | 
  T216239 schedule 1week of icinga downtime for labvirt1019 | 
  [production] | 
            
  | 10:48 | 
  <akosiaris> | 
  upgrade docker on contint2001 to 18.06.2 T216236 | 
  [production] | 
            
  | 10:42 | 
  <akosiaris> | 
  upgrade docker on contint1001 to 18.06.2 T216236 | 
  [production] | 
            
  | 10:35 | 
  <gtirloni> | 
  reboot cloudvirt1019 | 
  [production] | 
            
  | 09:44 | 
  <gehel> | 
  repool maps100[12] | 
  [production] | 
            
  | 09:33 | 
  <moritzm> | 
  imported php-defaults debs to thirdparty/php72 | 
  [production] | 
            
  | 08:42 | 
  <akosiaris> | 
  restart gerrit to pick up https://gerrit.wikimedia.org/r/490640 T177868 | 
  [production] | 
            
  | 08:40 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1109 (duration: 00m 46s) | 
  [production] |