| 2018-12-19
      
      § | 
    
  | 12:46 | <marostegui> | Drop image_comment_temp on s3 - T209591 | [production] | 
            
  | 12:24 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:23 | <zfilipin@deploy1001> | Synchronized php-1.33.0-wmf.9/extensions/Kartographer/: SWAT: [[gerrit:480687|Fix using at-ease functions in namespaced class (T212218)]] (duration: 00m 53s) | [production] | 
            
  | 12:06 | <moritzm> | rearmed keyholder after netmon2001 reboot | [production] | 
            
  | 11:58 | <moritzm> | rebooting netmon2001 for kernel security update | [production] | 
            
  | 11:50 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: repool db1091 after schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 11:49 | <moritzm> | rebooting matomo1001 to pick up SSBD-enabled qemu | [production] | 
            
  | 11:46 | <banyek> | repooling db1091 after schema change - T85757 | [production] | 
            
  | 11:41 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1091 for schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 11:37 | <banyek> | depooling db1091 for schema change - T85757 | [production] | 
            
  | 11:34 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: repool db1084 after schema change - T85757 (duration: 00m 51s) | [production] | 
            
  | 11:30 | <banyek> | repooling db1084 after schema change - T85757 | [production] | 
            
  | 11:29 | <moritzm> | upgrading nodejs on restbase2013-2018 | [production] | 
            
  | 11:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Repool db2050 after recloning db2057 T212275 (duration: 00m 52s) | [production] | 
            
  | 11:25 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1084 for schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 11:15 | <banyek> | depooling db1084 for schema change - T85757 | [production] | 
            
  | 11:13 | <marostegui> | Stop MySQL and power off db2057 for firmware upgrade - T212277 | [production] | 
            
  | 11:11 | <marostegui> | Drop image_comment_temp from s5 - T209591 | [production] | 
            
  | 10:37 | <moritzm> | draining restbase2012 for eventual reboot for kernel security update | [production] | 
            
  | 10:28 | <banyek> | executing schema change in db2051 (s4 codfw master) with replication enabled - T85757 | [production] | 
            
  | 10:25 | <banyek> | stopping replication on db2073 as executing schema change on codfw master - T85757 | [production] | 
            
  | 10:14 | <moritzm> | draining restbase2011 for eventual reboot for kernel security update | [production] | 
            
  | 09:53 | <banyek> | dropping tables 'flagged%' on db1066 ptwiki with replication enabled - T211544 | [production] | 
            
  | 09:41 | <moritzm> | draining restbase2010 for eventual reboot for kernel security update | [production] | 
            
  | 09:37 | <banyek> | dropping tables with 'T211544' prefix on db1122 - T211544 | [production] | 
            
  | 09:24 | <moritzm> | draining restbase2009 for eventual reboot for kernel security update | [production] | 
            
  | 09:14 | <moritzm> | rebooting restbase2008 for kernel security update | [production] | 
            
  | 08:53 | <elukey> | roll restart of cassandra on aqs1005-1009 for opendjdk upgrades | [production] | 
            
  | 08:50 | <marostegui> | Drop image_comment_temp from s7 - T209591 | [production] | 
            
  | 08:46 | <marostegui> | Drop image_comment_temp from s6 - T209591 | [production] | 
            
  | 08:43 | <akosiaris> | rebalance row_A ganeti01.svc.codfw.wmnet nodegroup after recabling T210447 | [production] | 
            
  | 08:40 | <marostegui> | Drop image_comment_temp from s8 - T209591 | [production] | 
            
  | 08:37 | <moritzm> | draining restbase2007 for eventual reboot for kernel security update | [production] | 
            
  | 08:28 | <marostegui> | Drop image_comment_temp from s2 - T209591 | [production] | 
            
  | 08:27 | <marostegui> | Drop image_comment_temp from s1 - T209591 | [production] | 
            
  | 08:16 | <godog> | swift eqiad-prod: more weight for ms-be10[44-50].eqiad.wmnet - T209618 | [production] | 
            
  | 07:37 | <marostegui> | Drop nodepooldb on m5 master - T212230 | [production] | 
            
  | 07:22 | <marostegui> | Stop MySQL on db2050 to clone db2057 - T212275 | [production] | 
            
  | 07:15 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Depool db2050 to clone db2057 T212275 (duration: 00m 52s) | [production] | 
            
  | 06:59 | <marostegui> | Enable GTID on s8 codfw master (db2045) - T211973 | [production] | 
            
  | 06:58 | <marostegui> | Enable GTID on s1 codfw master (db2048) - T211973 | [production] | 
            
  | 06:44 | <marostegui> | Remove nodepool@10.64.16.155 user from m5 master - T212230 | [production] | 
            
  | 06:34 | <marostegui> | Hard reboot db2057 - T212275 | [production] | 
            
  | 06:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Depool db2057 - storage crashed T212275 (duration: 01m 08s) | [production] | 
            
  | 01:27 | <tstarling@deploy1001> | Synchronized php-1.33.0-wmf.8/extensions/AbuseFilter/maintenance/normalizeThrottleParameters.php: g 480681 make maintenance script dry run more useful (duration: 00m 52s) | [production] | 
            
  | 01:25 | <tstarling@deploy1001> | Synchronized php-1.33.0-wmf.8/extensions/AbuseFilter/includes/AbuseFilter.php: g 480680 fix exception in maintenance script (duration: 00m 54s) | [production] | 
            
  | 00:11 | <mutante> | contint1001 - rsyncing /srv/org/wikimedia/docs to rsync://docs1001.eqiad.wmnet/docs T211974 | [production] |