| 2018-11-26
      
      § | 
    
  | 17:54 | <bblack@neodymium> | conftool action : set/pooled=yes; selector: name=cp5001.eqsin.wmnet | [production] | 
            
  | 17:53 | <bblack> | re-pooling cp5001 - T199675 | [production] | 
            
  | 17:53 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1122 (duration: 00m 46s) | [production] | 
            
  | 17:44 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) | [production] | 
            
  | 17:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) | [production] | 
            
  | 17:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 45s) | [production] | 
            
  | 17:22 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 17:22 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 17:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 and db1122 (duration: 00m 46s) | [production] | 
            
  | 16:01 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 to clone db1122 (duration: 00m 46s) | [production] | 
            
  | 16:00 | <marostegui> | Stop MySQL on db1090:3312 to clone db1122 | [production] | 
            
  | 15:57 | <marostegui> | Stop MySQL on db1122 - it will be recloned | [production] | 
            
  | 15:50 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 (duration: 01m 24s) | [production] | 
            
  | 15:48 | <ppchelko@deploy1001> | Started deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 | [production] | 
            
  | 15:32 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1122 - actor table missing (duration: 00m 46s) | [production] | 
            
  | 15:27 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 (duration: 01m 21s) | [production] | 
            
  | 15:26 | <ppchelko@deploy1001> | Started deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 | [production] | 
            
  | 15:24 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on group 1 (T188327) (duration: 00m 46s) | [production] | 
            
  | 13:47 | <moritzm> | rebooting releases1001 | [production] | 
            
  | 13:36 | <moritzm> | rebooting releases2001 | [production] | 
            
  | 13:33 | <moritzm> | rebooting netmon1003 | [production] | 
            
  | 12:04 | <_joe_> | uploaded php-excimer for component thirdparty/php72 to stretch-wikimedia T205059 | [production] | 
            
  | 12:00 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back (duration: 04m 01s) | [production] | 
            
  | 11:56 | <kartik@deploy1001> | Started deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back | [production] | 
            
  | 11:41 | <arturo> | icinga downtime cloudcontrol1004 for some systemd slice tests | [production] | 
            
  | 11:01 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 11:00 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 47s) | [production] | 
            
  | 10:32 | <moritzm> | rebooting boron | [production] | 
            
  | 09:58 | <banyek> | performing schema change on s6 master - db1061 for frwiki (T85757) | [production] | 
            
  | 09:51 | <banyek> | performing schema change on s6 master - db1061 for ruwiki (T85757) | [production] | 
            
  | 09:44 | <banyek> | performing schema change on s6 master - db1061 for jawiki (T85757) | [production] | 
            
  | 08:35 | <moritzm> | removed labvirt1015 from debmonitor DB (got renamed to cloudvirt1015) | [production] | 
            
  | 08:22 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 - T202167 (duration: 00m 46s) | [production] | 
            
  | 08:16 | <marostegui> | Deploy schema change on db1096:3316 - T202167 | [production] | 
            
  | 08:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 - T202167 (duration: 00m 47s) | [production] | 
            
  | 08:10 | <moritzm> | installing pixman security updates | [production] | 
            
  | 07:36 | <elukey> | restart memcached on mc1021 (cache wipe) to add -R 200 - T208844 | [production] | 
            
  | 07:10 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1088 - T86338 (duration: 00m 46s) | [production] | 
            
  | 07:00 | <marostegui> | Deploy schema change on db1088 - T86338 | [production] | 
            
  | 06:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1088 - T86338 (duration: 00m 46s) | [production] | 
            
  | 06:46 | <marostegui> | Deploy schema change on db2067 - T86338 | [production] | 
            
  | 06:36 | <marostegui> | Deploy schema change on s3 master (db1075) - T86339 | [production] | 
            
  | 06:28 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1077 - T86339 (duration: 00m 46s) | [production] | 
            
  | 06:22 | <marostegui> | Reload haproxy on dbproxy1005 | [production] | 
            
  | 06:21 | <marostegui> | Deploy schema change on db1077 (s3 sanitarium master) with replication - T86339 | [production] | 
            
  | 06:21 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1077 - T86339 (duration: 00m 50s) | [production] | 
            
  | 06:02 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 (duration: 04m 21s) | [production] | 
            
  | 05:58 | <kartik@deploy1001> | Started deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 | [production] |