| 2019-03-05
      
      ยง | 
    
  | 11:45 | <_joe_> | installing new scap version in codfw | [production] | 
            
  | 11:44 | <oblivian@deploy1001> | Synchronized README: Test deploy for new scap version (duration: 00m 48s) | [production] | 
            
  | 11:43 | <_joe_> | installing new swat version on deployment servers, T217611 | [production] | 
            
  | 11:22 | <_joe_> | uploading new scap packages , T217611 | [production] | 
            
  | 10:58 | <ema> | lvs4007/lvs5003: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 | [production] | 
            
  | 10:57 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 47s) | [production] | 
            
  | 10:55 | <gilles@deploy1001> | Synchronized php-1.33.0-wmf.19/extensions/NavigationTiming/NavigationTiming.config.php: T187299 Fix wiki oversampling config validation (duration: 00m 48s) | [production] | 
            
  | 10:37 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 48s) | [production] | 
            
  | 10:27 | <jiji@cumin1001> | conftool action : set/weight=4; selector: dc=eqiad,service=citoid,cluster=scb,name=kubernetes.* | [production] | 
            
  | 10:24 | <jijiki> | Rump up citoid traffic from k8s to 25% - T213194 | [production] | 
            
  | 10:18 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 47s) | [production] | 
            
  | 10:10 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T187299 Oversample navtiming on ruwiki and eswiki (duration: 00m 47s) | [production] | 
            
  | 10:07 | <gilles@deploy1001> | Synchronized php-1.33.0-wmf.19/extensions/NavigationTiming: T187299 Backport wiki oversampling config syntax change (duration: 00m 48s) | [production] | 
            
  | 10:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3312 and db1103:3314 after mysql upgrade (duration: 00m 50s) | [production] | 
            
  | 09:56 | <ema> | lvs200[456]: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 | [production] | 
            
  | 09:31 | <marostegui> | Stop MySQL on db1103:3312 and db1103:3314 for MySQL upgrade | [production] | 
            
  | 09:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 and db1103:3314 for mysql upgrade (duration: 00m 47s) | [production] | 
            
  | 09:26 | <ema> | lvs100[456]: reboot for L1TF kernel/microcode updates T203011 | [production] | 
            
  | 09:23 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1081 (duration: 00m 47s) | [production] | 
            
  | 09:16 | <godog> | kibana refresh field list | [production] | 
            
  | 08:58 | <mutante> | restarting gerrit to pickup change 493963 - disable jgit gc | [production] | 
            
  | 08:47 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 47s) | [production] | 
            
  | 08:43 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1084 (duration: 00m 48s) | [production] | 
            
  | 08:33 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1084 in API (duration: 00m 48s) | [production] | 
            
  | 08:32 | <marostegui> | Optimize echo_event table on x1 codfw master (db2034) this will generate lag on x1 codfw - T217591 | [production] | 
            
  | 08:24 | <akosiaris> | T213194 bump percentage of citoid requests reaching eqiad kubernetes cluster to 9% | [production] | 
            
  | 08:23 | <jiji@cumin1001> | conftool action : set/pooled=yes; selector: dc=eqiad,service=citoid,cluster=scb,name=kubernetes100.* | [production] | 
            
  | 08:14 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1084 (duration: 00m 49s) | [production] | 
            
  | 07:47 | <marostegui> | Upgrade MySQL on db1084 | [production] | 
            
  | 07:18 | <marostegui> | Stop MySQL on db1095 (backups host) to upgrade MySQL | [production] | 
            
  | 07:18 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 47s) | [production] | 
            
  | 07:08 | <marostegui> | Start transferring data from labsdb1011 to labsdb1012 - T215231 | [production] | 
            
  | 06:56 | <marostegui> | Reboot labsdb1012 | [production] | 
            
  | 06:55 | <marostegui> | Defragment echo_event tables on dbstore1005:3320 T217591 | [production] | 
            
  | 06:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1091 (duration: 00m 48s) | [production] | 
            
  | 06:43 | <marostegui> | Stop MySQL on db2035 (s2 codfw master) to upgrade MySQL | [production] | 
            
  | 06:41 | <kart_> | Finished manual run of unpublished ContentTranslation draft purge script (T217310) | [production] | 
            
  | 06:18 | <marostegui> | Stop MySQL on dbstore2001 to upgrade MySQL | [production] | 
            
  | 06:17 | <marostegui> | Reload haproxy on dbproxy1010 to depool labsdb1011 | [production] | 
            
  | 06:10 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 51s) | [production] | 
            
  | 03:05 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Handle TitleBlacklist errors correctly (T217382) (duration: 00m 49s) | [production] | 
            
  | 03:03 | <kart_> | Started manual run of unpublished ContentTranslation draft purge script (T217310) | [production] | 
            
  | 02:59 | <ejegg> | updated payments-wiki from ca7c280f3e to 4f2935ad17 | [production] | 
            
  | 02:27 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Revert hot fix (duration: 00m 46s) | [production] | 
            
  | 02:21 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Hot fix for T217615 (duration: 00m 47s) | [production] | 
            
  | 02:05 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) | [production] | 
            
  | 01:32 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) | [production] | 
            
  | 01:21 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) | [production] | 
            
  | 01:18 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 47s) | [production] | 
            
  | 01:15 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.19/includes/api/ApiBase.php: Logging live patch to debug T217615 (duration: 00m 49s) | [production] |