| 
      
        2018-11-05
      
      §
     | 
  
    
  | 21:41 | 
  <arlolra@deploy1001> | 
  Finished deploy [parsoid/deploy@96d739b]: Updating Parsoid to 8ed698b (duration: 10m 59s) | 
  [production] | 
            
  | 21:38 | 
  <thcipriani@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: [[gerrit:471246|Removed decomissioned citoid url]] T133001 (duration: 00m 53s) | 
  [production] | 
            
  | 21:30 | 
  <arlolra@deploy1001> | 
  Started deploy [parsoid/deploy@96d739b]: Updating Parsoid to 8ed698b | 
  [production] | 
            
  | 21:23 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@5b8ad3c]: Update deps, removed sections table, T207904 T206048 T207324 take 2 (duration: 09m 18s) | 
  [production] | 
            
  | 21:14 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@5b8ad3c]: Update deps, removed sections table, T207904 T206048 T207324 take 2 | 
  [production] | 
            
  | 21:10 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@5b8ad3c]: Update deps, removed sections table, T207904 T206048 T207324 (duration: 12m 15s) | 
  [production] | 
            
  | 21:09 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: Ensure all wikis on 1.33.0-wmf.2 | 
  [production] | 
            
  | 20:58 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@5b8ad3c]: Update deps, removed sections table, T207904 T206048 T207324 | 
  [production] | 
            
  | 20:38 | 
  <ppchelko@deploy1001> | 
  Finished deploy [restbase/deploy@5b8ad3c] (dev-cluster): Update deps, removed sections table (duration: 03m 40s) | 
  [production] | 
            
  | 20:35 | 
  <ppchelko@deploy1001> | 
  Started deploy [restbase/deploy@5b8ad3c] (dev-cluster): Update deps, removed sections table | 
  [production] | 
            
  | 19:53 | 
  <akosiaris> | 
  do a depool, scap deploy, scap wikiversions-compile, hhvm restart and then a pool in eqiad mediawiki servers | 
  [production] | 
            
  | 19:50 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:470868|Disable page issues A/B test (duration: 00m 53s) | 
  [production] | 
            
  | 19:44 | 
  <sbisson@deploy1001> | 
  Synchronized php-1.33.0-wmf.2/includes/block/BlockRestriction.php: SWAT: [[gerrit:471094|BlockRestriction::update() unnecessarily does a SELECT on the page table.]] (duration: 01m 00s) | 
  [production] | 
            
  | 19:19 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471116|Enable error logging for WikimediaEvents]] (duration: 00m 52s) | 
  [production] | 
            
  | 19:12 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471072|Enable GrowthExperiments logging channel]] (duration: 00m 53s) | 
  [production] | 
            
  | 18:57 | 
  <_joe_> | 
  restarting hhvm on mwdebug1002 | 
  [production] | 
            
  | 18:44 | 
  <godog> | 
  pool graphite1004 for reads - T196484 | 
  [production] | 
            
  | 18:43 | 
  <XioNoX> | 
  delete asw2-b - asw-b interface - T183585 | 
  [production] | 
            
  | 18:41 | 
  <XioNoX> | 
  remove asw-b-eqiad from LibreNMS - T183585 | 
  [production] | 
            
  | 18:37 | 
  <XioNoX> | 
  remove vrrp priority 70 on cr2-eqiad:ae2 to failback VIPs to cr2 - T183585 | 
  [production] | 
            
  | 18:26 | 
  <XioNoX> | 
  re-enable ae2 on cr2-eqiad - T183585 | 
  [production] | 
            
  | 18:21 | 
  <thcipriani> | 
  rollback mwdebug1001 group2 wikis | 
  [production] | 
            
  | 18:13 | 
  <thcipriani> | 
  testing php-1.33.0-wmf.2 on group2 wikis on mwdebug1001 | 
  [production] | 
            
  | 18:05 | 
  <XioNoX> | 
  disable ae2 on cr2-eqiad - T183585 | 
  [production] | 
            
  | 18:02 | 
  <XioNoX> | 
  set vrrp priority 70 on cr2-eqiad:ae2 to failover VIP to cr1 - T183585 | 
  [production] | 
            
  | 16:49 | 
  <XioNoX> | 
  Update LLDP config on cr3-ulsfo - T208630 | 
  [production] | 
            
  | 16:48 | 
  <vgutierrez> | 
  uploaded certcentral 0.5 to apt.wikimedia.org (stretch) - T208572 T208378 | 
  [production] | 
            
  | 16:06 | 
  <anomie@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Setting MCR to read-new on all wikis (T198308) (duration: 00m 55s) | 
  [production] | 
            
  | 13:57 | 
  <jynus_> | 
  increase consistency of db2050, dbstore2002 s3 after them catching up replication T208462 | 
  [production] | 
            
  | 12:33 | 
  <ladsgroup@deploy1001> | 
  Finished deploy [ores/deploy@096ffb3]: T208577 T181632 T208608 (duration: 22m 58s) | 
  [production] | 
            
  | 12:23 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:23 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471088|Increase wikidata dispatchers to 3]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:16 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:470985|Set wgForeignUploadTargets to [] for zhwiki (T208397)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:10 | 
  <ladsgroup@deploy1001> | 
  Started deploy [ores/deploy@096ffb3]: T208577 T181632 T208608 | 
  [production] | 
            
  | 12:05 | 
  <zfilipin@deploy1001> | 
  Synchronized static/images/project-logos/: SWAT: [[gerrit:469027|Revert "Anniversary logo for cswiki" (T207589)]] (duration: 00m 58s) | 
  [production] | 
            
  | 10:02 | 
  <godog> | 
  reformat xfs filesystems on ms-be1040 - T199198 | 
  [production] | 
            
  | 09:17 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/refinery@9d39efa]: fixing stat1004 (duration: 00m 04s) | 
  [production] | 
            
  | 09:17 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/refinery@9d39efa]: fixing stat1004 | 
  [production] | 
            
  | 09:08 | 
  <joal@deploy1001> | 
  Finished deploy [analytics/refinery@9d39efa]: regular analytics weekly deploy (duration: 05m 21s) | 
  [production] | 
            
  | 09:02 | 
  <joal@deploy1001> | 
  Started deploy [analytics/refinery@9d39efa]: regular analytics weekly deploy | 
  [production] | 
            
  
    | 
      
        2018-11-04
      
      §
     | 
  
    
  | 23:42 | 
  <jynus_> | 
  deleting the same row on all s8 broken servers | 
  [production] | 
            
  | 23:39 | 
  <jynus_> | 
  deleting one row on db1104 | 
  [production] | 
            
  | 20:38 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.33.0-wmf.2/extensions/FlaggedRevs/frontend/specialpages/reports/ProblemChanges_body.php: T176232 - Ia43626584e (duration: 01m 17s) | 
  [production] | 
            
  | 18:32 | 
  <jynus_> | 
  reduce temp. consistency level of s4, s5, and s6 codfw masters to prevent excessive lagging due to ongoing mediawiki core maintenance | 
  [production] | 
            
  | 08:42 | 
  <eileen> | 
  process-control config revision is e832b5a04a renable running job list (all jobs on again now0 | 
  [production] | 
            
  | 08:38 | 
  <eileen> | 
  process-control config revision is e16b2c1c61 renable jobs | 
  [production] | 
            
  | 02:00 | 
  <eileen> | 
  I think I got the rest of the jobs off  process-control config revision is 4422254128 | 
  [production] | 
            
  | 01:52 | 
  <eileen> | 
  process-control config revision is 6ec67b3d01 - also turn off omnirecipient repair job | 
  [production] | 
            
  | 01:40 | 
  <eileen> | 
  process-control config revision is 5b72cfe874 - reapply turn off q jobs | 
  [production] |