| 
      
        2019-02-26
      
      §
     | 
  
    
  | 10:20 | 
  <marostegui> | 
  Deploy schema change on db1074, this will generate lag on labsdb for s2 - T86342 | 
  [production] | 
            
  | 10:20 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1074 (duration: 00m 46s) | 
  [production] | 
            
  | 10:12 | 
  <godog> | 
  bounce gerrit on gerrit2001 and cobalt after https://gerrit.wikimedia.org/r/c/operations/puppet/+/492633 - T213899 | 
  [production] | 
            
  | 09:10 | 
  <jynus> | 
  temporarilly stop dbstore1001:s1replication to perform new backup system test | 
  [production] | 
            
  | 09:04 | 
  <jijiki> | 
  Pooling thumbor1003 | 
  [production] | 
            
  | 08:48 | 
  <jiji@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 49s) | 
  [production] | 
            
  | 08:47 | 
  <jiji@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: (no justification provided) | 
  [production] | 
            
  | 08:45 | 
  <moritzm> | 
  installing elfutils security updates | 
  [production] | 
            
  | 08:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1080 (duration: 00m 45s) | 
  [production] | 
            
  | 08:31 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1080 (duration: 00m 46s) | 
  [production] | 
            
  | 08:08 | 
  <jijiki> | 
  Depool and reimage thumbor2004 - T214597 | 
  [production] | 
            
  | 08:07 | 
  <jijiki> | 
  Pooling thumbor2003 - T214597 | 
  [production] | 
            
  | 08:04 | 
  <jiji@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 30s) | 
  [production] | 
            
  | 08:04 | 
  <jiji@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: (no justification provided) | 
  [production] | 
            
  | 07:54 | 
  <elukey> | 
  removed /rmstore-analytics-test-hadoop from zookeeper main-eqiad - T216952 | 
  [production] | 
            
  | 07:45 | 
  <_joe_> | 
  publishing golang:1.11.5-1 docker image | 
  [production] | 
            
  | 07:44 | 
  <moritzm> | 
  installing tiff security updates | 
  [production] | 
            
  | 07:02 | 
  <marostegui> | 
  Deploy schema change on s2 codfw (this will generate lag on s2 codfw) T86342 | 
  [production] | 
            
  | 06:53 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 (duration: 00m 45s) | 
  [production] | 
            
  | 06:50 | 
  <jijiki> | 
  Depool and reimage thumbor1003 and thumbor2003 - T214597 | 
  [production] | 
            
  | 06:46 | 
  <jiji@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 07s) | 
  [production] | 
            
  | 06:46 | 
  <jiji@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: (no justification provided) | 
  [production] | 
            
  | 06:45 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1097:3314 (duration: 00m 45s) | 
  [production] | 
            
  | 06:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1088 (duration: 00m 45s) | 
  [production] | 
            
  | 06:41 | 
  <jijiki> | 
  Pooling tthumbor1002 | 
  [production] | 
            
  | 06:35 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1083 (duration: 00m 46s) | 
  [production] | 
            
  | 06:34 | 
  <tgr> | 
  T215107 running mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=commonswiki --logwiki=metawiki --ignorestatus 'The_Photographer' 'Wilfredor' | 
  [production] | 
            
  | 06:28 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1088 T86342 (duration: 00m 48s) | 
  [production] | 
            
  | 06:17 | 
  <marostegui> | 
  Change abuse_filter_log indexes on db1083 - T187295 | 
  [production] | 
            
  | 06:17 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1083 T187295 (duration: 00m 51s) | 
  [production] | 
            
  | 06:10 | 
  <tgr> | 
  T215107 running mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=commonswiki --logwiki=metawiki 'The_Photographer' 'Wilfredor' | 
  [production] | 
            
  | 04:25 | 
  <kart_> | 
  Finished manual run of unpublished ContentTranslation draft purge script (T216983) | 
  [production] | 
            
  | 04:24 | 
  <eileen-sorting-k> | 
  civicrm revision changed from d1fc603677 to 224bf15206, config revision is d1826e371b | 
  [production] | 
            
  | 03:06 | 
  <kart_> | 
  Manual run of unpublished ContentTranslation draft purge script (T216983) | 
  [production] | 
            
  
    | 
      
        2019-02-25
      
      §
     | 
  
    
  | 23:50 | 
  <XioNoX> | 
  Re-enabled BGP to Zayo on cr2-codfw - T215193 | 
  [production] | 
            
  | 23:15 | 
  <herron> | 
  service restarts to make logstash101[012] master eligible are taking longer than expected, leaving elasticsearch on logstash100[456] enabled overnight T213898 | 
  [production] | 
            
  | 22:56 | 
  <mholloway-shell@deploy1001> | 
  Started restart [mobileapps/deploy@1ac3c38]: Restarting mobileapps on scb2003 | 
  [production] | 
            
  | 21:54 | 
  <eileen> | 
  update  process-control config revision is d1826e371b | 
  [production] | 
            
  | 21:14 | 
  <arlolra@deploy1001> | 
  Finished deploy [parsoid/deploy@cb62482]: Updating Parsoid to a8fe45e (duration: 04m 19s) | 
  [production] | 
            
  | 21:11 | 
  <herron> | 
  turning down elasticsearch service on logstash100[456] (data has been migrated to logstash101[012]) T213898 | 
  [production] | 
            
  | 21:10 | 
  <arlolra@deploy1001> | 
  Started deploy [parsoid/deploy@cb62482]: Updating Parsoid to a8fe45e | 
  [production] | 
            
  | 21:09 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@1ac3c38]: Update mobileapps to c3871cc (duration: 03m 48s) | 
  [production] | 
            
  | 21:05 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@1ac3c38]: Update mobileapps to c3871cc | 
  [production] | 
            
  | 19:58 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: Use EventBus multi endpoint configuration for eventbus configs (duration: 00m 45s) | 
  [production] | 
            
  | 19:53 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Swat! (duration: 00m 45s) | 
  [production] | 
            
  | 19:46 | 
  <reedy@deploy1001> | 
  Synchronized dblists/mobilemainpagelegacy.dblist: Disable MFSpecialCaseMainPage for srwiki and enwikivoyage (duration: 00m 46s) | 
  [production] | 
            
  | 19:41 | 
  <vgutierrez> | 
  restarting pybal on lvs5003 - T213121 | 
  [production] | 
            
  | 19:34 | 
  <reedy@deploy1001> | 
  Synchronized php-1.33.0-wmf.18/extensions/Renameuser: T215107 (duration: 00m 46s) | 
  [production] | 
            
  | 19:31 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: labs! (duration: 00m 46s) | 
  [production] | 
            
  | 18:44 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.33.0-wmf.18/includes/libs/objectcache/WANObjectCache.php: 79a1593cae48 / T203786 (duration: 00m 48s) | 
  [production] |