| 
      
        2019-03-29
      
      §
     | 
  
    
  | 12:52 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@670ddb8]: Gerrit (back) to version 2.15.11 on cobalt -- restart of gerrit incoming (duration: 00m 11s) | 
  [production] | 
            
  | 12:52 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@670ddb8]: Gerrit (back) to version 2.15.11 on cobalt -- restart of gerrit incoming | 
  [production] | 
            
  | 12:51 | 
  <moritzm> | 
  removing php 7.0 packages from snapshot1008, dumps are only using 7.2 (T218193) | 
  [production] | 
            
  | 12:50 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@670ddb8]: Gerrit (back) to version 2.15.11 (gerrit2001 only) (duration: 00m 10s) | 
  [production] | 
            
  | 12:50 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@670ddb8]: Gerrit (back) to version 2.15.11 (gerrit2001 only) | 
  [production] | 
            
  | 12:46 | 
  <moritzm> | 
  upgrading snapshot1008 to component/php72 (T218193) | 
  [production] | 
            
  | 12:46 | 
  <moritzm> | 
  upgrading snapshot1005-1007/1009 to component/php72 (T218193) | 
  [production] | 
            
  | 12:23 | 
  <ema> | 
  rolling ATS restarts to apply https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/500011/ T213263 | 
  [production] | 
            
  | 11:45 | 
  <mutante> | 
  cobalt - systemctl restart gerrit | 
  [production] | 
            
  | 10:36 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe | 
  [production] | 
            
  | 10:36 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx | 
  [production] | 
            
  | 10:35 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe | 
  [production] | 
            
  | 10:35 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx | 
  [production] | 
            
  | 09:37 | 
  <mutante> | 
  restarting zuul on contint1001 | 
  [production] | 
            
  | 09:05 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2005.codfw.wmnet,service=varnish-fe | 
  [production] | 
            
  | 09:05 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2005.codfw.wmnet,service=nginx | 
  [production] | 
            
  | 09:05 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe | 
  [production] | 
            
  | 09:05 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx | 
  [production] | 
            
  | 08:36 | 
  <godog> | 
  depool ulsfo as precaution -- link repair in progress | 
  [production] | 
            
  | 08:30 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1110 (duration: 00m 50s) | 
  [production] | 
            
  | 07:58 | 
  <gilles@deploy1001> | 
  Synchronized php-1.33.0-wmf.23/includes/media/MediaTransformOutput.php: T216499 Only apply high priority half the time (duration: 00m 50s) | 
  [production] | 
            
  | 07:54 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1110 (duration: 00m 51s) | 
  [production] | 
            
  | 07:28 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1110 (duration: 00m 50s) | 
  [production] | 
            
  | 07:19 | 
  <vgutierrez> | 
  reenabling puppet in acme-chief clients after verifying NOOP in netmon2001 | 
  [production] | 
            
  | 07:17 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1110 (duration: 01m 06s) | 
  [production] | 
            
  | 07:11 | 
  <vgutierrez> | 
  disabling puppet in acme-chief clients to merge I437b91c177d97b863a4356ca30b388561f5b9d3c safely | 
  [production] | 
            
  | 07:06 | 
  <marostegui> | 
  Upgrade db1110 | 
  [production] | 
            
  | 07:06 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1110 (duration: 00m 49s) | 
  [production] | 
            
  | 07:01 | 
  <gilles@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T216598 T216594 Element Timing for Images and Layout Stability on ruwiki (duration: 00m 51s) | 
  [production] | 
            
  | 06:56 | 
  <marostegui> | 
  Remove tools section from tendril by doing: update shards set display='0' where name='tools'; T216749 | 
  [production] | 
            
  | 06:44 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool pc1009 (duration: 00m 49s) | 
  [production] | 
            
  | 06:41 | 
  <marostegui> | 
  Upgrade pc1009 | 
  [production] | 
            
  | 06:32 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool pc1009 (duration: 00m 50s) | 
  [production] | 
            
  | 06:19 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1075 (duration: 00m 50s) | 
  [production] | 
            
  | 05:49 | 
  <marostegui> | 
  Disable notifications on labsdb1004 and labsdb1005 - T216749 | 
  [production] | 
            
  | 05:47 | 
  <marostegui> | 
  Remove labsdb1004 and labsdb1005 from tendril - T216749 | 
  [production] | 
            
  | 05:46 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1075 (duration: 00m 52s) | 
  [production] | 
            
  | 00:18 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.33.0-wmf.23/includes/api/ApiStashEdit.php: I35213d83a0 (duration: 00m 49s) | 
  [production] | 
            
  | 00:16 | 
  <krinkle@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: I8887ce013a8 (duration: 00m 51s) | 
  [production] | 
            
  | 00:00 | 
  <krinkle@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: I24a5469dbfd0 / T216206 for testwikidatawiki (duration: 00m 50s) | 
  [production] | 
            
  
    | 
      
        2019-03-28
      
      §
     | 
  
    
  | 23:54 | 
  <krinkle@deploy1001> | 
  Synchronized wmf-config/Wikibase.php: Ib9d61762be763c (duration: 00m 50s) | 
  [production] | 
            
  | 23:53 | 
  <krinkle@deploy1001> | 
  Synchronized wmf-config/WikibaseSearchSettings.php: Ib9d61762be763c (duration: 00m 51s) | 
  [production] | 
            
  | 23:14 | 
  <bstorm_> | 
  completed setting up clouddb1003 as the replica of labsdb1006 (osm) | 
  [production] | 
            
  | 22:13 | 
  <bd808@deploy1001> | 
  Finished deploy [striker/deploy@2f62c43]: Fixes for error pages and repo creation (T176325) (duration: 00m 59s) | 
  [production] | 
            
  | 22:12 | 
  <bd808@deploy1001> | 
  Started deploy [striker/deploy@2f62c43]: Fixes for error pages and repo creation (T176325) | 
  [production] | 
            
  | 22:11 | 
  <XioNoX> | 
  add AS specific policy-statements to cr1-eqsin v6 transits - T211930 | 
  [production] | 
            
  | 21:51 | 
  <thcipriani> | 
  restarting gerrit | 
  [production] | 
            
  | 21:18 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [Wikimania] Enable VisualEditor in the 2019 namespace T218645 (duration: 00m 50s) | 
  [production] | 
            
  | 21:16 | 
  <XioNoX> | 
  add AS specific policy-statements to cr2-eqsin v6 transits - T211930 | 
  [production] | 
            
  | 21:13 | 
  <jforrester@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [Wikitech] Enable VisualEditor in extra namespaces (duration: 00m 50s) | 
  [production] |