| 
      
        2018-11-19
      
      §
     | 
  
    
  | 15:08 | 
  <anomie@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on group 0 (T188327) (duration: 00m 47s) | 
  [production] | 
            
  | 14:02 | 
  <joal@deploy1001> | 
  Finished deploy [analytics/aqs/deploy@7cde8c8]: Update unique-devices schema adding 2 fields (duration: 20m 57s) | 
  [production] | 
            
  | 13:55 | 
  <gtirloni> | 
  T207377 reboot cloudcontrol1004 | 
  [production] | 
            
  | 13:43 | 
  <moritzm> | 
  installing chromium security update on proton* (tested new upstream release in deployment-prep) | 
  [production] | 
            
  | 13:41 | 
  <joal@deploy1001> | 
  Started deploy [analytics/aqs/deploy@7cde8c8]: Update unique-devices schema adding 2 fields | 
  [production] | 
            
  | 13:39 | 
  <fdans@deploy1001> | 
  Finished deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques (duration: 06m 18s) | 
  [production] | 
            
  | 13:39 | 
  <akosiaris> | 
  cumin -b1 -s 300 'ores2*' 'enable-puppet "merge of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/" ; puppet agent -t ; service uwsgi-ores restart ; service celery-ores-worker restart' | 
  [production] | 
            
  | 13:36 | 
  <akosiaris> | 
  disable puppet on ores1* and ores2* for slow deployment of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/ | 
  [production] | 
            
  | 13:33 | 
  <fdans@deploy1001> | 
  Started deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques | 
  [production] | 
            
  | 13:21 | 
  <gtirloni> | 
  T207377 icinga downtime and reboot of labcontrol1001 and labservices1001 | 
  [production] | 
            
  | 13:08 | 
  <arturo> | 
  T207377 icinga downtime and reboot of cloudcontrol1003 and cloudservices1003 | 
  [production] | 
            
  | 13:06 | 
  <raynor> | 
  EU SWAT finished | 
  [production] | 
            
  | 13:03 | 
  <pmiazga@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:474679]|In SecurePoll use gpg1 to avoid gpg-agent autostart (T209802)]] (duration: 00m 48s) | 
  [production] | 
            
  | 12:50 | 
  <raynor> | 
  EU SWAT reopened | 
  [production] | 
            
  | 12:40 | 
  <raynor> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:38 | 
  <pmiazga@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472918]|Enable autopatrol, patrol, rollback rights and RCPatrol on srwiktionary (T209252)]] (duration: 00m 46s) | 
  [production] | 
            
  | 12:21 | 
  <pmiazga@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:474124]|Remove wgMetaNamespaceTalk for shnwiki (T206777)]] (duration: 00m 46s) | 
  [production] | 
            
  | 12:10 | 
  <pmiazga@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:473225]|Enable Schema.org page split test at 50% sampling (T208755)]] (duration: 00m 46s) | 
  [production] | 
            
  | 11:33 | 
  <gtirloni> | 
  labsdb1011 upgraded packages on labsdb1011 (pre-work T209517) | 
  [production] | 
            
  | 11:20 | 
  <elukey> | 
  restart memcached on mc1020 to apply -R 200 settings (shard wiped) - T208844 | 
  [production] | 
            
  | 10:41 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1078 T209754 (duration: 00m 46s) | 
  [production] | 
            
  | 10:21 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) | 
  [production] | 
            
  | 10:21 | 
  <banyek> | 
  stopping replication on db2076 (T85757) | 
  [production] | 
            
  | 10:11 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) | 
  [production] | 
            
  | 09:57 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1123 and increase weight for db1078 T209754 (duration: 00m 46s) | 
  [production] | 
            
  | 09:48 | 
  <marostegui> | 
  Rename table foundationwiki.petition_data on db1078 - T208979 | 
  [production] | 
            
  | 09:46 | 
  <marostegui> | 
  Drop empty testwiki.petition_data from db1075 with replication - T208979 | 
  [production] | 
            
  | 09:43 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1123 and db1078 T209754 (duration: 00m 46s) | 
  [production] | 
            
  | 09:10 | 
  <Nikerabbit> | 
  Rebuilt message group stats cache for T208521 | 
  [production] | 
            
  | 08:43 | 
  <banyek> | 
  executing schema change on db2095 (T85757) | 
  [production] | 
            
  | 07:57 | 
  <marostegui> | 
  Stop MySQL on db1123 - T209754 | 
  [production] | 
            
  | 07:56 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1123 to clone db1078 T209754 (duration: 00m 47s) | 
  [production] | 
            
  | 06:21 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Add db1078 line back to config file but depooled T209754 (duration: 00m 51s) | 
  [production] | 
            
  | 06:20 | 
  <marostegui@deploy1001> | 
  sync-file aborted: Add db1078 line back to config file but depooled T209754 (duration: 00m 02s) | 
  [production] | 
            
  
    | 
      
        2018-11-16
      
      §
     | 
  
    
  | 23:13 | 
  <smalyshev@deploy1001> | 
  Finished deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 (duration: 00m 23s) | 
  [production] | 
            
  | 23:12 | 
  <smalyshev@deploy1001> | 
  Started deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 | 
  [production] | 
            
  | 16:23 | 
  <Trey314159> | 
  reindexing Chinese wikis on elastic@eqiad and elastic@codfw  (T209156) | 
  [production] | 
            
  | 15:46 | 
  <moritzm> | 
  rebooting debmonitor* instances for kernel security update and to pick up SSBD | 
  [production] | 
            
  | 15:01 | 
  <hashar> | 
  restarting zuul with 1300 events to process | 
  [production] | 
            
  | 14:56 | 
  <marostegui> | 
  Create ipblocks_restrictions on labswiki and labtestwiki on db1073 - T209674 | 
  [production] | 
            
  | 14:56 | 
  <ema> | 
  upgrade cp-ats to 8.0.0-1wm2 T204225 T204209 | 
  [production] | 
            
  | 14:39 | 
  <ema> | 
  trafficserver 8.0.0-1wm2 uploaded to stretch-wikimedia T204225 T204209 | 
  [production] | 
            
  | 14:36 | 
  <hashar> | 
  Gracefully stopping zuul (kill -SIGUSR1) | 
  [production] | 
            
  | 14:29 | 
  <_joe_> | 
  re-depooling mw1261 for php-fpm testing | 
  [production] |