| 2017-12-07
      
      § | 
    
  | 15:18 | <otto@tin> | Started deploy [analytics/superset/deploy@f0f5adf]: initial deployment | [production] | 
            
  | 14:55 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1099:331 with low weight - T178359 (duration: 00m 47s) | [production] | 
            
  | 14:29 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully repool db1074 (duration: 00m 47s) | [production] | 
            
  | 14:09 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 14:08 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:395835|alswiki: Set wgRestrictDisplayTitle = false (T182154)]] (duration: 00m 49s) | [production] | 
            
  | 13:39 | <moritzm> | reimaging mw2246 to stretch | [production] | 
            
  | 12:54 | <jmm@puppetmaster1001> | conftool action : set/pooled=yes; selector: mw2152.codfw.wmnet | [production] | 
            
  | 12:32 | <addshore@tin> | Synchronized wmf-config/Wikibase.php: [[gerrit:395966|Move Wikibase dispatchingLockManager to InitialiseSettings]] PT 2/2 (duration: 00m 48s) | [production] | 
            
  | 12:31 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:395966|Move Wikibase dispatchingLockManager to InitialiseSettings]] PT 1/2 (duration: 00m 48s) | [production] | 
            
  | 11:42 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase API traffic for db1074 (duration: 00m 48s) | [production] | 
            
  | 11:41 | <moritzm> | reimaging mw2152 to stretch | [production] | 
            
  | 11:35 | <marostegui> | Compress s8 on db1099 - T178359 | [production] | 
            
  | 11:21 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase API traffic for db1074 (duration: 00m 48s) | [production] | 
            
  | 11:10 | <mobrovac@tin> | Finished deploy [restbase/deploy@097ba7d]: Add CORS headers to erroneous responses as well - T182103 (duration: 05m 24s) | [production] | 
            
  | 11:05 | <mobrovac@tin> | Started deploy [restbase/deploy@097ba7d]: Add CORS headers to erroneous responses as well - T182103 | [production] | 
            
  | 10:57 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1074 with low weight (duration: 00m 48s) | [production] | 
            
  | 10:50 | <elukey> | powercycle analytics1003 - no serial console, ssh stuck in  System is booting up. See pam_nologin(8) | [production] | 
            
  | 10:28 | <_joe_> | depooling mw1283 for further investigation | [production] | 
            
  | 10:14 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully pool db1098:3316 db1098:3317 - T178359 (duration: 00m 51s) | [production] | 
            
  | 10:12 | <elukey> | reboot analytics1003 for kernel+jvm updates - T179943 | [production] | 
            
  | 10:01 | <gehel> | upgrade of ELK stack on logstash100* completed - Kibana was unavailable for longer than expected - T178412 | [production] | 
            
  | 09:48 | <hashar> | CI: removed Wikidata from configuration, replaced by Wikibase.  wmf/* and REL branches are going to be broken though | https://gerrit.wikimedia.org/r/395704 | T181838 | [production] | 
            
  | 09:46 | <akosiaris> | silence ganeti1006 on icinga T181121 | [production] | 
            
  | 09:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1098:3316 db1098:3317 - T178359 (duration: 00m 52s) | [production] | 
            
  | 09:28 | <marostegui> | Upgrade MySQL and kernel on db1074 | [production] | 
            
  | 09:22 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=logstash1009.eqiad.wmnet | [production] | 
            
  | 09:19 | <gehel@puppetmaster1001> | conftool action : set/pooled=no; selector: name=logstash1009.eqiad.wmnet | [production] | 
            
  | 09:18 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=logstash1008.eqiad.wmnet | [production] | 
            
  | 09:14 | <gehel@puppetmaster1001> | conftool action : set/pooled=no; selector: name=logstash1008.eqiad.wmnet | [production] | 
            
  | 09:13 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=logstash1007.eqiad.wmnet | [production] | 
            
  | 09:08 | <gehel@puppetmaster1001> | conftool action : set/pooled=no; selector: name=logstash1007.eqiad.wmnet | [production] | 
            
  | 09:05 | <gehel@tin> | Finished deploy [logstash/plugins@b13d2fa]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 09:05 | <gehel@tin> | Started deploy [logstash/plugins@b13d2fa]: (no justification provided) | [production] | 
            
  | 09:00 | <gehel> | upgrading ELK stack on logstash100* - some log messages might be lost during the upgrade - T178412 | [production] | 
            
  | 08:51 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1098:3316 db1098:3317 - T178359 (duration: 00m 48s) | [production] | 
            
  | 08:32 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1098:3316 db1098:3317 - T178359 (duration: 00m 48s) | [production] | 
            
  | 08:28 | <elukey> | install prometheus-druid-exporter 0.5 on druid* | [production] | 
            
  | 08:26 | <elukey> | upload prometheus-druid-exporter 0.5-1 to jessie/stretch-wikimedia | [production] | 
            
  | 07:19 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Slowly pool db1098:3316 db1098:3317 - T178359 (duration: 00m 47s) | [production] | 
            
  | 07:18 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Slowly pool db1098:3316 db1098:3317 - T178359 (duration: 00m 48s) | [production] | 
            
  | 06:45 | <marostegui> | Stop replication on db1099:3311 to reimport: change_tag, tag_summary, user and watchlist tables and recompress again - T178359 | [production] | 
            
  | 06:40 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1074 - T174569 (duration: 00m 48s) | [production] | 
            
  | 06:40 | <marostegui> | Deploy schema change on db1074 (s2) - T174569 | [production] | 
            
  | 03:00 | <catrope@tin> | Synchronized php-1.31.0-wmf.11/resources/src/mediawiki.rcfilters/: T182268 (duration: 00m 57s) | [production] | 
            
  | 02:29 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.10) (duration: 08m 57s) | [production] |