| 2018-12-05
      
      ยง | 
    
  | 12:59 | <onimisionipe> | banning elastic2001-elastic2024 from codfw production, psi and omega clusters | [production] | 
            
  | 12:53 | <jijiki> | uploaded python-thumbor-community-core_0.4.0-1+deb9u1 to stretch-wikimedia | [production] | 
            
  | 12:47 | <dcausse> | EU SWAT done | [production] | 
            
  | 12:45 | <oblivian@puppetmaster1001> | conftool action : set/pooled=false; selector: dnsdisc=(cit|math)oid,name=codfw | [production] | 
            
  | 12:44 | <dcausse@deploy1001> | Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Add temp clusters but still write to the old ones 2/2 (duration: 00m 46s) | [production] | 
            
  | 12:42 | <dcausse@deploy1001> | Synchronized wmf-config/CommonSettings.php: T210381: [cirrus] Add temp clusters but still write to the old ones 1/2 (duration: 00m 46s) | [production] | 
            
  | 12:31 | <fsero> | pooling mathoid and citoid again on  codfw | [production] | 
            
  | 12:30 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:477768| Bumping portals to master (T202497)]] (duration: 00m 46s) | [production] | 
            
  | 12:29 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:477768| Bumping portals to master (T202497)]] (duration: 00m 49s) | [production] | 
            
  | 12:23 | <dcausse@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T211188: Increase autoconfirmed count for Meta-Wiki to 5 (duration: 00m 47s) | [production] | 
            
  | 12:15 | <fsero> | upgrading codfw k8s cluster to 1.10.11 | [production] | 
            
  | 12:15 | <dcausse> | running namespaceDupes & cirrus indexNamespaces on yuewiktionary | [production] | 
            
  | 12:11 | <dcausse@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T205546: Define 2 new namespaces for yuewiktionary (duration: 00m 47s) | [production] | 
            
  | 12:02 | <fsero> | depooling mathoid and citoid servers on codfw for k8s upgrade | [production] | 
            
  | 11:28 | <mobrovac@deploy1001> | Finished deploy [citoid/deploy@b10e034]: Truncate Zotero-reported time stamp to date - T211127 (duration: 05m 55s) | [production] | 
            
  | 11:23 | <mobrovac@deploy1001> | Started deploy [citoid/deploy@b10e034]: Truncate Zotero-reported time stamp to date - T211127 | [production] | 
            
  | 11:05 | <akosiaris> | upgrade kubernetes-client and kubernetes-master on staging to 1.10.11 | [production] | 
            
  | 11:04 | <godog> | bootstrap cassandra-b, restbase2017 - T210843 | [production] | 
            
  | 10:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 (duration: 00m 45s) | [production] | 
            
  | 10:56 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1090:3317 (duration: 00m 45s) | [production] | 
            
  | 10:51 | <ema> | cache hosts: begin nginx rolling upgrade to 1.13.6-2+wmf2 | [production] | 
            
  | 10:46 | <marostegui> | Reboot db1090 for kernel upgrade | [production] | 
            
  | 10:44 | <moritzm> | uploaded jenkins 2.138.4 to jessie-wikimedia/thirdparty and stretch-wikimedia/thirdpary/ci | [production] | 
            
  | 10:42 | <marostegui> | Stop MySQL on db1090:3312 and db1090:3317 for MySQL upgrade | [production] | 
            
  | 10:42 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 46s) | [production] | 
            
  | 10:38 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1090:3317 (duration: 00m 46s) | [production] | 
            
  | 10:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1080 (duration: 00m 46s) | [production] | 
            
  | 10:21 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch | [production] | 
            
  | 10:17 | <arturo> | T205969 icinga downtime the load avg check in labstore1007 for 1 week | [production] | 
            
  | 10:10 | <banyek> | depooling labsdb1010 for testing materialized views - T210693 | [production] | 
            
  | 10:02 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1080 (duration: 00m 46s) | [production] | 
            
  | 09:42 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly pool db1080 (duration: 00m 46s) | [production] | 
            
  | 09:32 | <gehel> | setting up new elasticsearch servers on codfw - elastic2045-2054 - T210265 | [production] | 
            
  | 09:22 | <marostegui> | Stop MySQL on db1080 for mysql and kernel upgrade | [production] | 
            
  | 09:17 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1080 for MySQL upgrade (duration: 00m 46s) | [production] | 
            
  | 09:07 | <elukey> | matomo read only + upgrade to matomo 3.7.0 on matomo1001 - T209808 | [production] | 
            
  | 09:00 | <_joe_> | disabed puppet on mw1261, used for logging tests for T211184 | [production] | 
            
  | 08:48 | <addshore@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T207850 Define a new Wikibase log channel to use (duration: 00m 47s) | [production] | 
            
  | 08:01 | <moritzm> | installing pdns-recursor security update in esams | [production] | 
            
  | 07:59 | <godog> | bootstrap cassandra-a, restbase2017 - T210843 | [production] | 
            
  | 07:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1091 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 06:55 | <marostegui> | Deploy schema change on db1091 T86338 T202167 | [production] | 
            
  | 06:55 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1091 T86338 T202167 (duration: 00m 51s) | [production] | 
            
  | 04:03 | <urandom> | bootstrapping cassandra-c, restbase2016 -- T210843 | [production] | 
            
  | 03:11 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@a3dd2ca]: Update cxserver to c4240e6 and enable Youdao MT (T208985, T210578) (duration: 04m 26s) | [production] | 
            
  | 03:06 | <kartik@deploy1001> | Started deploy [cxserver/deploy@a3dd2ca]: Update cxserver to c4240e6 and enable Youdao MT (T208985, T210578) | [production] | 
            
  | 00:32 | <dcausse> | Evening SWAT done | [production] | 
            
  | 00:30 | <dcausse@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s) | [production] | 
            
  | 00:28 | <dcausse@deploy1001> | Synchronized wmf-config/ProductionServices.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s) | [production] | 
            
  | 00:16 | <dcausse@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Block notice stats on itwiki (T210452) (duration: 00m 47s) | [production] |