| 2018-10-08
      
      § | 
    
  | 22:45 | <XioNoX> | increase accepted-prefix-limit for 24115 on cr4-ulsfo | [production] | 
            
  | 22:41 | <XioNoX> | clear BGP neighbor cr1-eqsin:AS9583 (bgp limit threshold reached) | [production] | 
            
  | 21:11 | <ejegg> | updated payments-wiki from d623de9494 to 1472604b6e | [production] | 
            
  | 20:42 | <gehel> | repooling wdqs2003 catched up on lag - T206423 | [production] | 
            
  | 19:41 | <XioNoX> | troubleshooting asw2-b-eqid with JTAC - T201039 | [production] | 
            
  | 19:08 | <gehel> | depooling wdqs2003 to catch up on lag -T206423 | [production] | 
            
  | 19:00 | <tgr@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:465194|Enable MCR read-new mode on some small wikis (T198308)]] (duration: 00m 56s) | [production] | 
            
  | 18:55 | <onimisionipe@deploy1001> | Finished deploy [wdqs/wdqs@bd698bd]: WDQS deployment - New federation whitelist entries (duration: 10m 07s) | [production] | 
            
  | 18:45 | <onimisionipe@deploy1001> | Started deploy [wdqs/wdqs@bd698bd]: WDQS deployment - New federation whitelist entries | [production] | 
            
  | 18:37 | <onimisionipe@deploy1001> | Finished deploy [wdqs/wdqs@bd698bd]: WDQS test deployment - New federation whitelist entries(wdqs1009) (duration: 00m 33s) | [production] | 
            
  | 18:37 | <onimisionipe@deploy1001> | Started deploy [wdqs/wdqs@bd698bd]: WDQS test deployment - New federation whitelist entries(wdqs1009) | [production] | 
            
  | 18:36 | <tgr@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:465176|Enable Extension:File exporter to mrwikipedia (T206437)]] (duration: 00m 57s) | [production] | 
            
  | 16:29 | <XioNoX> | push firewall filter counters on asw2-b-eqiad - T201039 | [production] | 
            
  | 16:28 | <elukey> | restart eventlogging on eventlog1002 for python security upgrades | [production] | 
            
  | 14:05 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T184805: Revert 'mariadb: Depool db1110 for testing s3 imports' (duration: 00m 57s) | [production] | 
            
  | 14:03 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T184805: Revert 'mariadb: Depool db1110 for testing s3 imports' (duration: 00m 56s) | [production] | 
            
  | 13:43 | <elukey> | restart confd on esams nodes to pick up new srv settings | [production] | 
            
  | 13:41 | <elukey> | restart navtiming.service on webperf1001 to pick up the dns change for etcd | [production] | 
            
  | 13:39 | <marostegui> | Enable gtid on the following slaves: db2068 db1122 db1117:3323 | [production] | 
            
  | 13:37 | <elukey> | restart confd on all the other eqiad nodes to pick up new srv records | [production] | 
            
  | 13:32 | <elukey> | restart confd on cp1* to pick up new srv records | [production] | 
            
  | 13:11 | <_joe_> | purging the dnsrec cache for eqiad,esams etcd client SRV records | [production] | 
            
  | 13:09 | <ema> | depool eqiad front-edge traffic T201039 | [production] | 
            
  | 13:05 | <banyek> | converting cebwiki.templatelinks to TokuDB on host dbstore1002.eqiad.wmnet (T205544) | [production] | 
            
  | 13:04 | <banyek> | downtime notifications for dbstore1002 repliaction threads (T205544) | [production] | 
            
  | 12:49 | <banyek> | pt-kill-wmf enabled on the wikireplicas (T203674) | [production] | 
            
  | 11:59 | <_joe_> | restart pybal in esams, after running puppet, to switch etcd cluster used | [production] | 
            
  | 11:46 | <_joe_> | restart pybal on lvs1001 | [production] | 
            
  | 11:46 | <addshore> | SWAT done | [production] | 
            
  | 11:45 | <addshore@deploy1001> | Synchronized wmf-config/throttle.php: Add throttle exception for Netherlands Hackathon October 2018 - Wiki Techstorm T206241, and remove other rules. (duration: 00m 56s) | [production] | 
            
  | 11:39 | <addshore> | addshore@mwmaint2001:~$ mwscript namespaceDupes.php --wiki fywiktionary --fix --add-prefix=T202769 # T202769 | [production] | 
            
  | 11:35 | <addshore> | addshore@mwmaint2001:~$ mwscript namespaceDupes.php --wiki fywiktionary --fix # Finished, still 111 pages to fix | [production] | 
            
  | 11:34 | <addshore> | addshore@mwmaint2001:~$ mwscript namespaceDupes.php --wiki fywiktionary --fix # Started | [production] | 
            
  | 11:33 | <addshore> | addshore@mwmaint2001:~$ mwscript namespaceDupes.php --wiki fywiktionary # (dryrun, 11529 links to fix, 11529 were resolvable.) | [production] | 
            
  | 11:32 | <addshore@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455249]] Use translated MetaNamespace for fy.wiktionary T202769 (duration: 00m 58s) | [production] | 
            
  | 11:27 | <addshore@deploy1001> | Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:464890]] Remove the "reviewer" group at ruwikisource T205997 (duration: 00m 57s) | [production] | 
            
  | 10:41 | <elukey> | restart mcrouter on mw2201 with more verbose logging settings as test | [production] | 
            
  | 09:55 | <moritzm> | installing python3.5/python2.7 security updates | [production] | 
            
  | 09:51 | <godog> | rebuild sdc sdh sdj sdi on ms-be2041 with crc=1 finobt=0 - T199198 | [production] | 
            
  | 08:20 | <marostegui> | Disable gtid on es2 and es3 eqiad master | [production] | 
            
  | 08:20 | <gehel@puppetmaster1001> | conftool action : set/weight=15; selector: dc=codfw,cluster=wdqs,name=wdqs2001.codfw.wmnet | [production] | 
            
  | 08:20 | <gehel@puppetmaster1001> | conftool action : set/weight=15; selector: dc=codfw,cluster=wdqs,name=wdqs2002.codfw.wmnet | [production] | 
            
  | 07:50 | <marostegui> | Enabling replication eqiad -> codfw in preparation for DC failover | [production] | 
            
  | 07:40 | <marostegui> | Disable GTID on s1,s2,s3,s4,s6,s7,s8 eqiad masters in preparation for enabling replication eqiad -> codfw | [production] | 
            
  | 07:39 | <_joe_> | disabling puppet, doing etcd tests on lvs1006 | [production] | 
            
  | 07:38 | <gehel@puppetmaster1001> | conftool action : set/weight=15; selector: dc=codfw,cluster=wdqs,name=wdqs2002.eqiad.wmnet | [production] |