| 2017-03-15
      
      § | 
    
  | 09:02 | <marostegui> | Disable parallel replication on x1 slaves (db1029, db2033) - T160407 | [production] | 
            
  | 08:27 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:341401|Enable Cognate on beta wiktionary sites]] T156241 Beta Only (duration: 02m 48s) | [production] | 
            
  | 08:26 | <moritzm> | removed imagemagick 6.8.9.9-5+deb8u7+wmf1 from apt.wikimedia.org (the sharpen patch is folded into the new 6.8.9.9-5+deb8u8 security update) | [production] | 
            
  | 08:22 | <marostegui> | Deploy alter table x1 testing parallel replication - T160407 | [production] | 
            
  | 08:11 | <moritzm> | installing imagemagick security updates | [production] | 
            
  | 07:26 | <marostegui> | Enable parallel replication on x1 slaves - T160407 | [production] | 
            
  | 02:35 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.15) (duration: 13m 33s) | [production] | 
            
  | 00:55 | <eileen> | update civicrm from 31f19d6901fc6e4bf3b8a57ecde0ea62c1256c95 to 639eb688db02911948814fe8749523145d1a2df6 | [production] | 
            
  | 00:41 | <maxsem@tin> | Synchronized wmf-config/logging.php: https://gerrit.wikimedia.org/r/342778 (duration: 02m 46s) | [production] | 
            
  | 00:32 | <maxsem@tin> | Synchronized php-1.29.0-wmf.16/extensions/RelatedSites/: Hide DMOZ links with https://gerrit.wikimedia.org/r/#/c/342753/ + https://gerrit.wikimedia.org/r/#/c/342768/ (duration: 02m 48s) | [production] | 
            
  | 00:27 | <maxsem@tin> | Synchronized php-1.29.0-wmf.15/extensions/RelatedSites/: Hide DMOZ links with https://gerrit.wikimedia.org/r/#/c/342753/ + https://gerrit.wikimedia.org/r/#/c/342768/ (duration: 02m 48s) | [production] | 
            
  | 00:19 | <maxsem@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/340697/2 (duration: 02m 53s) | [production] | 
            
  | 00:08 | <mutante> | depooled mw2256 because it's down again (T155180) | [production] | 
            
  | 00:08 | <dzahn@puppetmaster1001> | conftool action : set/pooled=no; selector: name=mw2256.codfw.wmnet | [production] | 
            
  | 00:05 | <dzahn@puppetmaster1001> | conftool action : get/pooled; selector: dc=eqiad,name=mw2256.codfw.wmnet | [production] | 
            
  
    | 2017-03-14
      
      § | 
    
  | 23:59 | <maxsem@tin> | Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/342148/ (duration: 02m 47s) | [production] | 
            
  | 23:55 | <maxsem@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/342148/ (duration: 02m 47s) | [production] | 
            
  | 23:42 | <maxsem@tin> | Synchronized wmf-config/InitialiseSettings.php: - (duration: 02m 50s) | [production] | 
            
  | 23:31 | <tgr@tin> | Finished scap: T125917: Deploy PageViewInfo to testwiki (duration: 48m 58s) | [production] | 
            
  | 22:42 | <tgr@tin> | Started scap: T125917: Deploy PageViewInfo to testwiki | [production] | 
            
  | 21:29 | <ebernhardson> | reindexed search in group0 for mondays codfw search downtime/upgrade | [production] | 
            
  | 20:45 | <mattflaschen@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: Beta Cluster only (duration: 02m 50s) | [production] | 
            
  | 20:17 | <twentyafterfour> | scap was unable to connect to mw2256.codfw.wmnet | [production] | 
            
  | 20:14 | <twentyafterfour@tin> | Finished scap: full scap of new branch, move test wikis to 1.29.0-wmf.16 refs T158997 (duration: 56m 05s) | [production] | 
            
  | 19:18 | <twentyafterfour@tin> | Started scap: full scap of new branch, move test wikis to 1.29.0-wmf.16 refs T158997 | [production] | 
            
  | 19:14 | <ema> | restarting pybal on lvs1010-11 T160405 | [production] | 
            
  | 19:13 | <Reedy> | Delete 2FA for User:Conny per request on IRC. Identy verified via Lydia_WMDE | [production] | 
            
  | 18:42 | <nuria@tin> | Finished deploy [eventlogging/analytics@417c40f]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 18:42 | <nuria@tin> | Started deploy [eventlogging/analytics@417c40f]: (no justification provided) | [production] | 
            
  | 18:39 | <gehel> | removing swap from elasticsearch servers - T158884 | [production] | 
            
  | 18:37 | <ottomata> | upgrading librdkafka to 0.9.4 and restarting varnishkafka on cache text hosts | [production] | 
            
  | 18:19 | <ottomata> | upgrading librdkafka to 0.9.4 and restarting varnishkafka on cache upload hosts | [production] | 
            
  | 18:13 | <ottomata> | upgrading librdkafka to 0.9.4 and restarting varnishkafka on cache misc hosts | [production] | 
            
  | 18:11 | <nuria@tin> | Finished deploy [eventlogging/analytics@c3ccb4a]: (no justification provided) (duration: 00m 03s) | [production] | 
            
  | 18:11 | <nuria@tin> | Started deploy [eventlogging/analytics@c3ccb4a]: (no justification provided) | [production] | 
            
  | 17:07 | <ottomata> | upgrading librdkafka to 0.9.4 on cache misc and restarting varnishkafka | [production] | 
            
  | 16:29 | <jynus> | no reponse from db1057 after powercycle- trying to hard reset it | [production] | 
            
  | 16:10 | <urandom> | T111113: Restart Cassandra in RESTBase Staging to enable optional client encryption | [production] | 
            
  | 15:39 | <godog> | shut ms-be2002 for idrac / bios troubleshooting T155689 | [production] | 
            
  | 15:24 | <chasemp> | silence toolschecker precise job start check in anticipation of removal | [production] | 
            
  | 15:18 | <twentyafterfour> | preparing to branch 1.29.0-wmf.16 refs T158997 | [production] | 
            
  | 14:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1080 - T132416 (duration: 00m 40s) | [production] | 
            
  | 14:36 | <marostegui> | Enabled parallel replication (5 threads) on db2033 (x1) - T160407 | [production] | 
            
  | 14:20 | <chasemp> | labsdb100[9|10|11] 'maintain-views --all-databases --table page --replace-all --debug' | [production] | 
            
  | 14:18 | <chasemp> | labsdb1003 time maintain-views --all-databases --table page --replace-all --debug | [production] | 
            
  | 14:01 | <Dereckson> | Purged portals URL | [production] | 
            
  | 13:56 | <dereckson@tin> | Synchronized portals: Resync portals/ directory after touch (duration: 00m 42s) | [production] | 
            
  | 13:56 | <chasemp> | labsdb1001 maintain-views --all-databases --table page --replace-all --debug | [production] | 
            
  | 13:46 | <dereckson@tin> | Synchronized portals: Bump to e576c18522ff (duration: 00m 41s) | [production] | 
            
  | 13:45 | <dereckson@tin> | Synchronized portals/prod/wikipedia.org/assets: Bump to e576c18522ff (duration: 00m 41s) | [production] |