| 2018-05-02
      
      ยง | 
    
  | 23:39 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2179.codfw.wmnet | [production] | 
            
  | 23:35 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2178.codfw.wmnet | [production] | 
            
  | 23:29 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2177.codfw.wmnet | [production] | 
            
  | 23:17 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/Kartographer/: Add maintenance script to purge pages with map tags (T193525) (duration: 01m 18s) | [production] | 
            
  | 22:24 | <XioNoX> | Re-enabled the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 | [production] | 
            
  | 22:18 | <ebernhardson> | start reindex of viwiki on eqiad elasticsearch, failed on last run due to unrelated issues | [production] | 
            
  | 22:17 | <XioNoX> | Disabling the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 | [production] | 
            
  | 22:17 | <XioNoX> | Re-enabled the link between fasw-codfw and pfw3b-codfw (backup) - T192104 | [production] | 
            
  | 21:42 | <XioNoX> | Disabling the link between fasw-codfw and pfw3b-codfw (backup) - T192104 | [production] | 
            
  | 21:33 | <XioNoX> | failing-over RG1 to node0 on pfw3-codfw - T192104 | [production] | 
            
  | 19:54 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2173.codfw.wmnet | [production] | 
            
  | 19:38 | <mutante> | mw2173 - scap pull (wasn't pooled but should have, bring up to date) | [production] | 
            
  | 19:25 | <thcipriani@tin> | rebuilt and synchronized wikiversions files: revert group1 to 1.32.0-wmf.2 | [production] | 
            
  | 19:23 | <thcipriani@tin> | rebuilt and synchronized wikiversions files: group1 to 1.32.0-wmf.2 | [production] | 
            
  | 19:18 | <mutante> | mw2177, mw2178, mw2179 - reinstalling with stretch | [production] | 
            
  | 19:14 | <ppchelko@tin> | Finished deploy [restbase/deploy@1093d1d]: Sample log action api 4xx with 1% probability (duration: 16m 18s) | [production] | 
            
  | 19:10 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2176.codfw.wmnet | [production] | 
            
  | 19:08 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2175.codfw.wmnet | [production] | 
            
  | 18:58 | <ppchelko@tin> | Started deploy [restbase/deploy@1093d1d]: Sample log action api 4xx with 1% probability | [production] | 
            
  | 17:59 | <mutante> | mw2174 - repooled | [production] | 
            
  | 17:58 | <imarlier@tin> | Started deploy [performance/coal@bd7568a]: deploy coal to webperf1001 | [production] | 
            
  | 17:55 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable RemexHtml on wikis with <100 high-prio issues (T192299) (duration: 01m 17s) | [production] | 
            
  | 17:48 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable RemexHtml on metawiki (T192386) (duration: 01m 17s) | [production] | 
            
  | 17:40 | <imarlier@tin> | Finished deploy [performance/coal@bd7568a]: deploy coal to webperf1001 (duration: 00m 06s) | [production] | 
            
  | 17:40 | <imarlier@tin> | Started deploy [performance/coal@bd7568a]: deploy coal to webperf1001 | [production] | 
            
  | 17:31 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/MobileFrontend/: T193564 (duration: 01m 20s) | [production] | 
            
  | 17:29 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/Kartographer/: Add missing util dependency (duration: 01m 14s) | [production] | 
            
  | 17:12 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable $wgCiteResponsiveReferences on kowiki (T193491) (duration: 01m 17s) | [production] | 
            
  | 16:35 | <bawolff> | run recountCategories.php on huwiki T169964 | [production] | 
            
  | 16:29 | <gehel> | restarting blazegraph to increase TasksMax | [production] | 
            
  | 15:18 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1098 (duration: 01m 17s) | [production] | 
            
  | 15:07 | <joal@tin> | Finished deploy [analytics/refinery@318d449]: Regular weekly deploy (duration: 08m 46s) | [production] | 
            
  | 14:58 | <joal@tin> | Started deploy [analytics/refinery@318d449]: Regular weekly deploy | [production] | 
            
  | 14:37 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Add and pool db1121 (duration: 01m 17s) | [production] | 
            
  | 14:33 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Add db1121 (duration: 01m 16s) | [production] | 
            
  | 14:23 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:430384|Update comment next to WMDE wmgMonologChannels entry]] T191500 (duration: 01m 17s) | [production] | 
            
  | 13:58 | <gilles> | End of mid-day EU SWAT | [production] | 
            
  | 13:49 | <ottomata> | beginning upgrade of kafka-jumbo brokers from 1.0.0 -> 1.1.0 : T193495 | [production] | 
            
  | 13:47 | <vgutierrez> | Update puppet compiler facts | [production] | 
            
  | 13:40 | <vgutierrez> | Repool lvs2001 - T191897 | [production] | 
            
  | 13:37 | <gilles@tin> | Synchronized wmf-config/InitialiseSettings.php: T187299 Add performance perception QuickSurvey definition (duration: 01m 17s) | [production] | 
            
  | 13:29 | <elukey> | upgrade zookeeper to 3.4.9 on druid100[4-6] (wikistats 2 backend) - T164008 | [production] | 
            
  | 13:20 | <elukey> | restart druid broker on druid100[1-3] to enable the 'druid.sql.enable' feature | [production] | 
            
  | 13:15 | <gilles> | T193225 mwscript namespaceDupes.php --wiki=euwikisource --fix | [production] | 
            
  | 13:13 | <gilles@tin> | Synchronized wmf-config/InitialiseSettings.php: T193225 Add Author namespace on eu.wikisource (duration: 01m 20s) | [production] | 
            
  | 13:05 | <gilles> | Starting mid-day EU SWAT | [production] | 
            
  | 13:01 | <moritzm> | re-attempting to reimage mw1250, mw1254, mw1255 (app servers) to stretch, those ran into a timeout earlier which is now fixed in the reimage script | [production] | 
            
  | 12:48 | <moritzm> | reimaging mw1340, mw1341, mw1342 (API servers) to stretch | [production] | 
            
  | 12:17 | <vgutierrez> | Depool and reimage lvs2001 as stretch - T191897 | [production] | 
            
  | 11:41 | <vgutierrez> | Repool lvs2002 - T191897 | [production] |