| 2018-05-03
      
      § | 
    
  | 05:28 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Clarify that db1060 is running an alter table (duration: 01m 15s) | [production] | 
            
  | 05:22 | <marostegui> | Deploy schema change on db1060 with replication (this will generate lag on labs - s2) - T191519 T188299 T190148 | [production] | 
            
  | 03:32 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2182.codfw.wmnet | [production] | 
            
  | 03:28 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2181.codfw.wmnet | [production] | 
            
  | 03:26 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2180.codfw.wmnet | [production] | 
            
  | 02:43 | <l10nupdate@tin> | scap sync-l10n completed (1.32.0-wmf.1) (duration: 07m 20s) | [production] | 
            
  | 00:33 | <krinkle@tin> | Synchronized php-1.32.0-wmf.1/extensions/NavigationTiming/modules/: Ie77e77de3b8 (duration: 01m 18s) | [production] | 
            
  | 00:20 | <mutante> | mw2180,mw2181,mw2182 - reinstalling with stretch (in case there are alerts that's why) | [production] | 
            
  | 00:02 | <twentyafterfour> | no phabricator upgrade tonight. | [production] | 
            
  
    | 2018-05-02
      
      § | 
    
  | 23:39 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2179.codfw.wmnet | [production] | 
            
  | 23:35 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2178.codfw.wmnet | [production] | 
            
  | 23:29 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2177.codfw.wmnet | [production] | 
            
  | 23:17 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/Kartographer/: Add maintenance script to purge pages with map tags (T193525) (duration: 01m 18s) | [production] | 
            
  | 22:24 | <XioNoX> | Re-enabled the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 | [production] | 
            
  | 22:18 | <ebernhardson> | start reindex of viwiki on eqiad elasticsearch, failed on last run due to unrelated issues | [production] | 
            
  | 22:17 | <XioNoX> | Disabling the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 | [production] | 
            
  | 22:17 | <XioNoX> | Re-enabled the link between fasw-codfw and pfw3b-codfw (backup) - T192104 | [production] | 
            
  | 21:42 | <XioNoX> | Disabling the link between fasw-codfw and pfw3b-codfw (backup) - T192104 | [production] | 
            
  | 21:33 | <XioNoX> | failing-over RG1 to node0 on pfw3-codfw - T192104 | [production] | 
            
  | 19:54 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2173.codfw.wmnet | [production] | 
            
  | 19:38 | <mutante> | mw2173 - scap pull (wasn't pooled but should have, bring up to date) | [production] | 
            
  | 19:25 | <thcipriani@tin> | rebuilt and synchronized wikiversions files: revert group1 to 1.32.0-wmf.2 | [production] | 
            
  | 19:23 | <thcipriani@tin> | rebuilt and synchronized wikiversions files: group1 to 1.32.0-wmf.2 | [production] | 
            
  | 19:18 | <mutante> | mw2177, mw2178, mw2179 - reinstalling with stretch | [production] | 
            
  | 19:14 | <ppchelko@tin> | Finished deploy [restbase/deploy@1093d1d]: Sample log action api 4xx with 1% probability (duration: 16m 18s) | [production] | 
            
  | 19:10 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2176.codfw.wmnet | [production] | 
            
  | 19:08 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2175.codfw.wmnet | [production] | 
            
  | 18:58 | <ppchelko@tin> | Started deploy [restbase/deploy@1093d1d]: Sample log action api 4xx with 1% probability | [production] | 
            
  | 17:59 | <mutante> | mw2174 - repooled | [production] | 
            
  | 17:58 | <imarlier@tin> | Started deploy [performance/coal@bd7568a]: deploy coal to webperf1001 | [production] | 
            
  | 17:55 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable RemexHtml on wikis with <100 high-prio issues (T192299) (duration: 01m 17s) | [production] | 
            
  | 17:48 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable RemexHtml on metawiki (T192386) (duration: 01m 17s) | [production] | 
            
  | 17:40 | <imarlier@tin> | Finished deploy [performance/coal@bd7568a]: deploy coal to webperf1001 (duration: 00m 06s) | [production] | 
            
  | 17:40 | <imarlier@tin> | Started deploy [performance/coal@bd7568a]: deploy coal to webperf1001 | [production] | 
            
  | 17:31 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/MobileFrontend/: T193564 (duration: 01m 20s) | [production] | 
            
  | 17:29 | <catrope@tin> | Synchronized php-1.32.0-wmf.2/extensions/Kartographer/: Add missing util dependency (duration: 01m 14s) | [production] | 
            
  | 17:12 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable $wgCiteResponsiveReferences on kowiki (T193491) (duration: 01m 17s) | [production] | 
            
  | 16:35 | <bawolff> | run recountCategories.php on huwiki T169964 | [production] | 
            
  | 16:29 | <gehel> | restarting blazegraph to increase TasksMax | [production] | 
            
  | 15:18 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1098 (duration: 01m 17s) | [production] | 
            
  | 15:07 | <joal@tin> | Finished deploy [analytics/refinery@318d449]: Regular weekly deploy (duration: 08m 46s) | [production] | 
            
  | 14:58 | <joal@tin> | Started deploy [analytics/refinery@318d449]: Regular weekly deploy | [production] | 
            
  | 14:37 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Add and pool db1121 (duration: 01m 17s) | [production] | 
            
  | 14:33 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Add db1121 (duration: 01m 16s) | [production] | 
            
  | 14:23 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:430384|Update comment next to WMDE wmgMonologChannels entry]] T191500 (duration: 01m 17s) | [production] | 
            
  | 13:58 | <gilles> | End of mid-day EU SWAT | [production] | 
            
  | 13:49 | <ottomata> | beginning upgrade of kafka-jumbo brokers from 1.0.0 -> 1.1.0 : T193495 | [production] | 
            
  | 13:47 | <vgutierrez> | Update puppet compiler facts | [production] | 
            
  | 13:40 | <vgutierrez> | Repool lvs2001 - T191897 | [production] | 
            
  | 13:37 | <gilles@tin> | Synchronized wmf-config/InitialiseSettings.php: T187299 Add performance perception QuickSurvey definition (duration: 01m 17s) | [production] |