| 
      
        2018-05-10
      
      ยง
     | 
  
    
  | 20:02 | 
  <twentyafterfour> | 
  New branch 1.32.0-wmf.3 appears to be stable on all wikis. This completes the train for the week. Tune in again next week, same bat time, same bat channel. refs T191049 | 
  [production] | 
            
  | 19:57 | 
  <twentyafterfour@tin> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.3 | 
  [production] | 
            
  | 19:53 | 
  <twentyafterfour> | 
  all deployment blockers resolved, proceeding to deploy mediawiki 1.32.0-wmf.3 to all wikis | 
  [production] | 
            
  | 19:14 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.32.0-wmf.3/includes/libs/rdbms/: deploy https://gerrit.wikimedia.org/r/#/c/432415/ refs T194308 (duration: 01m 23s) | 
  [production] | 
            
  | 18:56 | 
  <maxsem@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/432416/ labs only (duration: 01m 20s) | 
  [production] | 
            
  | 18:30 | 
  <sbisson@tin> | 
  Finished deploy [tilerator/deploy@a5ec109]: Tilerator: load source and style from yaml (duration: 08m 45s) | 
  [production] | 
            
  | 18:21 | 
  <sbisson@tin> | 
  Started deploy [tilerator/deploy@a5ec109]: Tilerator: load source and style from yaml | 
  [production] | 
            
  | 18:16 | 
  <sbisson@tin> | 
  Finished deploy [kartotherian/deploy@3aa87ff]: Kartotherian: load style from yaml (duration: 06m 16s) | 
  [production] | 
            
  | 18:09 | 
  <sbisson@tin> | 
  Started deploy [kartotherian/deploy@3aa87ff]: Kartotherian: load style from yaml | 
  [production] | 
            
  | 18:02 | 
  <ppchelko@tin> | 
  Finished deploy [restbase/deploy@fb306e3]: Logging improvements (duration: 15m 33s) | 
  [production] | 
            
  | 17:59 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Fully pool db1123, Remove db1072 (duration: 01m 15s) | 
  [production] | 
            
  | 17:57 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Remove db1072 (duration: 01m 20s) | 
  [production] | 
            
  | 17:46 | 
  <ppchelko@tin> | 
  Started deploy [restbase/deploy@fb306e3]: Logging improvements | 
  [production] | 
            
  | 15:54 | 
  <elukey> | 
  drain and reimage analytics1028 to Debian Jessie (Hadoop Journal node) | 
  [production] | 
            
  | 15:00 | 
  <elukey> | 
  rolling restart of Hadoop HDFS datanodes on analytics workers to pick up the new openjdk-8 security upgrades | 
  [production] | 
            
  | 14:53 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Pool db1123 with low weight (duration: 01m 20s) | 
  [production] | 
            
  | 14:38 | 
  <elukey> | 
  rolling restart of Hadoop Yarn nodemanagers on analytics worker nodes for openjdk-8 security upgrades | 
  [production] | 
            
  | 14:32 | 
  <jynus> | 
  restarting db1123 | 
  [production] | 
            
  | 14:28 | 
  <otto@tin> | 
  Started restart [eventlogging/eventbus@aa9eb2c]: apply log level changes | 
  [production] | 
            
  | 14:27 | 
  <ottomata> | 
  rolling restart of eventbus service to apply new log level settings | 
  [production] | 
            
  | 14:07 | 
  <elukey> | 
  restart hive/oozie Hadoop daemons on analytics1003 for openjdk-8 upgrades | 
  [production] | 
            
  | 13:56 | 
  <mutante> | 
  mw2139,mw2140,mw2144,mw2202 - reinstall with --no-verify - last few special cases that didnt have puppet certs or failed before - after that all appservers done | 
  [production] | 
            
  | 13:46 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2138.codfw.wmnet | 
  [production] | 
            
  | 13:43 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2137.codfw.wmnet | 
  [production] | 
            
  | 13:42 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2136.codfw.wmnet | 
  [production] | 
            
  | 13:41 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2135.codfw.wmnet | 
  [production] | 
            
  | 13:31 | 
  <elukey> | 
  rolling restart of kafka on kafka-jumbo1* for openjdk-8 security upgrades | 
  [production] | 
            
  | 13:25 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 13:19 | 
  <elukey> | 
  reimage analytics1029 to Debian Stretch | 
  [production] | 
            
  | 13:15 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:429989|cawiki: remove gendered namespace aliases, already on MW core (T113616)]] (duration: 01m 20s) | 
  [production] | 
            
  | 13:06 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:432073|Enable TemplateStyles for nowiki (T193786)]] (duration: 01m 20s) | 
  [production] | 
            
  | 12:21 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Add db1123 (duration: 01m 19s) | 
  [production] | 
            
  | 12:07 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Add db1123 (duration: 01m 19s) | 
  [production] | 
            
  | 12:04 | 
  <Reedy> | 
  that was for "Add throttle rule for Netherlands Hackathon 2018 - Women Tech Storm" | 
  [production] | 
            
  | 12:04 | 
  <reedy@tin> | 
  Synchronized wmf-config/throttle.php: (no justification provided) (duration: 01m 48s) | 
  [production] | 
            
  | 11:46 | 
  <elukey> | 
  reimage analytics1030/31 to Debian Stretch | 
  [production] | 
            
  | 11:07 | 
  <volans> | 
  updated puppet compiler facts | 
  [production] | 
            
  | 09:07 | 
  <jynus> | 
  stop db1072 for maintenance | 
  [production] | 
            
  | 08:10 | 
  <jynus> | 
  shutdown and restart labsdb1010 for upgrade | 
  [production] | 
            
  | 07:12 | 
  <jynus> | 
  depool labsdb1010 from wikireplicas for maintenace | 
  [production] | 
            
  | 03:04 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.32.0-wmf.2) (duration: 15m 35s) | 
  [production] | 
            
  | 02:51 | 
  <mutante> | 
  mw2137,mw2138,mw22139 - reinstall with strech (last message was wrong, already running) | 
  [production] | 
            
  | 02:48 | 
  <mutante> | 
  mw2136,mw2137,mw22138 - reinstall with stret h | 
  [production] | 
            
  | 02:44 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2141.codfw.wmnet | 
  [production] | 
            
  | 02:41 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2142.codfw.wmnet | 
  [production] | 
            
  | 02:39 | 
  <dzahn@neodymium> | 
  conftool action : set/pooled=yes; selector: name=mw2143.codfw.wmnet | 
  [production] | 
            
  | 01:16 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.32.0-wmf.3/includes/libs/rdbms: sync https://gerrit.wikimedia.org/r/#/c/432297/ refs T194308 T191049 (duration: 01m 24s) | 
  [production] | 
            
  | 00:33 | 
  <mutante> | 
  mw2135, mw2136, mw2137 - reinstall with stretch, depooled, downtimed | 
  [production] | 
            
  | 00:28 | 
  <hoo@tin> | 
  Synchronized php-1.32.0-wmf.3/extensions/Wikibase/lib/WikibaseLib.php: Remove wgHooks entry for GalleryGetModes (T194316) (duration: 01m 16s) | 
  [production] | 
            
  | 00:26 | 
  <hoo@tin> | 
  Synchronized php-1.32.0-wmf.2/extensions/Wikibase/lib/WikibaseLib.php: Remove wgHooks entry for GalleryGetModes (T194316) (duration: 01m 20s) | 
  [production] |