| 2018-05-11
      
      § | 
    
  | 18:21 | <chasemp> | change 'Advertise this list when people ask what lists are on this machine' to no for cloud-admin-l and cloud-admin-feed | [production] | 
            
  | 17:21 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1076 with full weight (duration: 01m 02s) | [production] | 
            
  | 16:26 | <jynus> | restarting mariadb@s8 at dbstore2001 | [production] | 
            
  | 16:20 | <jynus> | removing x1 from dbstore2001 | [production] | 
            
  | 14:37 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1076 with low load, increase db1066 load (duration: 01m 02s) | [production] | 
            
  | 14:30 | <jynus> | reset labsdb proxies to its config defaults after rolling restart for upgrade | [production] | 
            
  | 14:28 | <elukey> | restart kafka brokers on kafka10[20,22,23] to pick up openjdk-7 security upgrades | [production] | 
            
  | 14:14 | <andrewbogott> | rebooting labvirt1001 for T194258 | [production] | 
            
  | 14:13 | <elukey> | restart Hadoop daemons on analytics100[12] for openjdk security upgrades | [production] | 
            
  | 13:39 | <jynus> | stopping and restarting labsdb1009 for upgrade | [production] | 
            
  | 13:32 | <jynus> | reloading haproxy configuration for dbproxy1011 to point to labsdb1011 | [production] | 
            
  | 12:09 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1066 with low load (duration: 01m 02s) | [production] | 
            
  | 11:48 | <Amir1> | making change_tag_def table on all wikis (T194302) | [production] | 
            
  | 10:07 | <elukey> | reimage analytics1052 to Debian Stretch (Hadoop Journal node) | [production] | 
            
  | 09:30 | <jynus> | stopping db1076 for maintenance | [production] | 
            
  | 09:25 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1076 (duration: 01m 02s) | [production] | 
            
  | 07:59 | <elukey> | reimage analytics1035 to Debian Stretch | [production] | 
            
  | 07:00 | <jynus> | depool and upgrade/restart of dbproxy1011 | [production] | 
            
  | 02:09 | <ejegg> | updated payments-wiki from 55d0808853 to c81e25f8d3 | [production] | 
            
  
    | 2018-05-10
      
      § | 
    
  | 23:18 | <ejegg> | updated CiviCRM from 4c6a9c9c1c to 5b8c868a00 | [production] | 
            
  | 23:09 | <thcipriani@tin> | Synchronized dblists/categories-rdf.dblist: SWAT: [[gerrit:432043|Add wikis with more that 1000 categories to categories dump]] T194139 (duration: 01m 02s) | [production] | 
            
  | 20:27 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2140.codfw.wmnet | [production] | 
            
  | 20:27 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2140.co3dfw.wmnet | [production] | 
            
  | 20:26 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2144.codfw.wmnet | [production] | 
            
  | 20:24 | <dzahn@neodymium> | conftool action : set/pooled=yes; selector: name=mw2202.codfw.wmnet | [production] | 
            
  | 20:17 | <sbisson@tin> | Finished deploy [kartotherian/deploy@06572bb]: Kartotherian: add fonts for Syriac and Inuktituk (duration: 03m 40s) | [production] | 
            
  | 20:13 | <sbisson@tin> | Started deploy [kartotherian/deploy@06572bb]: Kartotherian: add fonts for Syriac and Inuktituk | [production] | 
            
  | 20:05 | <XenoRyet> | updated payments-wiki from 4a8aada491 to 55d0808853 | [production] | 
            
  | 20:02 | <twentyafterfour> | New branch 1.32.0-wmf.3 appears to be stable on all wikis. This completes the train for the week. Tune in again next week, same bat time, same bat channel. refs T191049 | [production] | 
            
  | 19:57 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.3 | [production] | 
            
  | 19:53 | <twentyafterfour> | all deployment blockers resolved, proceeding to deploy mediawiki 1.32.0-wmf.3 to all wikis | [production] | 
            
  | 19:14 | <twentyafterfour@tin> | Synchronized php-1.32.0-wmf.3/includes/libs/rdbms/: deploy https://gerrit.wikimedia.org/r/#/c/432415/ refs T194308 (duration: 01m 23s) | [production] | 
            
  | 18:56 | <maxsem@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/432416/ labs only (duration: 01m 20s) | [production] | 
            
  | 18:30 | <sbisson@tin> | Finished deploy [tilerator/deploy@a5ec109]: Tilerator: load source and style from yaml (duration: 08m 45s) | [production] | 
            
  | 18:21 | <sbisson@tin> | Started deploy [tilerator/deploy@a5ec109]: Tilerator: load source and style from yaml | [production] | 
            
  | 18:16 | <sbisson@tin> | Finished deploy [kartotherian/deploy@3aa87ff]: Kartotherian: load style from yaml (duration: 06m 16s) | [production] | 
            
  | 18:09 | <sbisson@tin> | Started deploy [kartotherian/deploy@3aa87ff]: Kartotherian: load style from yaml | [production] | 
            
  | 18:02 | <ppchelko@tin> | Finished deploy [restbase/deploy@fb306e3]: Logging improvements (duration: 15m 33s) | [production] | 
            
  | 17:59 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Fully pool db1123, Remove db1072 (duration: 01m 15s) | [production] | 
            
  | 17:57 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Remove db1072 (duration: 01m 20s) | [production] | 
            
  | 17:46 | <ppchelko@tin> | Started deploy [restbase/deploy@fb306e3]: Logging improvements | [production] | 
            
  | 15:54 | <elukey> | drain and reimage analytics1028 to Debian Jessie (Hadoop Journal node) | [production] | 
            
  | 15:00 | <elukey> | rolling restart of Hadoop HDFS datanodes on analytics workers to pick up the new openjdk-8 security upgrades | [production] | 
            
  | 14:53 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1123 with low weight (duration: 01m 20s) | [production] | 
            
  | 14:38 | <elukey> | rolling restart of Hadoop Yarn nodemanagers on analytics worker nodes for openjdk-8 security upgrades | [production] | 
            
  | 14:32 | <jynus> | restarting db1123 | [production] | 
            
  | 14:28 | <otto@tin> | Started restart [eventlogging/eventbus@aa9eb2c]: apply log level changes | [production] | 
            
  | 14:27 | <ottomata> | rolling restart of eventbus service to apply new log level settings | [production] | 
            
  | 14:07 | <elukey> | restart hive/oozie Hadoop daemons on analytics1003 for openjdk-8 upgrades | [production] | 
            
  | 13:56 | <mutante> | mw2139,mw2140,mw2144,mw2202 - reinstall with --no-verify - last few special cases that didnt have puppet certs or failed before - after that all appservers done | [production] |