| 2018-05-16
      
      § | 
    
  | 21:58 | <cmjohnson1> | swapping PEM 1 asw-c8-eqiad | [production] | 
            
  | 20:13 | <marostegui> | Force WriteBack policy on db1067 - T194852 | [production] | 
            
  | 19:38 | <twentyafterfour> | The train for 1.32.0-wmf.4 is blocked by fatals in Echo extension. See T194848 | [production] | 
            
  | 19:28 | <twentyafterfour@tin> | Synchronized php-1.32.0-wmf.4/extensions/CongressLookup: sync CongressLookup extension on wmf.4 refs T191050 (duration: 01m 22s) | [production] | 
            
  | 17:35 | <milimetric@tin> | Finished deploy [analytics/refinery@a205447]: Fix drop partitions script (duration: 15m 12s) | [production] | 
            
  | 17:33 | <hoo@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable RemexHtml on wikis with < 100 ns0 errors in high priority cats (T193685) (duration: 01m 22s) | [production] | 
            
  | 17:20 | <milimetric@tin> | Started deploy [analytics/refinery@a205447]: Fix drop partitions script | [production] | 
            
  | 17:16 | <milimetric@tin> | Started deploy [analytics/refinery@15be6ae]: Fix drop partitions script | [production] | 
            
  | 16:38 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1088 with low weight (duration: 01m 21s) | [production] | 
            
  | 16:34 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Change db1067 IP - T193835 (duration: 01m 21s) | [production] | 
            
  | 16:29 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Change db1067 IP - T193835 (duration: 01m 17s) | [production] | 
            
  | 16:22 | <elukey> | upgrade burrow on kafkamon1001 from 1.0 to 1.1 | [production] | 
            
  | 16:18 | <marostegui> | Power off db1067 for rack move - T193835 | [production] | 
            
  | 16:18 | <godog> | move ms-be1036 for asw2-c-eqiad - T187962 | [production] | 
            
  | 16:03 | <godog> | move ms-be1035 for asw2-c-eqiad - T187962 | [production] | 
            
  | 16:03 | <_joe_> | installing cergen 0.2.2 on the puppetmaster frontends | [production] | 
            
  | 15:50 | <andrewbogott> | upgrading kernel, microcode and rebooting labnet1002 | [production] | 
            
  | 15:50 | <jynus> | stop and reimage db1088 | [production] | 
            
  | 15:49 | <godog> | move ms-be1034 for asw2-c-eqiad - T187962 | [production] | 
            
  | 15:36 | <godog> | move ms-be1025 for asw2-c-eqiad - T187962 | [production] | 
            
  | 15:35 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 03m 26s) | [production] | 
            
  | 15:27 | <_joe_> | uploading cergen 0.2.2 to stretch, jessie | [production] | 
            
  | 15:18 | <godog> | move ms-be1024 for asw2-c-eqiad - T187962 | [production] | 
            
  | 15:17 | <elukey> | upgrade burrow from 1.0.0 to 1.1.0 on kafkamon* hosts | [production] | 
            
  | 15:17 | <elukey> | upload burrow 1.1.0 to stretch|jessie-wikimedia | [production] | 
            
  | 15:17 | <bstorm_> | labsdb1004 reboot and upgrade kernel to 4.9.0-0.bpo.6-amd64 | [production] | 
            
  | 15:10 | <godog> | pool ms-fe1008 for asw2 move - T187962 | [production] | 
            
  | 15:02 | <marostegui> | Stop MySQL on labsdb1004 | [production] | 
            
  | 15:01 | <marostegui> | Stop MySQL on db1067 - T193835 | [production] | 
            
  | 14:54 | <godog> | depool ms-fe1008 for asw2 move - T187962 | [production] | 
            
  | 14:50 | <moritzm> | upgrading codfw job runners to HHVM 3,18.5+dfsg-1+wmf8+deb9u1 | [production] | 
            
  | 14:49 | <godog> | pool ms-fe1007 for asw2 move - T187962 | [production] | 
            
  | 14:19 | <filippo@neodymium> | conftool action : set/pooled=no; selector: name=ms-fe1007.eqiad.wmnet | [production] | 
            
  | 14:17 | <godog> | depool ms-fe1007 for asw2 move - T187962 | [production] | 
            
  | 14:04 | <jynus> | stop and reimage db2048 (s1 master) | [production] | 
            
  | 13:56 | <marostegui> | Restart mysql on db1116 for testing | [production] | 
            
  | 13:54 | <marostegui> | Deploy schema change on db1098:3317 - T191519 T188299 T190148 | [production] | 
            
  | 13:54 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 for alter table (duration: 01m 20s) | [production] | 
            
  | 13:48 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 after alter table (duration: 01m 21s) | [production] | 
            
  | 13:43 | <addshore> | SWAT all done | [production] | 
            
  | 13:42 | <addshore@tin> | Synchronized php-1.32.0-wmf.3/autoload.php: SWAT: [[gerrit:433367|Deduplicate archive.ar_rev_id]] (duration: 01m 21s) | [production] | 
            
  | 13:41 | <addshore@tin> | Synchronized php-1.32.0-wmf.3/includes/installer/DatabaseUpdater.php: SWAT: [[gerrit:433367|Deduplicate archive.ar_rev_id]] (duration: 01m 21s) | [production] | 
            
  | 13:39 | <ottomata> | rolling restart of Kafka jumbo  brokers to apply jdk.tls.namedGroups=secp256r1 https://phabricator.wikimedia.org/T182993 | [production] | 
            
  | 13:39 | <addshore@tin> | Synchronized php-1.32.0-wmf.3/maintenance/: SWAT: [[gerrit:433367|Deduplicate archive.ar_rev_id]] (duration: 01m 30s) | [production] | 
            
  | 13:38 | <addshore@tin> | Synchronized php-1.32.0-wmf.4/autoload.php: SWAT: [[gerrit:433368|Deduplicate archive.ar_rev_id]] (duration: 01m 21s) | [production] | 
            
  | 13:37 | <jynus> | restart dbstore2002 for upgrade | [production] | 
            
  | 13:36 | <addshore@tin> | Synchronized php-1.32.0-wmf.4/includes/installer/DatabaseUpdater.php: SWAT: [[gerrit:433368|Deduplicate archive.ar_rev_id]] (duration: 01m 21s) | [production] |