| 2018-01-11
      
      § | 
    
  | 08:55 | <marostegui> | Upgrade db1110 kernel - T184256 | [production] | 
            
  | 08:36 | <moritzm> | powercycling wtp2013 (apparently didn't come back up after reboot) | [production] | 
            
  | 08:27 | <marostegui> | Fix data drifts on enwiki.archive on codfw - T162807 | [production] | 
            
  | 08:21 | <gehel@puppetmaster1001> | conftool action : set/pooled=no; selector: name=logstash1007.eqiad.wmnet | [production] | 
            
  | 08:17 | <gehel> | rolling restart of logstash for kernel upgrade | [production] | 
            
  | 07:50 | <marostegui> | Deploy schema change on db1110 - T174569 | [production] | 
            
  | 07:50 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1110 - T174569 (duration: 01m 03s) | [production] | 
            
  | 07:47 | <moritzm> | reboot remaining mediawiki API servers for kernel security update (along with update to HHVM 3.18.6) | [production] | 
            
  | 07:44 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1082 - T174569 (duration: 01m 03s) | [production] | 
            
  | 07:24 | <marostegui> | Drop external_user table from s3 - T184247 | [production] | 
            
  | 07:17 | <foks> | Removed 2FA from Amjaabc | [production] | 
            
  | 07:12 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 db1099:3318 - T162807 T184256 (duration: 01m 02s) | [production] | 
            
  | 06:32 | <marostegui> | Deploy schema change on db1082.s5 with replication (this will generate lag on labs) - T174569 | [production] | 
            
  | 06:32 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1082 - T174569 (duration: 01m 02s) | [production] | 
            
  | 06:25 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 - T174569 (duration: 01m 03s) | [production] | 
            
  | 06:21 | <marostegui> | Upgrade mariadb+kernel on db1089 | [production] | 
            
  | 06:17 | <marostegui> | Force BBU relearn on db1059 - T184160 | [production] | 
            
  | 02:37 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.15) (duration: 11m 10s) | [production] | 
            
  | 00:57 | <urandom> | bootstrapping restbase1011-c -- T184100 | [production] | 
            
  
    | 2018-01-10
      
      § | 
    
  | 23:50 | <eileen> | civicrm revision changed from 429a5c5385 to 354f32fe8a, deploy contact change, contact search fixes, install cleanup | [production] | 
            
  | 21:57 | <twentyafterfour> | group1 looks stable. This concludes the MediaWiki train for today. | [production] | 
            
  | 21:54 | <twentyafterfour@tin> | Synchronized php: group1 wikis to 1.31.0-wmf.16 (duration: 01m 02s) | [production] | 
            
  | 21:53 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: group1 wikis to 1.31.0-wmf.16 | [production] | 
            
  | 21:47 | <twentyafterfour@tin> | Finished scap: group0 to 1.31.0-wmf.16 refs T180749 (duration: 38m 29s) | [production] | 
            
  | 21:09 | <twentyafterfour@tin> | Started scap: group0 to 1.31.0-wmf.16 refs T180749 | [production] | 
            
  | 20:49 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.16: Sync wmf.16 to deploy multiple patches from addshore refs T180749 (duration: 10m 23s) | [production] | 
            
  | 20:14 | <otto@tin> | Finished deploy [eventstreams/deploy@ee854df]: Update eventstreams with newer service-template-node: T171011 (duration: 04m 11s) | [production] | 
            
  | 20:09 | <otto@tin> | Started deploy [eventstreams/deploy@ee854df]: Update eventstreams with newer service-template-node: T171011 | [production] | 
            
  | 20:09 | <otto@tin> | Finished deploy [eventstreams/deploy@ee854df]: Update eventstreams deploy test to scb2002: T171011 (duration: 00m 24s) | [production] | 
            
  | 20:09 | <otto@tin> | Started deploy [eventstreams/deploy@ee854df]: Update eventstreams deploy test to scb2002: T171011 | [production] | 
            
  | 20:05 | <jynus> | upgrade and restart dbstore2002 | [production] | 
            
  | 20:00 | <jynus> | upgrade and restart dbstore2001 | [production] | 
            
  | 19:45 | <jynus> | upgrade and restart db2047 | [production] | 
            
  | 19:32 | <urandom> | bootstrapping restbase1011-b -- T184100 | [production] | 
            
  | 19:22 | <thcipriani@tin> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:403432|Add throttle rule for Paris University and sort other by date]] T184618 (duration: 01m 03s) | [production] | 
            
  | 19:00 | <jynus> | upgrade and restart db1059 | [production] | 
            
  | 18:45 | <chasemp> | reboot labtestvirt2002.codfw.wmnet w/ new kernel | [production] | 
            
  | 18:40 | <andrewbogott> | upgrading labvirt1018 kernel and rebooting | [production] | 
            
  | 18:23 | <jynus> | upgrade and restart db2040 | [production] | 
            
  | 17:59 | <jynus> | upgrade and restart db2087 | [production] | 
            
  | 17:48 | <andrewbogott> | installing linux-image-generic-lts-xenial on labtestvirt2003 | [production] | 
            
  | 17:44 | <jynus> | upgrade and restart db2086 | [production] | 
            
  | 16:55 | <elukey> | reboot analytics1047->50 for kernel updates | [production] | 
            
  | 16:43 | <akosiaris> | wtp* rolling restarts for meltdown finished | [production] | 
            
  | 16:39 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1006.eqiad.wmnet | [production] | 
            
  | 16:38 | <filippo@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=ms-fe1008.eqiad.wmnet | [production] | 
            
  | 16:35 | <godog> | bounce thumbor-instances on thumbor1001 | [production] | 
            
  | 16:26 | <anomie> | Running cleanupUsersWithNoId.php on dewiki and wikidatawiki | [production] | 
            
  | 16:22 | <ottomata> | restarting kafka jumbo brokers to apply java.security certpath restrictions | [production] | 
            
  | 16:08 | <godog> | roll-restart swift frontend in eqiad for kernel upgrade | [production] |