| 2018-04-03
      
      § | 
    
  | 13:21 | <marostegui> | Reimport  s51541_sulwatcher.logging from master to slave - T191020 | [production] | 
            
  | 13:18 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1077 after alter table (duration: 00m 58s) | [production] | 
            
  | 13:18 | <elukey> | roll restart of zookeeper on conf200[123] to pick up prometheus monitoring settings | [production] | 
            
  | 12:57 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1077 after alter table (duration: 00m 59s) | [production] | 
            
  | 11:19 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after alter table (duration: 00m 58s) | [production] | 
            
  | 11:16 | <godog> | deploy thumbor 1.16 in codfw | [production] | 
            
  | 11:06 | <moritzm> | installing libdatetime-timezone-perl update from Debian SUA | [production] | 
            
  | 09:51 | <godog> | deploy thumbor 1.16 in codfw and eqiad - T186528 T179200 T189647 T191028 | [production] | 
            
  | 08:46 | <marostegui> | Deploy schema change on db1077 - s3 - T187089 T185128 T153182 | [production] | 
            
  | 08:41 | <moritzm> | upgrading HHVM on video scalers | [production] | 
            
  | 08:40 | <volans> | temporarily disabled puppet (and re-enabling it one-by-one) on all prod puppetmasters to deploy g/422907 - T190918 | [production] | 
            
  | 08:36 | <marostegui> | Stop MySQL on db1077 for mysql and kernel upgrade | [production] | 
            
  | 08:35 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1077 for alter table (duration: 00m 59s) | [production] | 
            
  | 08:29 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Restore original weight for db1078 (duration: 00m 58s) | [production] | 
            
  | 08:29 | <godog> | codfw-prod: more weight to ms-be204[0-3] - T189633 | [production] | 
            
  | 08:14 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) | [production] | 
            
  | 08:01 | <elukey> | restart of druid-(overlord|middlemanager) on druid1004[456] as precautionary measure after zk restart | [production] | 
            
  | 08:01 | <moritzm> | uploaded HHVM 3.18.5-dfsg-1+wmf5+deb9u1 for stretch-security to apt.wikimedia.org | [production] | 
            
  | 08:00 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) | [production] | 
            
  | 07:50 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) | [production] | 
            
  | 07:50 | <elukey> | roll restart zookeeper on druid100[456] to enable prometheus monitoring | [production] | 
            
  | 07:32 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1078 with low weight (duration: 00m 58s) | [production] | 
            
  | 07:12 | <jynus> | upgrade and restart of labsdb1010 | [production] | 
            
  | 07:10 | <marostegui> | Stop MySQL on db1078 for mariadb and kernel upgrade | [production] | 
            
  | 06:43 | <elukey> | execute systemctl reset-failed kafka-mirror-main-eqiad_to_jumbo-eqiad.service on kafka102[23] | [production] | 
            
  | 06:18 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Change db2035 rack comment (duration: 00m 58s) | [production] | 
            
  | 05:37 | <marostegui> | Deploy schema change on db1078 - s3 - T187089 T185128 T153182 | [production] | 
            
  | 05:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1078 for alter table (duration: 00m 59s) | [production] | 
            
  | 05:18 | <marostegui> | Enable back gtid on db2035 - T191193 | [production] | 
            
  | 02:44 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.27) (duration: 19m 03s) | [production] | 
            
  | 00:11 | <Amir1> | Evening SWAT is done | [production] | 
            
  
    | 2018-04-02
      
      § | 
    
  | 23:56 | <ladsgroup@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:405550|Add several domains of Ukraine government to wgCopyUploadsDomains (T185399)]] (duration: 00m 59s) | [production] | 
            
  | 23:45 | <ladsgroup@tin> | Synchronized tests/cirrusTest.php: [[gerrit:423532|Shift all search traffic to codfw, part II (T191236)]] (duration: 00m 58s) | [production] | 
            
  | 23:44 | <ladsgroup@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:423532|Shift all search traffic to codfw (T191236)]] (duration: 00m 59s) | [production] | 
            
  | 23:29 | <Amir1> | Persian Wikipedia logos have been purged using purgeList.php on terbium | [production] | 
            
  | 23:26 | <ladsgroup@tin> | Synchronized static/images/project-logos: [[gerrit:423562|Update logo for the Persian Wikipedia (T191174)]] (duration: 00m 59s) | [production] | 
            
  | 22:41 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.27/includes/libs/CSSMin.php: sync https://gerrit.wikimedia.org/r/423574 (duration: 00m 58s) | [production] | 
            
  | 22:11 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.27 | [production] | 
            
  | 21:59 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.27/includes/libs/CSSMin.php: (no justification provided) (duration: 01m 16s) | [production] | 
            
  | 21:28 | <twentyafterfour@tin> | Synchronized php: group1 wikis to 1.31.0-wmf.27 (duration: 01m 14s) | [production] | 
            
  | 21:26 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: group1 wikis to 1.31.0-wmf.27 | [production] | 
            
  | 21:22 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.27/includes/libs/rdbms/database/: Revert ceb7d61ee7ef3edc6705abd41ec86b3afcd9c491 refs T183966 T190960 (duration: 00m 59s) | [production] | 
            
  | 21:09 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.26 | [production] | 
            
  | 20:59 | <twentyafterfour> | MediaWiki Train: rolling back to 1.31.0-wmf.26 refs T183966, T190960 | [production] | 
            
  | 20:38 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.27/includes/libs/rdbms/database/DatabaseMysqlBase.php: sync 36c52351487aa70a651dbc6157e0a5882dfd9e7f refs T190960 (duration: 01m 16s) | [production] | 
            
  | 20:22 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@940bd48]: Update mobileapps to 58a0a88 (duration: 05m 52s) | [production] | 
            
  | 20:17 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@940bd48]: Update mobileapps to 58a0a88 | [production] | 
            
  | 19:56 | <herron> | puppetdb postgres update complete — puppet agents re-enabled | [production] | 
            
  | 19:46 | <herron> | temporarily disabling puppet agents for puppetdb postgres security update | [production] | 
            
  | 19:41 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.27/includes/libs/rdbms/database/DatabaseMysqlBase.php: sync 779e7fd3de08101ab626136c07045c98ea162c5b refs T190960 (duration: 01m 16s) | [production] |