| 
      
        2018-09-27
      
      ยง
     | 
  
    
  | 15:03 | 
  <arturo> | 
  T196507 2h downtime cloudvirt1019 in icinga | 
  [production] | 
            
  | 15:02 | 
  <moritzm> | 
  rebooting labtestvirt2003 for microcode tests | 
  [production] | 
            
  | 14:48 | 
  <cmjohnson1> | 
  disabling checks on cloudvirt1019 to replace raid controller cable T196507 | 
  [production] | 
            
  | 14:29 | 
  <banyek> | 
  converting srwiki.pagelinks to TokuDB on host dbstore1002 (T205544) | 
  [production] | 
            
  | 13:49 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: T205514: revert: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 56s) | 
  [production] | 
            
  | 13:46 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: T205514: revert: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 55s) | 
  [production] | 
            
  | 13:44 | 
  <moritzm> | 
  installing ca-certificates updates for jessie/stretch | 
  [production] | 
            
  | 13:41 | 
  <banyek> | 
  repooling db1104 (T205514) | 
  [production] | 
            
  | 13:34 | 
  <moritzm> | 
  installing postgres security updates on labsdb1004 | 
  [production] | 
            
  | 13:17 | 
  <zfilipin@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.23 | 
  [production] | 
            
  | 13:13 | 
  <godog> | 
  repair /dev/sdh1 on ms-be2042 - T199198 | 
  [production] | 
            
  | 12:24 | 
  <gehel> | 
  reboot of wdqs2004-2006 for kernel upgrade | 
  [production] | 
            
  | 12:11 | 
  <moritzm> | 
  installing libapache2-mod-perl2 security updates | 
  [production] | 
            
  | 11:45 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 11:44 | 
  <zfilipin@deploy1001> | 
  Synchronized php-1.32.0-wmf.23/extensions/ContentTranslation/: SWAT: [[gerrit:463232|Use numerical option when setting CX version preference (T205493)]] (duration: 00m 57s) | 
  [production] | 
            
  | 10:50 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: NOOP phpdoc comment changes pt2/2 (duration: 00m 56s) | 
  [production] | 
            
  | 10:48 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: NOOP phpdoc comment changes pt1/2 (duration: 00m 56s) | 
  [production] | 
            
  | 10:41 | 
  <godog> | 
  stop icinga-wm temporarily | 
  [production] | 
            
  | 09:54 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: T205514: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 56s) | 
  [production] | 
            
  | 09:35 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-19 (duration: 00m 56s) | 
  [production] | 
            
  | 09:15 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-15 (duration: 00m 57s) | 
  [production] | 
            
  | 09:04 | 
  <moritzm> | 
  rebooting ores1* for kernel security updates | 
  [production] | 
            
  | 08:56 | 
  <banyek> | 
  stopping replocication & mariadb on db1104 and db1092 as db1092 is getting recloned from db1104 (T205514) | 
  [production] | 
            
  | 08:54 | 
  <godog> | 
  test formatting sde on ms-be1040 with crc=0 - T199198 | 
  [production] | 
            
  | 08:48 | 
  <marostegui> | 
  Deploy schema change on labswiki (db1073 master) - T203709 | 
  [production] | 
            
  | 08:39 | 
  <marostegui> | 
  Deploy schema change on labtestwiki - T203709 | 
  [production] | 
            
  | 08:30 | 
  <banyek> | 
  upgrading db1104 (kernel-mariadb) and rebooting it (T205514) | 
  [production] | 
            
  | 07:58 | 
  <banyek> | 
  rebooting db1108 for kernel & mariadb upgrade (T205288) | 
  [production] | 
            
  | 07:55 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-12 (duration: 00m 55s) | 
  [production] | 
            
  | 07:54 | 
  <addshore@deploy1001> | 
  sync-file aborted: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-08 (duration: 00m 01s) | 
  [production] | 
            
  | 07:53 | 
  <jynus> | 
  enabling puppet back on all db hosts | 
  [production] | 
            
  | 07:45 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-08 (duration: 00m 55s) | 
  [production] | 
            
  | 07:30 | 
  <godog> | 
  test formatting sdd on ms-be1040 with crc=0 - T199198 | 
  [production] | 
            
  | 07:29 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: [[gerrit:463203|RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-06]] (duration: 00m 57s) | 
  [production] | 
            
  | 07:27 | 
  <godog> | 
  test formatting sdc on ms-be1040 with crc=0 - T199198 | 
  [production] | 
            
  | 07:26 | 
  <jynus> | 
  enabling puppet on all core eqiad hosts | 
  [production] | 
            
  | 07:08 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1089 (duration: 00m 55s) | 
  [production] | 
            
  | 07:05 | 
  <jynus> | 
  disablingh puppet on all databases | 
  [production] | 
            
  | 07:00 | 
  <marostegui> | 
  Stop replication in sync on db1089 and dbstore1002:s1 | 
  [production] | 
            
  | 06:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1089 (duration: 00m 56s) | 
  [production] | 
            
  | 06:17 | 
  <marostegui> | 
  Deploy schema change on dbstore2002:3311 | 
  [production] | 
            
  | 05:41 | 
  <marostegui> | 
  Deploy schema change on s1 eqiad master, lag will be generated - T203709 | 
  [production] | 
            
  | 05:40 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2072 (duration: 00m 57s) | 
  [production] | 
            
  | 05:26 | 
  <marostegui> | 
  Drop wikiuser on dbstore1002 | 
  [production] | 
            
  | 05:21 | 
  <marostegui> | 
  Deploy schema change on db2072 | 
  [production] | 
            
  | 05:21 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2072 (duration: 01m 00s) | 
  [production] | 
            
  | 03:04 | 
  <l10nupdate@deploy1001> | 
  ResourceLoader cache refresh completed at Thu Sep 27 03:04:40 UTC 2018 (duration 10m 51s) | 
  [production] | 
            
  | 02:53 | 
  <l10nupdate@deploy1001> | 
  scap sync-l10n completed (1.32.0-wmf.23) (duration: 07m 16s) | 
  [production] | 
            
  | 02:41 | 
  <onimisionipe> | 
  starting inplace reindexing of viwiki and commonswiki - T204362 | 
  [production] | 
            
  | 02:35 | 
  <l10nupdate@deploy1001> | 
  scap sync-l10n completed (1.32.0-wmf.22) (duration: 13m 25s) | 
  [production] |