| 2018-09-27
      
      ยง | 
    
  | 15:07 | <XioNoX> | add peering with Telin in esams | [production] | 
            
  | 15:03 | <arturo> | T196507 2h downtime cloudvirt1019 in icinga | [production] | 
            
  | 15:02 | <moritzm> | rebooting labtestvirt2003 for microcode tests | [production] | 
            
  | 14:48 | <cmjohnson1> | disabling checks on cloudvirt1019 to replace raid controller cable T196507 | [production] | 
            
  | 14:29 | <banyek> | converting srwiki.pagelinks to TokuDB on host dbstore1002 (T205544) | [production] | 
            
  | 13:49 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T205514: revert: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 56s) | [production] | 
            
  | 13:46 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T205514: revert: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 55s) | [production] | 
            
  | 13:44 | <moritzm> | installing ca-certificates updates for jessie/stretch | [production] | 
            
  | 13:41 | <banyek> | repooling db1104 (T205514) | [production] | 
            
  | 13:34 | <moritzm> | installing postgres security updates on labsdb1004 | [production] | 
            
  | 13:17 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.23 | [production] | 
            
  | 13:13 | <godog> | repair /dev/sdh1 on ms-be2042 - T199198 | [production] | 
            
  | 12:24 | <gehel> | reboot of wdqs2004-2006 for kernel upgrade | [production] | 
            
  | 12:11 | <moritzm> | installing libapache2-mod-perl2 security updates | [production] | 
            
  | 11:45 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 11:44 | <zfilipin@deploy1001> | Synchronized php-1.32.0-wmf.23/extensions/ContentTranslation/: SWAT: [[gerrit:463232|Use numerical option when setting CX version preference (T205493)]] (duration: 00m 57s) | [production] | 
            
  | 10:50 | <addshore@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: NOOP phpdoc comment changes pt2/2 (duration: 00m 56s) | [production] | 
            
  | 10:48 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: NOOP phpdoc comment changes pt1/2 (duration: 00m 56s) | [production] | 
            
  | 10:41 | <godog> | stop icinga-wm temporarily | [production] | 
            
  | 09:54 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T205514: depooling db1104, adding db1109 as temproray api host for s8 (duration: 00m 56s) | [production] | 
            
  | 09:35 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-19 (duration: 00m 56s) | [production] | 
            
  | 09:15 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-15 (duration: 00m 57s) | [production] | 
            
  | 09:04 | <moritzm> | rebooting ores1* for kernel security updates | [production] | 
            
  | 08:56 | <banyek> | stopping replocication & mariadb on db1104 and db1092 as db1092 is getting recloned from db1104 (T205514) | [production] | 
            
  | 08:54 | <godog> | test formatting sde on ms-be1040 with crc=0 - T199198 | [production] | 
            
  | 08:48 | <marostegui> | Deploy schema change on labswiki (db1073 master) - T203709 | [production] | 
            
  | 08:39 | <marostegui> | Deploy schema change on labtestwiki - T203709 | [production] | 
            
  | 08:30 | <banyek> | upgrading db1104 (kernel-mariadb) and rebooting it (T205514) | [production] | 
            
  | 07:58 | <banyek> | rebooting db1108 for kernel & mariadb upgrade (T205288) | [production] | 
            
  | 07:55 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-12 (duration: 00m 55s) | [production] | 
            
  | 07:54 | <addshore@deploy1001> | sync-file aborted: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-08 (duration: 00m 01s) | [production] | 
            
  | 07:53 | <jynus> | enabling puppet back on all db hosts | [production] | 
            
  | 07:45 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-08 (duration: 00m 55s) | [production] | 
            
  | 07:30 | <godog> | test formatting sdd on ms-be1040 with crc=0 - T199198 | [production] | 
            
  | 07:29 | <addshore@deploy1001> | Synchronized wmf-config/CommonSettings.php: [[gerrit:463203|RejectParserCacheValue Hook to purge wikidatawiki to 2018-09-06]] (duration: 00m 57s) | [production] | 
            
  | 07:27 | <godog> | test formatting sdc on ms-be1040 with crc=0 - T199198 | [production] | 
            
  | 07:26 | <jynus> | enabling puppet on all core eqiad hosts | [production] | 
            
  | 07:08 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1089 (duration: 00m 55s) | [production] | 
            
  | 07:05 | <jynus> | disablingh puppet on all databases | [production] | 
            
  | 07:00 | <marostegui> | Stop replication in sync on db1089 and dbstore1002:s1 | [production] | 
            
  | 06:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1089 (duration: 00m 56s) | [production] | 
            
  | 06:17 | <marostegui> | Deploy schema change on dbstore2002:3311 | [production] | 
            
  | 05:41 | <marostegui> | Deploy schema change on s1 eqiad master, lag will be generated - T203709 | [production] | 
            
  | 05:40 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Repool db2072 (duration: 00m 57s) | [production] | 
            
  | 05:26 | <marostegui> | Drop wikiuser on dbstore1002 | [production] | 
            
  | 05:21 | <marostegui> | Deploy schema change on db2072 | [production] | 
            
  | 05:21 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Depool db2072 (duration: 01m 00s) | [production] | 
            
  | 03:04 | <l10nupdate@deploy1001> | ResourceLoader cache refresh completed at Thu Sep 27 03:04:40 UTC 2018 (duration 10m 51s) | [production] | 
            
  | 02:53 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.23) (duration: 07m 16s) | [production] | 
            
  | 02:41 | <onimisionipe> | starting inplace reindexing of viwiki and commonswiki - T204362 | [production] |