| 
      
        2016-06-07
      
      §
     | 
  
    
  | 19:44 | 
  <jynus> | 
  restarting es2017 due to a bunch of ACPI errors (probably memory-caused) | 
  [production] | 
            
  | 19:35 | 
  <thcipriani@tin> | 
  Finished scap: testwiki to php-1.28.0-wmf.5 and rebuild l10n cache (duration: 26m 40s) | 
  [production] | 
            
  | 19:08 | 
  <thcipriani@tin> | 
  Started scap: testwiki to php-1.28.0-wmf.5 and rebuild l10n cache | 
  [production] | 
            
  | 18:30 | 
  <andrewbogott> | 
  rebooting labvirt1011 | 
  [production] | 
            
  | 17:51 | 
  <ottomata> | 
  restarting broker on kafka1020 | 
  [production] | 
            
  | 17:44 | 
  <Dereckson> | 
  `mwscript initSiteStats.php --wiki kshwiki --update` on Terbium (T137234) | 
  [production] | 
            
  | 17:33 | 
  <mutante> | 
  furud - shutdown, decom, deleteV VM | 
  [production] | 
            
  | 17:30 | 
  <ejegg> | 
  updated payments-wiki from 3df3329f75fdbc679baf37bfd3955880091b3ae1 to 28e10141454ef53085aed4c6619a34d3a4b43c58 | 
  [production] | 
            
  | 17:06 | 
  <krinkle@tin> | 
  Synchronized wmf-config/CommonSettings.php: clean-up | 
  [production] | 
            
  | 17:05 | 
  <ejegg> | 
  rolled back payments-wiki to 3df3329f75fdbc679baf37bfd3955880091b3ae1 | 
  [production] | 
            
  | 17:04 | 
  <thcipriani> | 
  starting branch-cut for mediawiki and extensions for version 1.28.0-wmf.5 | 
  [production] | 
            
  | 17:04 | 
  <ejegg> | 
  updated payments-wiki from 3df3329f75fdbc679baf37bfd3955880091b3ae1 to 413bd3ea92ac570c081532c71891c31391194984 | 
  [production] | 
            
  | 16:01 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:293091|Update audit hooks for AuthManager]] (duration: 00m 24s) | 
  [production] | 
            
  | 15:53 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/wikitech.php: SWAT: [[gerrit:293086|Do not set wgAuth to LdapAuth when AuthManager is enabled]] (duration: 00m 23s) | 
  [production] | 
            
  | 15:48 | 
  <thcipriani@tin> | 
  Synchronized portals: SWAT: [[gerrit:293110|T135902 adding readme and license to wikipedia.org portal]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:48 | 
  <thcipriani@tin> | 
  Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:293110|T135902 adding readme and license to wikipedia.org portal]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:41 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:292964|huwiki: Enable Popups A/B test for 50% of users]] (duration: 00m 24s) | 
  [production] | 
            
  | 15:32 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT: [[gerrit:292938|Revert "Send wmf.4 search and ttmserver traffic to codfw"]] (duration: 00m 26s) | 
  [production] | 
            
  | 15:24 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/PrivateSettings.php: SWAT: [[gerrit:292898|Use bot password for TNBot]] after touch wmf-config/PrivateSettings.php (duration: 00m 25s) | 
  [production] | 
            
  | 15:16 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:292898|Use bot password for TNBot]] (duration: 00m 34s) | 
  [production] | 
            
  | 15:15 | 
  <thcipriani@tin> | 
  Synchronized private/PrivateSettings.php: SWAT: password update for Translation Notification Bot (duration: 00m 41s) | 
  [production] | 
            
  | 14:47 | 
  <elukey> | 
  installing varnishkafka 1.0.10-1 on cp1046 manually to test the new version. | 
  [production] | 
            
  | 14:23 | 
  <jynus> | 
  stopping mysql and the OS @ es2017 for hardware maintenance | 
  [production] | 
            
  | 13:53 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Pool new s5 db hosts: db1082, db1087, db1092 with low weight (duration: 00m 23s) | 
  [production] | 
            
  | 13:52 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Add new coredb servers to alias configuration (duration: 00m 38s) | 
  [production] | 
            
  | 13:49 | 
  <jynus> | 
  about to pool new dewiki/wikidata servers T133398 | 
  [production] | 
            
  | 12:27 | 
  <moritzm> | 
  rolling out gdk-pixbuf security updates | 
  [production] | 
            
  | 12:23 | 
  <moritzm> | 
  rolling restart of sca cluster for libxml2 security update | 
  [production] | 
            
  | 11:27 | 
  <moritzm> | 
  restarting apache2 on californium (hosting horizon dashboard) for libxml2 update | 
  [production] | 
            
  | 11:23 | 
  <moritzm> | 
  restarting apache2 on silver (hosting wikitech) for libxml2 update | 
  [production] | 
            
  | 11:08 | 
  <hashar> | 
  restarted apache2 on gallium for libxml2 update | 
  [production] | 
            
  | 10:53 | 
  <moritzm> | 
  restarting apache2 on iridium (hosting Phabricator) for libxml2 update | 
  [production] | 
            
  | 10:18 | 
  <moritzm> | 
  rolling restart of hhvm on eqiad appservers to pick up libxml2 update | 
  [production] | 
            
  | 09:09 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1070 after maintenance (duration: 00m 27s) | 
  [production] | 
            
  | 09:04 | 
  <hashar> | 
  Upgrading Jenkins IRC plugin 2.25..2.27 and instant messaging plugin 1.34..1.35  . The former should fix a deadlock on shutdowning Jenkins | 
  [production] | 
            
  | 09:00 | 
  <moritzm> | 
  rolling restart of hhvm on codfw appservers to pick up libxml2 update | 
  [production] | 
            
  | 08:53 | 
  <moritzm> | 
  rolling restart of hhvm on appserver canaries to pick up libxml2 update | 
  [production] | 
            
  | 08:28 | 
  <moritzm> | 
  deploying libxml2 security updates on Ubuntu systems (Debian systems already upgraded last week) | 
  [production] | 
            
  | 07:19 | 
  <jynus> | 
  stopping and cloning db1070 to new s5 servers | 
  [production] | 
            
  | 07:08 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1070 for cloning (duration: 00m 29s) | 
  [production] | 
            
  | 02:30 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Jun  7 02:30:57 UTC 2016 (duration 5m 32s) | 
  [production] | 
            
  | 02:25 | 
  <mwdeploy@tin> | 
  scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 36s) | 
  [production] | 
            
  | 01:10 | 
  <aude@tin> | 
  Synchronized php-1.28.0-wmf.4/extensions/Wikidata: Fix bug (T136093) in display of labels after edit (duration: 02m 03s) | 
  [production] | 
            
  | 00:39 | 
  <Krenair> | 
  (TXT record for SPF, actually) | 
  [production] | 
            
  | 00:39 | 
  <Krenair> | 
  Created MX and SPF records directly for wmflabs.org. for https://phabricator.wikimedia.org/T137160#2359786 | 
  [production] | 
            
  | 00:35 | 
  <ejegg> | 
  updated settings on payments-wiki | 
  [production] | 
            
  | 00:26 | 
  <ori@tin> | 
  Synchronized php-1.28.0-wmf.4/extensions/CentralAuth/includes/CentralAuthHooks.php: I79cbb1dc: Prefetch $wgCentralAuthLoginWiki DNS (T92864) (duration: 00m 29s) | 
  [production] |