| 2016-06-07
      
      § | 
    
  | 23:46 | <aaron@tin> | Synchronized php-1.28.0-wmf.5/includes/deferred/LinksUpdate.php: 6d85caaa9bb5918cb2888fc82f2c7c346cf746a2 (duration: 00m 25s) | [production] | 
            
  | 23:35 | <SMalyshev> | redeploying WDQS to update the Updater for T128947 fix | [production] | 
            
  | 23:35 | <tgr@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:292518]] User rights configuration for meta. wmf-supportsafety group (duration: 00m 26s) | [production] | 
            
  | 23:20 | <tgr@tin> | Finished scap: (no message) (duration: 24m 51s) | [production] | 
            
  | 23:02 | <awight> | update paymentswiki from 28e10141454ef53085aed4c6619a34d3a4b43c58 to de11bfe2273d0bcaa0e713389b2d91e8b3567a1d; add PP cert | [production] | 
            
  | 22:56 | <tgr> | scapping AuthManager backports + feature switch enabled on group0 T135504 | [production] | 
            
  | 22:56 | <tgr@tin> | Started scap: (no message) | [production] | 
            
  | 22:10 | <mutante> | icinga config broken: Error: Could not find any host matching 'relforge1001' | [production] | 
            
  | 21:35 | <twentyafterfour> | restarted apache on iridium to deploy D250 | [production] | 
            
  | 20:02 | <andrewbogott> | dist-upgrade on labvirt1010, in hopes of resolving a nova-compute lockup (possibly related to a kvm upgrade earlier today) | [production] | 
            
  | 20:00 | <thcipriani@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.28.0-wmf.5 | [production] | 
            
  | 19:44 | <jynus> | restarting es2017 due to a bunch of ACPI errors (probably memory-caused) | [production] | 
            
  | 19:35 | <thcipriani@tin> | Finished scap: testwiki to php-1.28.0-wmf.5 and rebuild l10n cache (duration: 26m 40s) | [production] | 
            
  | 19:08 | <thcipriani@tin> | Started scap: testwiki to php-1.28.0-wmf.5 and rebuild l10n cache | [production] | 
            
  | 18:30 | <andrewbogott> | rebooting labvirt1011 | [production] | 
            
  | 17:51 | <ottomata> | restarting broker on kafka1020 | [production] | 
            
  | 17:44 | <Dereckson> | `mwscript initSiteStats.php --wiki kshwiki --update` on Terbium (T137234) | [production] | 
            
  | 17:33 | <mutante> | furud - shutdown, decom, deleteV VM | [production] | 
            
  | 17:30 | <ejegg> | updated payments-wiki from 3df3329f75fdbc679baf37bfd3955880091b3ae1 to 28e10141454ef53085aed4c6619a34d3a4b43c58 | [production] | 
            
  | 17:06 | <krinkle@tin> | Synchronized wmf-config/CommonSettings.php: clean-up | [production] | 
            
  | 17:05 | <ejegg> | rolled back payments-wiki to 3df3329f75fdbc679baf37bfd3955880091b3ae1 | [production] | 
            
  | 17:04 | <thcipriani> | starting branch-cut for mediawiki and extensions for version 1.28.0-wmf.5 | [production] | 
            
  | 17:04 | <ejegg> | updated payments-wiki from 3df3329f75fdbc679baf37bfd3955880091b3ae1 to 413bd3ea92ac570c081532c71891c31391194984 | [production] | 
            
  | 16:01 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:293091|Update audit hooks for AuthManager]] (duration: 00m 24s) | [production] | 
            
  | 15:53 | <thcipriani@tin> | Synchronized wmf-config/wikitech.php: SWAT: [[gerrit:293086|Do not set wgAuth to LdapAuth when AuthManager is enabled]] (duration: 00m 23s) | [production] | 
            
  | 15:48 | <thcipriani@tin> | Synchronized portals: SWAT: [[gerrit:293110|T135902 adding readme and license to wikipedia.org portal]] (duration: 00m 25s) | [production] | 
            
  | 15:48 | <thcipriani@tin> | Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:293110|T135902 adding readme and license to wikipedia.org portal]] (duration: 00m 25s) | [production] | 
            
  | 15:41 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:292964|huwiki: Enable Popups A/B test for 50% of users]] (duration: 00m 24s) | [production] | 
            
  | 15:32 | <thcipriani@tin> | Synchronized wmf-config: SWAT: [[gerrit:292938|Revert "Send wmf.4 search and ttmserver traffic to codfw"]] (duration: 00m 26s) | [production] | 
            
  | 15:24 | <thcipriani@tin> | Synchronized wmf-config/PrivateSettings.php: SWAT: [[gerrit:292898|Use bot password for TNBot]] after touch wmf-config/PrivateSettings.php (duration: 00m 25s) | [production] | 
            
  | 15:16 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:292898|Use bot password for TNBot]] (duration: 00m 34s) | [production] | 
            
  | 15:15 | <thcipriani@tin> | Synchronized private/PrivateSettings.php: SWAT: password update for Translation Notification Bot (duration: 00m 41s) | [production] | 
            
  | 14:47 | <elukey> | installing varnishkafka 1.0.10-1 on cp1046 manually to test the new version. | [production] | 
            
  | 14:23 | <jynus> | stopping mysql and the OS @ es2017 for hardware maintenance | [production] | 
            
  | 13:53 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Pool new s5 db hosts: db1082, db1087, db1092 with low weight (duration: 00m 23s) | [production] | 
            
  | 13:52 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Add new coredb servers to alias configuration (duration: 00m 38s) | [production] | 
            
  | 13:49 | <jynus> | about to pool new dewiki/wikidata servers T133398 | [production] | 
            
  | 12:27 | <moritzm> | rolling out gdk-pixbuf security updates | [production] | 
            
  | 12:23 | <moritzm> | rolling restart of sca cluster for libxml2 security update | [production] | 
            
  | 11:27 | <moritzm> | restarting apache2 on californium (hosting horizon dashboard) for libxml2 update | [production] | 
            
  | 11:23 | <moritzm> | restarting apache2 on silver (hosting wikitech) for libxml2 update | [production] | 
            
  | 11:08 | <hashar> | restarted apache2 on gallium for libxml2 update | [production] | 
            
  | 10:53 | <moritzm> | restarting apache2 on iridium (hosting Phabricator) for libxml2 update | [production] | 
            
  | 10:18 | <moritzm> | rolling restart of hhvm on eqiad appservers to pick up libxml2 update | [production] | 
            
  | 09:09 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1070 after maintenance (duration: 00m 27s) | [production] | 
            
  | 09:04 | <hashar> | Upgrading Jenkins IRC plugin 2.25..2.27 and instant messaging plugin 1.34..1.35  . The former should fix a deadlock on shutdowning Jenkins | [production] | 
            
  | 09:00 | <moritzm> | rolling restart of hhvm on codfw appservers to pick up libxml2 update | [production] | 
            
  | 08:53 | <moritzm> | rolling restart of hhvm on appserver canaries to pick up libxml2 update | [production] | 
            
  | 08:28 | <moritzm> | deploying libxml2 security updates on Ubuntu systems (Debian systems already upgraded last week) | [production] | 
            
  | 07:19 | <jynus> | stopping and cloning db1070 to new s5 servers | [production] |