| 2014-11-25
      
      ยง | 
    
  | 23:06 | <Tim> | on osmium: removing stale static pcre and zip libraries in /usr/local , installed by hhvm | [production] | 
            
  | 22:50 | <ebernhardson> | Finished scap: Bump Echo and Flow in 1.25wmf9 for officewiki deployment (duration: 30m 17s) | [production] | 
            
  | 22:20 | <ebernhardson> | Started scap: Bump Echo and Flow in 1.25wmf9 for officewiki deployment | [production] | 
            
  | 22:20 | <ebernhardson> | Synchronized php-1.25wmf9/extensions/Echo/: Bump Echo in 1.25wmf9 (duration: 00m 08s) | [production] | 
            
  | 21:55 | <ejegg> | Synchronized wmf-config/CommonSettings.php: Turn CN client-side banner choice back on everywhere (duration: 00m 05s) | [production] | 
            
  | 21:39 | <ejegg> | Synchronized php-1.25wmf8/extensions/CentralNotice/: One more CentralNotice fix to get out ahead of the winter rush - wmf8 (duration: 00m 07s) | [production] | 
            
  | 21:22 | <ejegg> | Synchronized wmf-config/CommonSettings.php: Turn CN client-side banner choice back on for selected wmf9 wikis (duration: 00m 05s) | [production] | 
            
  | 21:15 | <ejegg> | Synchronized php-1.25wmf9/extensions/CentralNotice/: One more CentralNotice fix to get out ahead of the winter rush (duration: 00m 05s) | [production] | 
            
  | 20:53 | <Nemo_bis> | 100 % packet loss between esams and r1fra1.core.init7.net | [production] | 
            
  | 20:16 | <reedy> | Synchronized php-1.25wmf9/extensions/Wikidata: Ic070ce0beb142e100490940fddaa0bd36b8a50be (duration: 00m 14s) | [production] | 
            
  | 20:09 | <reedy> | Synchronized php-1.25wmf8/extensions/Wikidata: Ensure my sanity (duration: 00m 13s) | [production] | 
            
  | 19:49 | <bd808> | restarted elasticsearch on logstah1002 after OOM | [production] | 
            
  | 19:38 | <reedy> | Synchronized wmf-config/: Config updates (duration: 00m 06s) | [production] | 
            
  | 19:32 | <Reedy> | Created wikilove tables on zhwikivoyage | [production] | 
            
  | 19:28 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Non Wikipedias to 1.25wmf9 | [production] | 
            
  | 19:27 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Non Wikipedias to 1.25wmf9 | [production] | 
            
  | 19:18 | <reedy> | Synchronized php-1.25wmf8/extensions/Wikidata: I08946aac3 (duration: 00m 12s) | [production] | 
            
  | 19:18 | <reedy> | Synchronized php-1.25wmf9/extensions/CentralNotice: Ib4d23f2a588f58ef3abcbd8b0b500ad8534723cd (duration: 00m 06s) | [production] | 
            
  | 19:17 | <reedy> | Synchronized php-1.25wmf8/extensions/CentralNotice: Ib4d23f2a588f58ef3abcbd8b0b500ad8534723cd (duration: 00m 07s) | [production] | 
            
  | 18:28 | <csteipp> | deployed patches for T74222 and T72901 | [production] | 
            
  | 17:42 | <_joe_> | repooled mw1019-1032,mw1053 in the appservers pool | [production] | 
            
  | 17:13 | <_joe_> | depooled mw1019-1032 from the hhvm pool | [production] | 
            
  | 17:07 | <bd808> | Synchronized wmf-config/logging-labs.php: Update labs logging config (I1843dfd) (duration: 00m 06s) | [production] | 
            
  | 17:04 | <ori> | Synchronized wmf-config/CommonSettings.php: $wgPercentHHVM = 0 (duration: 00m 05s) | [production] | 
            
  | 17:00 | <anomie> | Synchronized php-1.25wmf9/includes/api: SWAT: API: Work around wfMangleFlashPolicy() [[gerrit:175596]] (duration: 00m 06s) | [production] | 
            
  | 16:53 | <anomie> | Synchronized php-1.25wmf9/includes: SWAT: Make calling wfMangleFlashPolicy configurable [[gerrit:175598]] (duration: 00m 09s) | [production] | 
            
  | 16:44 | <bd808> | Synchronized wmf-config/logging-labs.php: Update labs logging config (Ib8d8f8e) (duration: 00m 06s) | [production] | 
            
  | 16:36 | <bd808> | Synchronized wmf-config/logging-labs.php: Update labs logging config (Iaab0047) (duration: 00m 06s) | [production] | 
            
  | 16:24 | <ori> | Synchronized wmf-config/InitialiseSettings.php: Ibd888465: Remove HHVM beta feature (duration: 00m 05s) | [production] | 
            
  | 16:14 | <_joe_> | pooling mw1237-1258 in the appserver pool | [production] | 
            
  | 15:03 | <godog> | upload bcache-tools 1.0.7-1 to carbon | [production] | 
            
  | 12:15 | <_joe_> | pooling mw1221-mw1226 in the API pool | [production] | 
            
  | 06:37 | <YuviPanda> | restarted apache on strontium, was seeing transient puppetmaster fails | [production] | 
            
  | 06:08 | <mutante> | in respose to jenkins login issue reported by krinkle: /var/lib/jenkins/xml.config on gallium had "virt1000" value for LDAP, earlier Andrew made a switch from there to ldap-eqiad. fixed config, restarted jenkins | [production] | 
            
  | 06:06 | <mutante> | restarted gitblit | [production] | 
            
  | 04:31 | <jgage> | restarted jenkins | [production] | 
            
  | 04:22 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Tue Nov 25 04:22:50 UTC 2014 (duration 22m 49s) | [production] | 
            
  | 03:53 | <Krinkle> | Jenkins is unable to create new user sessions. Suspect LDAP is having issues. | [production] | 
            
  | 03:16 | <springle> | m2 db1020 rebuilt, but blocked from dbproxy1002 until replag=0 | [production] | 
            
  | 03:12 | <awight> | Synchronized wmf-config: Disabling CentralNotice client banner choice due to T75812 (duration: 00m 05s) | [production] | 
            
  | 02:31 | <LocalisationUpdate> | completed (1.25wmf9) at 2014-11-25 02:31:48+00:00 | [production] | 
            
  | 02:31 | <l10nupdate> | Synchronized php-1.25wmf9/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:18 | <LocalisationUpdate> | completed (1.25wmf8) at 2014-11-25 02:18:52+00:00 | [production] | 
            
  | 02:18 | <l10nupdate> | Synchronized php-1.25wmf8/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:15 | <mutante> | old-bugzilla now behind varnish too, cert issue should be gone | [production] | 
            
  | 02:07 | <bblack> | all LVS back to normal runtime state w/ new SSL config | [production] | 
            
  | 01:56 | <bblack> | switching off pybal on primary LVS in esams for HTTPS check | [production] | 
            
  | 01:54 | <bblack> | switching off pybal on primary LVS in eqiad for HTTPS check | [production] | 
            
  | 01:51 | <bblack> | esams+eqiad backup LVS converted to new ssl config (lvs100[45] + lvs300[34]) | [production] | 
            
  | 01:43 | <awight> | Synchronized php-1.25wmf9/extensions/CentralNotice: push CentralNotice updates (duration: 00m 05s) | [production] |