| 
      
        2015-10-14
      
      §
     | 
  
    
  | 21:53 | 
  <akosiaris> | 
  restarted zotero on sca1001. complaining out of memory in logs | 
  [production] | 
            
  | 20:20 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: Also exclude timedtext ns from purges (duration: 00m 18s) | 
  [production] | 
            
  | 19:52 | 
  <robh> | 
  reenabled puppet agent on etherpad1001, was disabled for a few hours and no reason specified and no SAL entry | 
  [production] | 
            
  | 19:50 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Turn off the mw "warning" logging channel (duration: 00m 18s) | 
  [production] | 
            
  | 19:21 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: Tighten check on empty page purges (duration: 00m 18s) | 
  [production] | 
            
  | 19:11 | 
  <ori@tin> | 
  Synchronized wmf-config/CommonSettings.php: I1d7969a9d: Purge pages with blank content beyond the PP limit report, I38cba9d9b6a: Get strpos() parameters correct (duration: 00m 17s) | 
  [production] | 
            
  | 19:09 | 
  <ori@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: I3a8a750bb3: Enable T115505 log channel for I1d7969a (duration: 00m 17s) | 
  [production] | 
            
  | 18:06 | 
  <demon@tin> | 
  Synchronized wmf-config: (no message) (duration: 00m 19s) | 
  [production] | 
            
  | 17:59 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) | 
  [production] | 
            
  | 17:58 | 
  <demon@tin> | 
  Synchronized wmf-config/extension-list: (no message) (duration: 00m 17s) | 
  [production] | 
            
  | 15:31 | 
  <thcipriani@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: SWAT: Split connection to source and target [[gerrit:246243]] (duration: 00m 18s) | 
  [production] | 
            
  | 15:19 | 
  <thcipriani@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/UploadWizard/UploadWizard.config.php: SWAT: Remove default category for UploadWizard files [[gerrit:246225]] (duration: 00m 17s) | 
  [production] | 
            
  | 15:14 | 
  <ori> | 
  restarted navtiming and statsv services on hafnium | 
  [production] | 
            
  | 15:11 | 
  <thcipriani@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/UploadWizard/UploadWizard.config.php: SWAT: Remove default category for UploadWizard files [[gerrit:246226]] (duration: 00m 18s) | 
  [production] | 
            
  | 15:05 | 
  <Krinkle> | 
  Statsv and eventlogging-navtiming seems to have gone down 7 hours ago | 
  [production] | 
            
  | 14:24 | 
  <ori> | 
  cleaned up tessera leftovers on graphite1001 | 
  [production] | 
            
  | 14:15 | 
  <mutante|1way> | 
  mw1157 - deleted puppet lock file, fix puppet run. ("already running" but didnt since 18h) | 
  [production] | 
            
  | 13:30 | 
  <ottomata> | 
  kafka-preferred-replica election after kafka1012 | 
  [production] | 
            
  | 13:12 | 
  <ottomata> | 
  restarted diamond, puppet didn't seem to after it removed the TcpConnStates from most hosts | 
  [production] | 
            
  | 12:55 | 
  <hashar> | 
  ERROR: Could not connect to SMTP host: polonium.wikimedia.org, port: 25  (from labs instances) | 
  [production] | 
            
  | 12:32 | 
  <krenair@tin> | 
  Synchronized README: testing https://gerrit.wikimedia.org/r/246206 (duration: 00m 17s) | 
  [production] | 
            
  | 12:07 | 
  <krenair@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/VisualEditor/modules/ve-mw/ui/inspectors/ve.ui.MWLinkAnnotationInspector.js: https://gerrit.wikimedia.org/r/#/c/246205/ (duration: 01m 13s) | 
  [production] | 
            
  | 03:14 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed Oct 14 03:14:22 UTC 2015 (duration 14m 21s) | 
  [production] | 
            
  | 03:14 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-14 03:14:22+00:00 | 
  [production] | 
            
  | 03:07 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 10m 37s) | 
  [production] | 
            
  | 02:40 | 
  <l10nupdate@tin> | 
  LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-14 02:40:43+00:00 | 
  [production] | 
            
  | 02:37 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 07m 10s) | 
  [production] | 
            
  
    | 
      
        2015-10-13
      
      §
     | 
  
    
  | 23:30 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Set $wgUploadNavigationUrl to use uselang=$lang for commonsuploads wikis by default (duration: 01m 14s) | 
  [production] | 
            
  | 23:27 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/WikimediaEvents/: Turn on cirrus common terms test (duration: 01m 15s) | 
  [production] | 
            
  | 23:25 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/CirrusSearch/: Add information for common terms ab test (duration: 01m 15s) | 
  [production] | 
            
  | 23:20 | 
  <Krenair> | 
  restarted apache on silver | 
  [production] | 
            
  | 23:19 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.2/extensions/Flow: Make flow board descriptions editable again (duration: 01m 16s) | 
  [production] | 
            
  | 23:13 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/Flow: Bump flow submodule in 1.27.0-wmf.3 (duration: 01m 15s) | 
  [production] | 
            
  | 23:10 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/: Update WME for common terms AB test (duration: 01m 14s) | 
  [production] | 
            
  | 23:08 | 
  <ebernhardson@tin> | 
  Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch/: Update cirrus for common terms AB tes (duration: 01m 15s) | 
  [production] | 
            
  | 23:02 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Turn on logging of the "warning" channel (duration: 01m 13s) | 
  [production] | 
            
  | 21:05 | 
  <ottomata> | 
  reenabling puppet on cp1052 | 
  [production] | 
            
  | 20:51 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.3 | 
  [production] | 
            
  | 20:47 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/includes/db: I0e5f2d3b2: Revert Enforce lagged-slave read-only mode on the DB layer (duration: 01m 14s) | 
  [production] | 
            
  | 20:45 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.3/autoload.php: (no message) (duration: 01m 14s) | 
  [production] | 
            
  | 20:40 | 
  <akosiaris> | 
  restart gitblit (once more) | 
  [production] | 
            
  | 20:27 | 
  <_joe_> | 
  rebooting mw1157, stuck in a kernel soft lockup | 
  [production] | 
            
  | 20:22 | 
  <ori> | 
  locally hacked testwiki and mediawikiwiki to point to php-1.27.0-wmf.3 on mw1017 | 
  [production] | 
            
  | 20:19 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 | 
  [production] | 
            
  | 20:18 | 
  <ori@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: (no message) | 
  [production] | 
            
  | 20:00 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.3 | 
  [production] | 
            
  | 19:38 | 
  <JohnFLewis> | 
  delete wikidata-l mailing list (archives still accessible) | 
  [production] | 
            
  | 19:30 | 
  <twentyafterfour@tin> | 
  Finished scap: Full scap sync for 1.27.0-wmf.3 (duration: 31m 26s) | 
  [production] | 
            
  | 18:58 | 
  <twentyafterfour@tin> | 
  Started scap: Full scap sync for 1.27.0-wmf.3 | 
  [production] | 
            
  | 18:45 | 
  <ottomata> | 
  FYI i have puppet disabled on cp1052 while I try to figure out a diamond+VSL+multiprocessing bug | 
  [production] |