| 2014-07-24
      
      § | 
    
  | 16:38 | <hashar> | restarting Jenkins it is broken again | [production] | 
            
  | 16:10 | <reedy> | Synchronized wmf-config/InitialiseSettings.php: Swap wikimania2013wiki to wikimania2014wiki in wmgCentralAuthLoginIcon (duration: 00m 14s) | [production] | 
            
  | 15:55 | <bd808|deploy> | Fetched de8022b to /a/common on tin; prod no-op change needed for beta | [production] | 
            
  | 15:40 | <bd808|deploy> | Fetched c7ae85e to /a/common on tin; prod no-op needed for beta | [production] | 
            
  | 15:39 | <ottomata> | temporarily stopping puppet on analytics1027 | [production] | 
            
  | 15:14 | <reedy> | Synchronized wmf-config/InitialiseSettings-labs.php: Fix reference thumbnail settings syntax (duration: 00m 13s) | [production] | 
            
  | 15:13 | <cmjohnson1> | swapping disk 8 es1001 | [production] | 
            
  | 15:10 | <hashar> | Clearing out old Zuul references on operations/puppet.git  might cause merge errors | [production] | 
            
  | 15:10 | <yurik> | Synchronized php-1.24wmf14/extensions/ZeroBanner: (no message) (duration: 01m 07s) | [production] | 
            
  | 15:08 | <yurik> | Synchronized php-1.24wmf13/extensions/ZeroBanner: (no message) (duration: 01m 11s) | [production] | 
            
  | 14:30 | <yurik> | Synchronized wmf-config/mobile.php: Font for zero banner (duration: 01m 10s) | [production] | 
            
  | 13:38 | <hashar> | Deleting old Zuul references in the Zuul maintained repository /srv/ssd/zuul/git/mediawiki/core/ on gallium {{bug|68481}} . Should speed up merge operations on that repository. | [production] | 
            
  | 10:10 | <hashar> | Zuul code being installed on lanthanum.eqiad.wmnet  Will let us use a merger daemon there and the Zuul cloner client. {{gerrit|141758}} | [production] | 
            
  | 05:45 | <springle> | labsdb1002 work in progress; it may misbehave. see labs-l for updates | [production] | 
            
  | 03:57 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Jul 24 03:56:32 UTC 2014 (duration 56m 31s) | [production] | 
            
  | 03:09 | <LocalisationUpdate> | completed (1.24wmf14) at 2014-07-24 03:08:05+00:00 | [production] | 
            
  | 02:37 | <LocalisationUpdate> | completed (1.24wmf13) at 2014-07-24 02:36:35+00:00 | [production] | 
            
  | 00:44 | <ori> | installing linux-tools on mw1053 to run perf on jobrunner | [production] | 
            
  
    | 2014-07-23
      
      § | 
    
  | 23:59 | <maxsem> | Finished scap: Pick up messages forgotten during Zero deployment (duration: 26m 42s) | [production] | 
            
  | 23:39 | <ori> | running sync-common on mw1053.eqiad.wmnet | [production] | 
            
  | 23:32 | <maxsem> | Started scap: Pick up messages forgotten during Zero deployment | [production] | 
            
  | 23:26 | <maxsem> | Synchronized php-1.24wmf14/extensions/MultimediaViewer/: (no message) (duration: 00m 03s) | [production] | 
            
  | 23:26 | <maxsem> | Synchronized php-1.24wmf14/extensions/VisualEditor/: (no message) (duration: 00m 04s) | [production] | 
            
  | 23:19 | <maxsem> | Synchronized php-1.24wmf13/extensions/MobileFrontend/: (no message) (duration: 00m 04s) | [production] | 
            
  | 23:18 | <maxsem> | Synchronized php-1.24wmf14/extensions/MobileFrontend/: (no message) (duration: 00m 04s) | [production] | 
            
  | 22:39 | <mutante> | removed platinum from icinga | [production] | 
            
  | 22:36 | <_joe_> | installed mw1053 as the first hhvm jobrunner, currently stopped. Puppet disabled so that it won't restart the jobrunner automatically | [production] | 
            
  | 21:49 | <ori> | Synchronized wmf-config/CommonSettings.php: I2f366fa93: Use luastandalone on HHVM (duration: 00m 03s) | [production] | 
            
  | 21:17 | <hashar> | Zuul is all good. It just receives too many patches :-] | [production] | 
            
  | 20:31 | <bd808|deploy> | Updated /a/common to 07834a9 (beta cluster: use luastandalone); no sync needed | [production] | 
            
  | 20:30 | <subbu> | deployed parsoid version 47d4bc83 | [production] | 
            
  | 20:27 | <hashar> | Having no idea how to fix zuul. Restarting it and killing the whole queue :-/ | [production] | 
            
  | 20:14 | <mutante> | contacts.wm - set $base_url in default/settings.php to https URL, and $is_https='on' in bootstrap.inc (unpuppetized?) | [production] | 
            
  | 19:49 | <awight> | Synchronized php-1.24wmf14/extensions/CentralNotice: push many CentralNotice fixes, including GeoIP cookie and hide cookie (duration: 00m 05s) | [production] | 
            
  | 19:49 | <awight> | Synchronized php-1.24wmf13/extensions/CentralNotice: push many CentralNotice fixes, including GeoIP cookie and hide cookie (duration: 00m 05s) | [production] | 
            
  | 19:28 | <awight> | Synchronized php-1.24wmf14/extensions/CentralNotice: push many CentralNotice fixes, including GeoIP cookie and hide cookie (duration: 00m 04s) | [production] | 
            
  | 19:27 | <awight> | Synchronized php-1.24wmf13/extensions/CentralNotice: push many CentralNotice fixes, including GeoIP cookie and hide cookie (duration: 00m 04s) | [production] | 
            
  | 18:57 | <hashar> | reenabled Gearman plugin in Jenkins.  Jobs have been reregistered and seems to be proceeding again | [production] | 
            
  | 18:55 | <hashar> | back. attempting to fix jenkins | [production] | 
            
  | 18:38 | <yurik> | Synchronized php-1.24wmf14/extensions/: update to JsonConfig, ZeroBanner, ZeroPortal (duration: 01m 24s) | [production] | 
            
  | 18:36 | <hashar> | can't fix jenkins / zuul right now.  Will be stalled for at least half an hour | [production] | 
            
  | 18:35 | <yurik> | Synchronized php-1.24wmf13/extensions/: update to JsonConfig, ZeroBanner, ZeroPortal (duration: 01m 27s) | [production] | 
            
  | 18:34 | <hashar> | Jenkins disabled and reenabled Gearman plugin. The jobs were no more registered in Zuul gearman server :-( | [production] | 
            
  | 18:32 | <hashar> | Jenkins stalled | [production] | 
            
  | 17:45 | <hoo> | Synchronized wmf-config/InitialiseSettings-labs.php: (no message) (duration: 00m 07s) | [production] | 
            
  | 17:38 | <godog> | launched a script on ms-fe1001 to collect thumb stats, no impact expected | [production] | 
            
  | 17:11 | <awight> | Synchronized php-1.24wmf14/extensions/FundraisingTranslateWorkflow: automatic translate workflow fix for Fundraising/ pages on meta.wmo (duration: 00m 04s) | [production] | 
            
  | 15:38 | <reedy> | Synchronized php-1.24wmf14/extensions/Wikidata: touch (duration: 00m 15s) | [production] | 
            
  | 15:34 | <reedy> | Synchronized php-1.24wmf14/extensions/Wikidata: Fix css issue in entity suggester on Wikidata (duration: 00m 17s) | [production] | 
            
  | 15:19 | <reedy> | Synchronized php-1.24wmf14/resources/Resources.php: Fixing forgotten OOUI messages (duration: 00m 15s) | [production] |