| 2014-03-28
      
      § | 
    
  | 03:56 | <Krinkle> | Rebuilding i18n using mw-update-l10n, syncing ExtensionMessages-1.23wmf20.php doesn't actually regenerate the cache | [production] | 
            
  | 03:55 | <RoanKattouw> | Running mw-update-l10n. Skipped wmf19, is now rebuilding l10ncache for wmf20 because I updated ExtensionMessages-1.23wmf20.php | [production] | 
            
  | 03:54 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Mar 28 03:54:22 UTC 2014 (duration 46m 33s) | [production] | 
            
  | 03:49 | <catrope> | synchronized wmf-config/ExtensionMessages-1.23wmf20.php  'Regenerated to add new JSON dirs that were missing' | [production] | 
            
  | 03:49 | <RoanKattouw> | Maybe the new scap scripts regenerate ExtensionMessages-$version.php at the wrong time (i.e. do things in the wrong order)? | [production] | 
            
  | 03:48 | <Krinkle> | So scap/mw-update-l10n (at branch cut) or LocalisationUpdate must've run mergeMessagesFileList.php  wrongly somehow | [production] | 
            
  | 03:46 | <RoanKattouw> | ExtensionMessages-1.23wmf20.php is out of date, regenerated | [production] | 
            
  | 03:33 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-03-28 03:33:49+00:00 | [production] | 
            
  | 03:27 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Mar 28 03:27:41 UTC 2014 (duration 27m 40s) | [production] | 
            
  | 03:19 | <LocalisationUpdate> | completed (1.23wmf19) at 2014-03-28 03:19:47+00:00 | [production] | 
            
  | 03:08 | <RoanKattouw> | Rerunning LocalisationUpdate in an attempt to figure out what's going on | [production] | 
            
  | 03:06 | <Krinkle> | All interface messages for of any extension in wmf20 that uses json is missing (mw-ui-feature-user-count, betafeatures-toplink, wikimediamessages-desc, )) | [production] | 
            
  | 02:53 | <Krinkle> | BetaFeatures is missing message "betafeatures-toplink" on every page on mediawiki.org | [production] | 
            
  | 02:51 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-03-28 02:51:49+00:00 | [production] | 
            
  | 02:34 | <springle> | synchronized wmf-config/db-eqiad.php  's7 increase db1007 temporarily' | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.23wmf19) at 2014-03-28 02:19:40+00:00 | [production] | 
            
  | 02:06 | <springle> | synchronized wmf-config/db-eqiad.php  's7 adjust loads' | [production] | 
            
  | 02:05 | <springle> | synchronized wmf-config/db-eqiad.php  's7 adjust loads' | [production] | 
            
  | 01:55 | <springle> | synchronized wmf-config/db-eqiad.php  's7 repool db1034' | [production] | 
            
  | 00:08 | <mwalker> | synchronized wmf-config/InitialiseSettings.php  'Attempting to poke frwikitionary into using VE' | [production] | 
            
  
    | 2014-03-27
      
      § | 
    
  | 23:58 | <mwalker> | synchronized php-1.23wmf19/extensions/LocalisationUpdate/  'Updating for {{Gerrit|121560}}' | [production] | 
            
  | 23:57 | <mwalker> | synchronized visualeditor.dblist  'Actually syncing for {{Gerrit|121439}}' | [production] | 
            
  | 23:56 | <mwalker> | synchronized visualeditor-default.dblist  'Actually syncing for {{Gerrit|121439}}' | [production] | 
            
  | 23:48 | <mwalker> | synchronized php-1.23wmf20/extensions/Wikidata/  'Updating Wikibase (not mulitmediaviewer) with {{Gerrit|121545}}...' | [production] | 
            
  | 23:45 | <mwalker> | synchronized php-1.23wmf19/extensions/Wikidata/  'Updating Wikibase (not multimedia viewer) with {{Gerrit|121544}}...' | [production] | 
            
  | 23:43 | <mwalker> | synchronized php-1.23wmf19/extensions/MultimediaViewer/  'Updating Wikibase with {{Gerrit|121544}}...' | [production] | 
            
  | 23:41 | <mwalker> | synchronized php-1.23wmf20/extensions/MultimediaViewer/  'Updating Wikibase with {{Gerrit|121545}}...' | [production] | 
            
  | 23:40 | <mwalker> | synchronized php-1.23wmf20/extensions/MultimediaViewer/  'Actually updating multimediaviewer with {{Gerrit|121555}}...' | [production] | 
            
  | 23:26 | <mwalker> | synchronized php-1.23wmf20/extensions/MultimediaViewer/  'Updating multimediaviewer with {{Gerrit|121555}}' | [production] | 
            
  | 23:23 | <mwalker> | synchronized php-1.23wmf20/skins/vector/components/common.less  'Syncing for 'Follow-up to typography changes to Vector'' | [production] | 
            
  | 23:23 | <ori> | synchronized multiversion/MWMultiVersion.php  'Ie4c431ae1: MWMultiVersion: treat *.hhvm.beta as *.wikipedia.beta' | [production] | 
            
  | 23:22 | <ori> | updated /a/common to {{Gerrit|Ie4c431ae1}}: MWMultiVersion: treat *.hhvm.beta as *.wikipedia.beta | [production] | 
            
  | 23:21 | <mwalker> | synchronized php-1.23wmf20/resources/oojs-ui  'Syncing for Update OOjs UI to v0.1.0-pre' | [production] | 
            
  | 23:07 | <mwalker> | synchronized wmf-config/  'Enabling VE on French Wiktionary & French Wikibooks' | [production] | 
            
  | 21:54 | <Krinkle> | Reloading Zuul to deploy I243258bc2b1770524285ec7 | [production] | 
            
  | 20:01 | <hoo> | synchronized php-1.23wmf20/extensions/Wikidata/  'Update Wikidata to fix a problem with SpecialMobileWatchlist' | [production] | 
            
  | 19:58 | <hoo> | synchronized php-1.23wmf19/extensions/Wikidata/  'Update Wikidata to fix a problem with SpecialMobileWatchlist' | [production] | 
            
  | 18:51 | <K4-713> | updated payments cluster to 051fc4f4c5a422988eb8 | [production] | 
            
  | 18:40 | <bd808> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.23wmf20 | [production] | 
            
  | 18:19 | <bd808> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.23wmf19 | [production] | 
            
  | 17:52 | <bd808> | Purged l10n cache for 1.23wmf17 | [production] | 
            
  | 17:44 | <bd808> | Finished scap: testwiki to php-1.23wmf20 and rebuild l10n cache (duration: 17m 29s) | [production] | 
            
  | 17:31 | <hashar> | Zuul is all happy. | [production] | 
            
  | 17:26 | <bd808> | Started scap: testwiki to php-1.23wmf20 and rebuild l10n cache | [production] | 
            
  | 17:24 | <bd808|deploy> | Deleted /a/common/php-1.23wmf1[12] on tin | [production] | 
            
  | 17:13 | <hashar> | repooled Jenkins slave 'gallium' | [production] | 
            
  | 17:09 | <hashar> | Jenkins restarting gallium slave. | [production] | 
            
  | 17:09 | <hashar> | Changes are stalled in Zuul because jobs tied to the 'gallium' slaves are not being processed. | [production] | 
            
  | 14:04 | <springle> | synchronized wmf-config/db-eqiad.php  's7 depool db1034 after crash' | [production] | 
            
  | 13:07 | <springle> | synchronized wmf-config/db-eqiad.php  's5 db1021 full steam' | [production] |