| 2014-04-10
      
      ยง | 
    
  | 21:50 | <Krinkle> | VisualEditor throws uncaught error on load for 1.23wmf21 wikis (bug 63791) | [production] | 
            
  | 21:15 | <bd808> | Disabled beta update Jenkins job (https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/) so that scap testing can happen in beta. | [production] | 
            
  | 19:30 | <ottomata> | reinstalling elastic1004 | [production] | 
            
  | 19:19 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'I5501078cee871fb9df03e085547b7a047ef5bd7e' | [production] | 
            
  | 19:16 | <ori> | synchronized wmf-config/InitialiseSettings-labs.php  'Ia79b1b848: Work around bug 63780 by specifying a siteParamsCallback' | [production] | 
            
  | 19:15 | <ori> | updated /a/common to {{Gerrit|Ia79b1b848}}: Work around bug 63780 by specifying a siteParamsCallback | [production] | 
            
  | 18:44 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'touch' | [production] | 
            
  | 18:43 | <reedy> | synchronized database lists files: Enable MediaViewer on mediawikiwiki | [production] | 
            
  | 18:42 | <reedy> | synchronized docroot and w | [production] | 
            
  | 18:41 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.23wmf22 | [production] | 
            
  | 18:37 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.23wmf21 | [production] | 
            
  | 18:33 | <reedy> | synchronized php-1.23wmf21/extensions/MultimediaViewer | [production] | 
            
  | 16:55 | <ottomata> | shutting down elastic1003 for reinstall and reformat | [production] | 
            
  | 16:42 | <reedy> | updated /a/common to {{Gerrit|Ie72029103}}: Add/update symlinks | [production] | 
            
  | 16:40 | <reedy> | Finished scap: testwiki to 1.23wmf22 and build l10n cache (duration: 24m 45s) | [production] | 
            
  | 16:15 | <reedy> | Started scap: testwiki to 1.23wmf22 and build l10n cache | [production] | 
            
  | 16:14 | <reedy> | updated /a/common to {{Gerrit|I2cccebdd7}}: wikidatawiki back to 1.23wmf21 | [production] | 
            
  | 15:03 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikidatawiki back to 1.23wmf21... | [production] | 
            
  | 15:00 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 10 15:00:01 UTC 2014 (duration 27m 49s) | [production] | 
            
  | 14:17 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-10 14:17:16+00:00 | [production] | 
            
  | 13:49 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-10 13:49:24+00:00 | [production] | 
            
  | 13:31 | <reedy> | Finished scap: l10n cache update for wikidatawiki (duration: 19m 15s) | [production] | 
            
  | 13:12 | <reedy> | Started scap: l10n cache update for wikidatawiki | [production] | 
            
  | 12:42 | <bblack> | removed broken pdns_gmetric cronjob on lvs boxes | [production] | 
            
  | 09:44 | <ori> | synchronized wmf-config/CommonSettings.php  'I107179a27: Move HHVM extension blacklist below extract($globals) so it isn't simply clobbered' | [production] | 
            
  | 09:42 | <ori> | updated /a/common to {{Gerrit|I107179a27}}: Move HHVM extension blacklist below extract($globals) so it isn't simply clobbered | [production] | 
            
  | 09:39 | <hashar> | Zuul processed its backlog.  Had to disconnect/reconnect the labs slaves.  There is some weird bug occurring :-( | [production] | 
            
  | 09:29 | <hashar> | Jenkins: disabling Gearman client in https://integration.wikimedia.org/ci/configure and reenabling it | [production] | 
            
  | 09:20 | <hashar> | Jenkins unpooling both slave labs using the web interface and killing the Jenkins client running as jenkins-deploy . Will repool so the job can be reregistered properly {{bug|63760}} | [production] | 
            
  | 09:11 | <mutante> | DNS update - removing ms6 | [production] | 
            
  | 09:04 | <hashar> | Jenkins bunch of jobs are not being triggered properly. Taking traces. | [production] | 
            
  | 08:55 | <mutante> | ms6 - shutdown -h now | [production] | 
            
  | 08:42 | <mutante> | forcing Bugzilla logout for all users | [production] | 
            
  | 08:19 | <aude> | synchronized php-1.23wmf20/extensions/Wikidata | [production] | 
            
  | 08:09 | <aude> | synchronized php-1.23wmf20/extensions/Wikidata | [production] | 
            
  | 07:57 | <aude> | rebuilt wikiversions.cdb and synchronized wikiversions files: Rebuild wikiversions and put wikidata on 1.23wmf20 | [production] | 
            
  | 07:53 | <aude> | synchronized wikiversions.json  'Put Wikidata back on 1.23wmf20, due to localisation cache issues' | [production] | 
            
  | 07:21 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 10 07:21:16 UTC 2014 (duration 7m 21s) | [production] | 
            
  | 06:46 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-10 06:45:59+00:00 | [production] | 
            
  | 06:27 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-10 06:27:30+00:00 | [production] | 
            
  | 06:27 | <ori> | synchronized wmf-config/CommonSettings.php  'I20bbe05cc: Avoid using bits on beta-hhvm.wmflabs.org' | [production] | 
            
  | 06:27 | <ori> | updated /a/common to {{Gerrit|I20bbe05cc}}: Avoid using bits on beta-hhvm.wmflabs.org | [production] | 
            
  | 06:15 | <ori> | Some interface messages are missing on wikidata.org. Started a manual l10nupdate. | [production] | 
            
  | 04:11 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 10 04:11:47 UTC 2014 (duration 11m 46s) | [production] | 
            
  | 03:19 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-10 03:19:18+00:00 | [production] | 
            
  | 03:02 | <ori> | synchronized multiversion/MWMultiVersion.php  'Ibdbac982b: Update multiversion regexp for *.beta-hhvm.wmflabs.org' | [production] | 
            
  | 03:01 | <ori> | updated /a/common to {{Gerrit|Ibdbac982b}}: Update multiversion regexp for *.beta-hhvm.wmflabs.org | [production] | 
            
  | 02:22 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-10 02:22:11+00:00 | [production] | 
            
  | 01:49 | <ori> | synchronized wmf-config/InitialiseSettings-labs.php  'I697f7e4a6: Use  to branch on interpreter' | [production] | 
            
  | 01:48 | <ori> | synchronized wmf-config/CommonSettings.php  'I697f7e4a6: Use  to branch on interpreter' | [production] |