| 2014-04-07
      
      § | 
    
  | 23:45 | <catrope> | synchronized php-1.23wmf21/extensions/VisualEditor/  'VisualEditor bug fixes' | [production] | 
            
  | 23:42 | <catrope> | synchronized php-1.23wmf21/resources/oojs-ui/  'Update OOJS-UI for bug fixes' | [production] | 
            
  | 23:42 | <catrope> | synchronized php-1.23wmf21/skins/vector/variables.less  'Remove troublesome fonts from font stack' | [production] | 
            
  | 23:17 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'SWAT changes: other projects bar on frwikisource, import sources' | [production] | 
            
  | 23:06 | <bd808> | Finished scap: test2wiki to 1.23wmf20 (duration: 16m 48s) | [production] | 
            
  | 22:49 | <bd808> | Started scap: test2wiki to 1.23wmf20 | [production] | 
            
  | 22:38 | <bd808> | Finished scap: test2wiki to 1.23wmf21 (duration: 12m 07s) | [production] | 
            
  | 22:26 | <bd808> | Started scap: test2wiki to 1.23wmf21 | [production] | 
            
  | 22:12 | <bd808> | Finished scap: Testing 1.23wmf21 l10n changes (duration: 01m 31s) | [production] | 
            
  | 22:10 | <bd808> | Started scap: Testing 1.23wmf21 l10n changes | [production] | 
            
  | 22:07 | <bd808> | Finished scap: Testing 1.23wmf21 l10n changes (duration: 03m 49s) | [production] | 
            
  | 22:04 | <bd808> | Started scap: Testing 1.23wmf21 l10n changes | [production] | 
            
  | 21:13 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Apr  7 21:13:14 UTC 2014 (duration 1m 59s) | [production] | 
            
  | 20:40 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-07 20:40:02+00:00 | [production] | 
            
  | 20:23 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-07 20:23:14+00:00 | [production] | 
            
  | 19:08 | <ottomata> | temporatily disabling puppet on analytics 1009, 1010, 1019, 1020 to bring up new journalnodes | [production] | 
            
  | 18:39 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Apr  7 18:39:21 UTC 2014 (duration 15m 30s) | [production] | 
            
  | 18:23 | <aaron> | synchronized wmf-config/PoolCounterSettings-eqiad.php  'Added "downloadtiff" pool counter config' | [production] | 
            
  | 18:13 | <AaronSchulz> | shwiki queue finished emptying out in staggered loop on terbium | [production] | 
            
  | 18:03 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-07 18:03:48+00:00 | [production] | 
            
  | 17:36 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-07 17:36:02+00:00 | [production] | 
            
  | 17:24 | <bd808> | Manually running l10nupdate with new --verbose flag to capture log output | [production] | 
            
  | 14:34 | <MaxSem> | Rebuilding GeoData index | [production] | 
            
  | 14:09 | <hashar> | Jenkins cleared swap on gallium (swapoff -a && swapon -a). Makes ganglia graph nicer :D | [production] | 
            
  | 13:15 | <apergos> | reenabled puppet on dataset2, testing done | [production] | 
            
  | 12:23 | <apergos> | disabled puppet on dataset2, testing | [production] | 
            
  | 11:19 | <reedy> | Finished scap: because we're scappy... (rebuilding l10n cache for 1.23wmf21 (duration: 18m 04s) | [production] | 
            
  | 11:01 | <reedy> | Started scap: because we're scappy... (rebuilding l10n cache for 1.23wmf21 | [production] | 
            
  | 10:45 | <hashar> | integration Getting PHP Composer installed on labs slaves. {{gerrit|124305}} | [production] | 
            
  | 09:21 | <paravoid> | reactivating peerings with HE, issues reportedly resolved | [production] | 
            
  | 09:04 | <hashar> | restarted Zuul | [production] | 
            
  | 08:54 | <hashar> | gallium killed console-kit-daemon process which was eating a lot of memory | [production] | 
            
  | 08:42 | <hashar> | Restarting Jenkins, out of Java heap space. Something is leaking memory | [production] | 
            
  | 08:41 | <hashar> | Jenkins being broken for some reason AGAIN ! | [production] | 
            
  | 05:04 | <ori> | Zuul is stuck: <http://i.imgur.com/o5ghCam.jpg> (617kb image) | [production] | 
            
  | 02:56 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Apr  7 02:56:12 UTC 2014 (duration 56m 11s) | [production] | 
            
  | 02:20 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-07 02:20:10+00:00 | [production] | 
            
  | 02:13 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-07 02:13:42+00:00 | [production] | 
            
  
    | 2014-04-05
      
      § | 
    
  | 04:15 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Sat Apr  5 04:15:00 UTC 2014 (duration 50m 39s) | [production] | 
            
  | 03:56 | <andrew> | rebuilt wikiversions.cdb and synchronized wikiversions files: Revert mw.org, test2wiki and testwikidatawiki to 1.23wmf20 due to localisation issue | [production] | 
            
  | 03:51 | <Andrew> | Reverting mw.org, test2 and test.wikidata back to 1.23wmf20 | [production] | 
            
  | 03:41 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-05 03:41:36+00:00 | [production] | 
            
  | 03:36 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-05 03:36:04+00:00 | [production] | 
            
  | 03:24 | <Andrew> | Actually, going to rerun l10nupdate first just to check. | [production] | 
            
  | 03:22 | <Andrew> | Going to revert deployment of 1.23wmf21 again - still broken | [production] | 
            
  | 03:08 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Sat Apr  5 03:08:33 UTC 2014 (duration 8m 32s) | [production] |