| 2014-04-08
      
      § | 
    
  | 14:31 | <manybubbles> | upgrading elastic1001 | [production] | 
            
  | 13:54 | <manybubbles> | they'll pick it up during the rolling restart today to upgrade to 1.1.0 | [production] | 
            
  | 13:53 | <manybubbles> | synced first Elasticsearch plugin to production Elasticsearch servers | [production] | 
            
  | 13:46 | <RobH> | upgraded libssl on holmium | [production] | 
            
  | 13:39 | <Jeff_Green> | update & reboot tellurium | [production] | 
            
  | 13:39 | <RobH> | replacing the blog cert, if holmium crashes I didn't do it correctly. | [production] | 
            
  | 13:37 | <mutante> | restarting gitblit | [production] | 
            
  | 12:56 | <reedy> | updated /a/common to {{Gerrit|Id15ddc665}}: Revert "Group0 wikis to 1.23wmf21" | [production] | 
            
  | 10:21 | <Jeff_Green> | update & reboot barium | [production] | 
            
  | 10:15 | <Jeff_Green> | update & reboot samarium | [production] | 
            
  | 07:47 | <_joe|away> | restarted nginx on cp1044 and cp1043 | [production] | 
            
  | 05:47 | <apergos> | shot many old apache processes running as stats user from 2013, on stat1001 (restarting apache runs it as www-data user) | [production] | 
            
  | 05:39 | <apergos> | restarted apache on fenari magnesium yterrbium antimony | [production] | 
            
  | 05:31 | <_joe_> | upgraded openssl on cp10* and cp30* servers as well | [production] | 
            
  | 04:46 | <Tim> | on dataset1001: upgraded libssl and restarted lighttpd | [production] | 
            
  | 04:43 | <Tim> | restarted apache on the above list, failed on labs-ns1, virt1000, ytterbium | [production] | 
            
  | 04:41 | <Tim> | upgraded libssl on zirconium.wikimedia.org,neon.wikimedia.org,netmon1001.wikimedia.org,iodine.wikimedia.org,ytterbium.wikimedia.org,gerrit.wikimedia.org,virt1000.wikimedia.org,labs-ns1.wikimedia.org,stat1001.wikimedia.org | [production] | 
            
  | 04:38 | <Ryan_Lane> | upgrading libssl on virt0 | [production] | 
            
  | 04:37 | <Ryan_Lane> | upgrading libssl on virt1000 | [production] | 
            
  | 04:15 | <Tim> | also upgraded libssl on cp4001-4019. Restarted nginx on these servers and also the previous list. | [production] | 
            
  | 04:03 | <Tim> | upgrading libssl on ssl1001,ssl1002,ssl1003,ssl1004,ssl1005,ssl1006,ssl1007,ssl1008,ssl1009,ssl3001.esams.wikimedia.org,ssl3002.esams.wikimedia.org,ssl3003.esams.wikimedia.org | [production] | 
            
  | 03:11 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Tue Apr  8 03:11:04 UTC 2014 (duration 11m 3s) | [production] | 
            
  | 02:35 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-08 02:34:56+00:00 | [production] | 
            
  | 02:16 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-08 02:15:58+00:00 | [production] | 
            
  | 01:06 | <bd808> | Finished scap: revert group0 to 1.23wmf21 (testwiki still on 1.23wmf21) (duration: 09m 54s) | [production] | 
            
  | 00:56 | <bd808> | Started scap: revert group0 to 1.23wmf21 (testwiki still on 1.23wmf21) | [production] | 
            
  | 00:55 | <bd808> | scap aborted: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (again) (duration: 00m 25s) | [production] | 
            
  | 00:54 | <bd808> | Started scap: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (again) | [production] | 
            
  | 00:53 | <bd808> | scap aborted: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (duration: 02m 57s) | [production] | 
            
  | 00:50 | <bd808> | Started scap: group0 to 1.23wmf21 (testing python change for mwversionsinuse) | [production] | 
            
  | 00:25 | <catrope> | synchronized php-1.23wmf21/extensions/VisualEditor  'it helps if you run git submodule update first' | [production] | 
            
  | 00:25 | <catrope> | synchronized php-1.23wmf20/extensions/VisualEditor  'it helps if you run git submodule update first' | [production] | 
            
  
    | 2014-04-07
      
      § | 
    
  | 23:58 | <catrope> | synchronized php-1.23wmf20/extensions/VisualEditor/  'VisualEditor bug fixes' | [production] | 
            
  | 23:57 | <catrope> | synchronized php-1.23wmf20/skins/vector/variables.less  'Remove troublesome fonts from font stack' | [production] | 
            
  | 23:50 | <catrope> | synchronized php-1.23wmf21/resources/oojs-ui/  'Update OOJS-UI for bug fixes' | [production] | 
            
  | 23:50 | <catrope> | synchronized php-1.23wmf21/extensions/VisualEditor/  'VisualEditor bug fixes' | [production] | 
            
  | 23:49 | <catrope> | synchronized php-1.23wmf21/skins/vector/variables.less  'Remove troublesome fonts from font stack' | [production] | 
            
  | 23:45 | <catrope> | synchronized php-1.23wmf21/extensions/VisualEditor/  'VisualEditor bug fixes' | [production] | 
            
  | 23:42 | <catrope> | synchronized php-1.23wmf21/resources/oojs-ui/  'Update OOJS-UI for bug fixes' | [production] | 
            
  | 23:42 | <catrope> | synchronized php-1.23wmf21/skins/vector/variables.less  'Remove troublesome fonts from font stack' | [production] | 
            
  | 23:17 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'SWAT changes: other projects bar on frwikisource, import sources' | [production] | 
            
  | 23:06 | <bd808> | Finished scap: test2wiki to 1.23wmf20 (duration: 16m 48s) | [production] | 
            
  | 22:49 | <bd808> | Started scap: test2wiki to 1.23wmf20 | [production] | 
            
  | 22:38 | <bd808> | Finished scap: test2wiki to 1.23wmf21 (duration: 12m 07s) | [production] | 
            
  | 22:26 | <bd808> | Started scap: test2wiki to 1.23wmf21 | [production] | 
            
  | 22:12 | <bd808> | Finished scap: Testing 1.23wmf21 l10n changes (duration: 01m 31s) | [production] | 
            
  | 22:10 | <bd808> | Started scap: Testing 1.23wmf21 l10n changes | [production] | 
            
  | 22:07 | <bd808> | Finished scap: Testing 1.23wmf21 l10n changes (duration: 03m 49s) | [production] | 
            
  | 22:04 | <bd808> | Started scap: Testing 1.23wmf21 l10n changes | [production] | 
            
  | 21:13 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Apr  7 21:13:14 UTC 2014 (duration 1m 59s) | [production] |