| 2014-04-08
      
      ยง | 
    
  | 18:45 | <ori> | synchronized wmf-config/InitialiseSettings.php  'I4b18e4ce8: Change wgServer and wgCanonicalServer for arbcom wikis' | [production] | 
            
  | 18:45 | <ori> | updated /a/common to {{Gerrit|I4b18e4ce8}}: Change wgServer and wgCanonicalServer for arbcom wikis | [production] | 
            
  | 18:13 | <bd808> | Finished scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) (duration: 03m 18s) | [production] | 
            
  | 18:10 | <bd808> | Started scap: group0 wikis to 1.23wmf21 (with patch for bug 63659) | [production] | 
            
  | 18:01 | <hoo> | synchronized wmf-config/InitialiseSettings.php  'Touch to clear config. cache' | [production] | 
            
  | 17:56 | <hoo> | changed the Wikidata wb_changes_dispatch position of all wikiquote wikis to 118158153 | [production] | 
            
  | 17:37 | <hoo> | synchronized php-1.23wmf20/extensions/Wikidata/extensions/Wikibase/lib/resources/wikibase.Site.js  'touch' | [production] | 
            
  | 17:37 | <aude> | synchronized wmf-config/Wikibase.php  'bump wgCacheEpoch for wikidata after enabling wikiquote site links' | [production] | 
            
  | 17:35 | <ottomata> | restarted gmetad on nickel to fix ganglia | [production] | 
            
  | 17:29 | <aude> | synchronized wikidataclient.dblist  'Enable Wikibase on Wikiquote' | [production] | 
            
  | 17:29 | <aude> | synchronized wmf-config  'config changes to enable Wikibase on Wikiquote' | [production] | 
            
  | 17:22 | <aude> | synchronized wmf-config/CirrusSearch-labs.php  'config change for beta, to enable highlighting' | [production] | 
            
  | 17:16 | <manybubbles> | finished upgrading elastic1001-1006.  starting on 1007.  yay progress. | [production] | 
            
  | 17:03 | <aude> | synchronized php-1.23wmf20/extensions/Wikidata  'Update Wikidata build, to allow populating sites table on wikiquote' | [production] | 
            
  | 16:31 | <aude> | added sites and site_identifiers core tables on wikiquote | [production] | 
            
  | 16:29 | <hashar> | Jenkins: killed jenkins-slave java process on gallium and repooled gallium slave.  It was no more registered in Zuul :-/ | [production] | 
            
  | 14:32 | <manybubbles> | no harm done, just lost time | [production] | 
            
  | 14:32 | <manybubbles> | woops, just restarted elastic1002.  silly me | [production] | 
            
  | 14:31 | <manybubbles> | upgrading elastic1001 | [production] | 
            
  | 13:54 | <manybubbles> | they'll pick it up during the rolling restart today to upgrade to 1.1.0 | [production] | 
            
  | 13:53 | <manybubbles> | synced first Elasticsearch plugin to production Elasticsearch servers | [production] | 
            
  | 13:46 | <RobH> | upgraded libssl on holmium | [production] | 
            
  | 13:39 | <Jeff_Green> | update & reboot tellurium | [production] | 
            
  | 13:39 | <RobH> | replacing the blog cert, if holmium crashes I didn't do it correctly. | [production] | 
            
  | 13:37 | <mutante> | restarting gitblit | [production] | 
            
  | 12:56 | <reedy> | updated /a/common to {{Gerrit|Id15ddc665}}: Revert "Group0 wikis to 1.23wmf21" | [production] | 
            
  | 10:21 | <Jeff_Green> | update & reboot barium | [production] | 
            
  | 10:15 | <Jeff_Green> | update & reboot samarium | [production] | 
            
  | 07:47 | <_joe|away> | restarted nginx on cp1044 and cp1043 | [production] | 
            
  | 05:47 | <apergos> | shot many old apache processes running as stats user from 2013, on stat1001 (restarting apache runs it as www-data user) | [production] | 
            
  | 05:39 | <apergos> | restarted apache on fenari magnesium yterrbium antimony | [production] | 
            
  | 05:31 | <_joe_> | upgraded openssl on cp10* and cp30* servers as well | [production] | 
            
  | 04:46 | <Tim> | on dataset1001: upgraded libssl and restarted lighttpd | [production] | 
            
  | 04:43 | <Tim> | restarted apache on the above list, failed on labs-ns1, virt1000, ytterbium | [production] | 
            
  | 04:41 | <Tim> | upgraded libssl on zirconium.wikimedia.org,neon.wikimedia.org,netmon1001.wikimedia.org,iodine.wikimedia.org,ytterbium.wikimedia.org,gerrit.wikimedia.org,virt1000.wikimedia.org,labs-ns1.wikimedia.org,stat1001.wikimedia.org | [production] | 
            
  | 04:38 | <Ryan_Lane> | upgrading libssl on virt0 | [production] | 
            
  | 04:37 | <Ryan_Lane> | upgrading libssl on virt1000 | [production] | 
            
  | 04:15 | <Tim> | also upgraded libssl on cp4001-4019. Restarted nginx on these servers and also the previous list. | [production] | 
            
  | 04:03 | <Tim> | upgrading libssl on ssl1001,ssl1002,ssl1003,ssl1004,ssl1005,ssl1006,ssl1007,ssl1008,ssl1009,ssl3001.esams.wikimedia.org,ssl3002.esams.wikimedia.org,ssl3003.esams.wikimedia.org | [production] | 
            
  | 03:11 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Tue Apr  8 03:11:04 UTC 2014 (duration 11m 3s) | [production] | 
            
  | 02:35 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-08 02:34:56+00:00 | [production] | 
            
  | 02:16 | <LocalisationUpdate> | completed (1.23wmf20) at 2014-04-08 02:15:58+00:00 | [production] | 
            
  | 01:06 | <bd808> | Finished scap: revert group0 to 1.23wmf21 (testwiki still on 1.23wmf21) (duration: 09m 54s) | [production] | 
            
  | 00:56 | <bd808> | Started scap: revert group0 to 1.23wmf21 (testwiki still on 1.23wmf21) | [production] | 
            
  | 00:55 | <bd808> | scap aborted: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (again) (duration: 00m 25s) | [production] | 
            
  | 00:54 | <bd808> | Started scap: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (again) | [production] | 
            
  | 00:53 | <bd808> | scap aborted: group0 to 1.23wmf21 (testing python change for mwversionsinuse) (duration: 02m 57s) | [production] | 
            
  | 00:50 | <bd808> | Started scap: group0 to 1.23wmf21 (testing python change for mwversionsinuse) | [production] | 
            
  | 00:25 | <catrope> | synchronized php-1.23wmf21/extensions/VisualEditor  'it helps if you run git submodule update first' | [production] | 
            
  | 00:25 | <catrope> | synchronized php-1.23wmf20/extensions/VisualEditor  'it helps if you run git submodule update first' | [production] |