| 2015-10-07
      
      § | 
    
  | 19:41 | <urandom> | doing full deploy of c20e6336 to RESTBase | [production] | 
            
  | 19:29 | <urandom> | canary deploy to restbase1001.eqiad complete | [production] | 
            
  | 19:14 | <urandom> | deploying c20e6336 to canary node restbase1001.eqiad | [production] | 
            
  | 19:09 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.2 | [production] | 
            
  | 18:56 | <twentyafterfour@tin> | Synchronized wmf-config/CommonSettings.php: fix undefined variable warning that has been spamming logs (duration: 00m 17s) | [production] | 
            
  | 16:39 | <mutante> | powercycling analytics1035 | [production] | 
            
  | 16:14 | <mobrovac> | citoid deploying ec149fd5 | [production] | 
            
  | 16:02 | <marktraceur@tin> | Synchronized wmf-config/: Adding new config variable for uploads to Commons (duration: 00m 17s) | [production] | 
            
  | 15:44 | <catrope@tin> | Synchronized php-1.27.0-wmf.1/extensions/MobileFrontend: SWAT (duration: 00m 17s) | [production] | 
            
  | 15:44 | <catrope@tin> | Synchronized php-1.27.0-wmf.2/extensions/Echo: SWAT (duration: 00m 18s) | [production] | 
            
  | 15:44 | <catrope@tin> | Synchronized php-1.27.0-wmf.1/extensions/Echo: SWAT (duration: 00m 17s) | [production] | 
            
  | 15:13 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1051 after maintenance (duration: 00m 17s) | [production] | 
            
  | 15:03 | <krenair@tin> | Synchronized visualeditor-default.dblist: https://gerrit.wikimedia.org/r/#/c/242041/ (duration: 00m 17s) | [production] | 
            
  | 15:02 | <krenair@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/242041/ (duration: 00m 18s) | [production] | 
            
  | 14:59 | <mobrovac> | AQS restarting restbase on aqs100x | [production] | 
            
  | 13:00 | <godog> | decomission restbase-test2001 and reimage | [production] | 
            
  | 12:27 | <paravoid> | salt-rm'ing /var/lib/apt/lists/ubuntu.wikimedia.org_ubuntu_dists_trusty_main_i18n_Translation-en%5fUS | [production] | 
            
  | 10:55 | <godog> | reenable puppet on restbase / maps-test / aqs | [production] | 
            
  | 10:10 | <_joe_> | depooling cp1059 from pybal, varnish | [production] | 
            
  | 08:44 | <godog> | disable puppet on restbase, maps, aqs before merging https://gerrit.wikimedia.org/r/#/c/243127 | [production] | 
            
  | 08:05 | <moritzm> | installed spice security updates on labvirt* | [production] | 
            
  | 06:01 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Wed Oct  7 06:01:01 UTC 2015 (duration 1m 0s) | [production] | 
            
  | 05:25 | <ebernhardson> | generating elasticsearch indices in codfw, should run ~3 hours | [production] | 
            
  | 04:33 | <ebernhardson@tin> | Synchronized wmf-config/InitialiseSettings.php: Touch InitiialiSettings.php to force config regeneration (duration: 00m 18s) | [production] | 
            
  | 04:23 | <ebernhardson@tin> | Synchronized wmf-config/: enable second es cluster in testwiki one more time (duration: 00m 18s) | [production] | 
            
  | 04:15 | <ebernhardson> | sync-common on mw2187.codfw.wmnet to fix localisation cache errors in exception.log | [production] | 
            
  | 03:37 | <ebernhardson@tin> | Synchronized wmf-config: redisable second cluster only on testwiki (duration: 00m 16s) | [production] | 
            
  | 03:35 | <ebernhardson@tin> | Synchronized wmf-config/: Reenable second ES cluster on testwiki only (duration: 00m 18s) | [production] | 
            
  | 03:10 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-07 03:10:02+00:00 | [production] | 
            
  | 03:03 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 10m 18s) | [production] | 
            
  | 02:37 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-07 02:37:32+00:00 | [production] | 
            
  | 02:32 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 22s) | [production] | 
            
  | 01:44 | <catrope@tin> | Synchronized php-1.27.0-wmf.2/extensions/Echo: Fix JS error (duration: 00m 18s) | [production] | 
            
  | 01:44 | <catrope@tin> | Synchronized php-1.27.0-wmf.1/extensions/Echo: Fix JS error (duration: 00m 17s) | [production] | 
            
  | 00:04 | <catrope@tin> | Synchronized php-1.27.0-wmf.2/extensions/Echo: SWAT (duration: 00m 17s) | [production] | 
            
  | 00:04 | <catrope@tin> | Synchronized php-1.27.0-wmf.1/extensions/Echo: SWAT (duration: 00m 17s) | [production] | 
            
  
    | 2015-10-06
      
      § | 
    
  | 23:20 | <ebernhardson@tin> | Synchronized wmf-config: Revert multicluster config for testwiki (duration: 00m 18s) | [production] | 
            
  | 23:18 | <ebernhardson@tin> | Synchronized wmf-config/: Enable multicluster ES on testwiki (duration: 00m 17s) | [production] | 
            
  | 22:44 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 | [production] | 
            
  | 22:40 | <twentyafterfour@tin> | Synchronized php-1.27.0-wmf.2: Deploy https://gerrit.wikimedia.org/r/#/c/244066/ (duration: 01m 40s) | [production] | 
            
  | 21:36 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.1 | [production] | 
            
  | 21:15 | <twentyafterfour> | restarted phd in response to a phabricator setup issue | [production] | 
            
  | 20:58 | <bblack> | disabling puppet on caches for VCL testing | [production] | 
            
  | 20:58 | <twentyafterfour@tin> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 | [production] | 
            
  | 20:53 | <twentyafterfour@tin> | Finished scap: sync wmf/1.27.0-wmf.1 (duration: 32m 13s) | [production] | 
            
  | 20:29 | <mutante> | service "ishmael" has been removed (T109777) - removed docroot on neon. tarball exists in /root just in case. code is on https://github.com/asher/ishmael | [production] | 
            
  | 20:20 | <twentyafterfour@tin> | Started scap: sync wmf/1.27.0-wmf.1 | [production] | 
            
  | 18:48 | <yuvipanda> | fixing https://phabricator.wikimedia.org/T109216 on labstore1002 | [production] | 
            
  | 18:10 | <godog> | upgrade videoscalers to ffmpeg2theora 0.29.0~git+20150813-2 | [production] | 
            
  | 15:04 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable Suggestion in af, gl, gu, mk, oc, sh and simplewiki [[gerrit:243919]] (duration: 00m 18s) | [production] |