| 2015-06-11
      
      § | 
    
  | 21:54 | <ori> | Widespread TC cache exhaustion again, doing rolling restart of HHVMs | [production] | 
            
  | 21:46 | <ori> | Synchronized wmf-config/CommonSettings.php: I3d3ed7647: Test LCStoreStaticArray on test2wiki (duration: 00m 14s) | [production] | 
            
  | 21:01 | <godog> | NPE while trying to make restbase1007 (cassandra 2.1.5) join the cluster, trying matching the same cassandra version (2.1.3) | [production] | 
            
  | 20:57 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: fix last commit, did not have any affect (duration: 00m 16s) | [production] | 
            
  | 20:55 | <ejegg> | updated payments from 43c7952d2a31deaea97e8319f5612d644dce43c8 to f33d0a8687a120a2057a7e6acad67da63b17f97e | [production] | 
            
  | 20:54 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/217688/1 (duration: 00m 13s) | [production] | 
            
  | 20:11 | <godog> | sign restbase1007 puppet key and first puppet run | [production] | 
            
  | 19:10 | <legoktm> | Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/217591 (duration: 00m 13s) | [production] | 
            
  | 18:58 | <legoktm> | Synchronized wmf-config/InitialiseSettings-labs.php: beta only change - https://gerrit.wikimedia.org/r/217560 (duration: 00m 12s) | [production] | 
            
  | 18:55 | <krinkle> | Synchronized php-1.26wmf9/extensions/WikimediaEvents: T101806 (duration: 00m 14s) | [production] | 
            
  | 18:43 | <twentyafterfour> | Synchronized php-1.26wmf9/includes/AjaxResponse.php: Hotfix Iafff9982bbbee893c13f891901dde88f998db7a6 (duration: 00m 14s) | [production] | 
            
  | 18:16 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf9 | [production] | 
            
  | 17:44 | <ejegg> | rolled back payments to 43c7952d2a31deaea97e8319f5612d644dce43c8 | [production] | 
            
  | 17:41 | <ejegg> | updated payments from 43c7952d2a31deaea97e8319f5612d644dce43c8 to 15f24d24b150d5d774314b0c1b40ae26a73185f2 | [production] | 
            
  | 17:00 | <moritzm> | updated mc200[1-3] to linux 3.19 | [production] | 
            
  | 16:28 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Use arbitrary access tag (duration: 00m 12s) | [production] | 
            
  | 16:27 | <aude> | Synchronized wmf-config/CommonSettings.php: Add arbitrary access group tag (duration: 00m 13s) | [production] | 
            
  | 16:27 | <aude> | Synchronized arbitraryaccess.dblist: Add dblist for arbitrary access wikis (duration: 00m 13s) | [production] | 
            
  | 16:24 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Use usagetracking tag (duration: 00m 13s) | [production] | 
            
  | 16:24 | <aude> | Synchronized wmf-config/CommonSettings.php: Add usagetracking group tag (duration: 00m 16s) | [production] | 
            
  | 16:23 | <ori> | Scap + deployments exhausted TC cache on Apaches; performed a rolling restart of HHVM | [production] | 
            
  | 16:21 | <aude> | Synchronized usagetracking.dblist: Add dblist for usage tracking wikis (duration: 00m 25s) | [production] | 
            
  | 16:19 | <ori> | Synchronized wmf-config/CommonSettings.php: Disable Parsoid update jobs (duration: 00m 14s) | [production] | 
            
  | 16:18 | <thcipriani> | Finished scap: SWAT: Update namespaces and special pages for Northern Luri (lrc) from translatewiki [[gerrit:216533]] [[gerrit:217327]] (duration: 32m 11s) | [production] | 
            
  | 15:46 | <thcipriani> | Started scap: SWAT: Update namespaces and special pages for Northern Luri (lrc) from translatewiki [[gerrit:216533]] [[gerrit:217327]] | [production] | 
            
  | 15:27 | <thcipriani> | Synchronized php-1.26wmf9/extensions/OpenStackManager: SWAT: update OpenStackManager to disable unused sudoer features [[gerrit:217407]] (duration: 00m 13s) | [production] | 
            
  | 15:11 | <thcipriani> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Make VisualEditor access RESTbase directly on all public wikis [[gerrit:214833]] (duration: 00m 12s) | [production] | 
            
  | 15:05 | <thcipriani> | Synchronized wmf-config/InitialiseSettings.php: SWAT: CX: Add wikis for deployment on 20150611 [[gerrit:217460 ]] (duration: 00m 12s) | [production] | 
            
  | 14:33 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Enable usage tracking on jawiki (duration: 00m 12s) | [production] | 
            
  | 13:40 | <_joe_> | rolling restart of all the restbase instances | [production] | 
            
  | 13:33 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Enable usage tracking on frwiki (duration: 00m 12s) | [production] | 
            
  | 13:32 | <_joe_> | running puppet on all restbase hosts | [production] | 
            
  | 13:19 | <_joe_> | running puppet on restbase1001 | [production] | 
            
  | 13:16 | <_joe_> | disabling puppet on restbase hosts in anticipation for merging https://gerrit.wikimedia.org/r/217431 | [production] | 
            
  | 13:11 | <paravoid> | removing gdnsd from apt: precise-wikimedia (1.9.0-1~precise1/2.1.0-1~precise1), trusty-wikimedia (2.1.0-1), jessie-wikimedia (2.1.2-1~deb8u1) | [production] | 
            
  | 12:13 | <aude> | Synchronized wmf-config/InitialiseSettings.php: Enable arbitrary access on Wikivoyage and Wikiquote (duration: 00m 13s) | [production] | 
            
  | 11:49 | <YuviPanda> | reboot labvirt1005 for kernel upgrade | [production] | 
            
  | 11:46 | <YuviPanda> | installing linux-image-generic-lts-vivid on labvirt1005 to get a 3.19 kernel | [production] | 
            
  | 09:51 | <akosiaris> | uploaded ruby-jsduck_5.3.4 and ruby-rkelly-remix_0.0.6 on apt.wikimedia.org/jessie-wikimedia/main | [production] | 
            
  | 08:18 | <akosiaris> | recreating jessie chroots on copper | [production] | 
            
  | 06:21 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Jun 11 06:21:53 UTC 2015 (duration 21m 52s) | [production] | 
            
  | 04:44 | <twentyafterfour> | upgraded phabricator at 1:50 UTC (belatedly logged...) | [production] | 
            
  | 03:01 | <LocalisationUpdate> | completed (1.26wmf9) at 2015-06-11 03:01:48+00:00 | [production] | 
            
  | 03:00 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1057, warm up (duration: 01m 16s) | [production] | 
            
  | 02:59 | <l10nupdate> | Synchronized php-1.26wmf9/cache/l10n: (no message) (duration: 05m 59s) | [production] | 
            
  | 02:43 | <LocalisationUpdate> | completed (1.26wmf8) at 2015-06-11 02:43:34+00:00 | [production] | 
            
  | 02:31 | <l10nupdate> | Synchronized php-1.26wmf8/cache/l10n: (no message) (duration: 09m 13s) | [production] |