| 2015-03-25
      
      § | 
    
  | 23:59 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/198786/ (duration: 00m 07s) | [production] | 
            
  | 23:58 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/198753/ (duration: 00m 09s) | [production] | 
            
  | 23:57 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/198749/ (duration: 00m 08s) | [production] | 
            
  | 23:55 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/194908 (duration: 00m 07s) | [production] | 
            
  | 23:53 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/193662/ (duration: 00m 07s) | [production] | 
            
  | 23:52 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/198460/ (duration: 00m 08s) | [production] | 
            
  | 23:50 | <krenair> | Synchronized wmf-config: re-sync that last one... (duration: 00m 08s) | [production] | 
            
  | 23:49 | <krenair> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/156078/ (duration: 00m 07s) | [production] | 
            
  | 23:40 | <krenair> | Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/199779/ (duration: 00m 08s) | [production] | 
            
  | 23:35 | <krenair> | Synchronized php-1.25wmf23/extensions/Flow/includes: https://gerrit.wikimedia.org/r/#/c/199684/1 (duration: 00m 09s) | [production] | 
            
  | 23:26 | <krenair> | Synchronized php-1.25wmf22/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/199686/ (duration: 00m 09s) | [production] | 
            
  | 23:23 | <krenair> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/196068/ (duration: 00m 09s) | [production] | 
            
  | 23:11 | <krenair> | Synchronized wmf-config: trying again (duration: 00m 08s) | [production] | 
            
  | 23:11 | <krenair> | Synchronized flow.dblist: (oops) (duration: 00m 08s) | [production] | 
            
  | 23:06 | <krenair> | Synchronized wmf-config: rv (duration: 00m 07s) | [production] | 
            
  | 23:03 | <krenair> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/194809/ - dblist for flow (duration: 00m 08s) | [production] | 
            
  | 22:57 | <twentyafterfour> | Purged l10n cache for 1.25wmf21 | [production] | 
            
  | 22:56 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf23 | [production] | 
            
  | 22:51 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf22 | [production] | 
            
  | 22:50 | <mutante> | disabled notifications for dsh group checks in icinga - reenable me after T93958 | [production] | 
            
  | 22:39 | <twentyafterfour> | Finished scap: testwiki to php-1.25wmf23 (this time without codfw) (duration: 03m 33s) | [production] | 
            
  | 22:35 | <twentyafterfour> | Started scap: testwiki to php-1.25wmf23 (this time without codfw) | [production] | 
            
  | 22:27 | <paravoid> | reformatting berkelium & curium | [production] | 
            
  | 22:18 | <twentyafterfour> | Finished scap: testwiki to php-1.25wmf23 and rebuild l10n cache (attempt #2) (duration: 149m 25s) | [production] | 
            
  | 22:12 | <bd808> | robh killed the stuck scap ssh connections to codfw and scap moved on to the next step | [production] | 
            
  | 22:01 | <bd808> | scap sync-common step stuck with 58 codfw hosts not syncing at any reasonable speed | [production] | 
            
  | 20:45 | <ejegg> | updated dash from b2db5e415ec75d289a4da2e1dd6af4a1bf5ab9b1 to 6d9acd60bb833c6dd57ab8b424afc8077b0c9f03 | [production] | 
            
  | 20:05 | <subbu> | deployed parsoid sha 0313fcc7 | [production] | 
            
  | 19:48 | <twentyafterfour> | Started scap: testwiki to php-1.25wmf23 and rebuild l10n cache (attempt #2) | [production] | 
            
  | 19:44 | <ejegg> | updated dash from 393facdb6c1a53bfbac3246f2fd3e1c4f51dc1cc to b2db5e415ec75d289a4da2e1dd6af4a1bf5ab9b1 | [production] | 
            
  | 19:41 | <awight> | updated payments from 7ffe008fb8964acb1382820d129d784d5b6dd9de to 32e860bd304763ccedc7110dee828249daa2b154 | [production] | 
            
  | 19:22 | <twentyafterfour> | scap failed: CalledProcessError Command 'cp '/srv/mediawiki-staging/php-1.25wmf23/cache/l10n/'*.cdb '/tmp/scap_l10n_2482639127'' returned non-zero exit status 1 (duration: 02m 19s) | [production] | 
            
  | 19:20 | <twentyafterfour> | Started scap: testwiki to php-1.25wmf23 and rebuild l10n cache | [production] | 
            
  | 16:21 | <aude> | Finished scap: Wikidata bug fixes and fix rollback bug in core (duration: 23m 01s) | [production] | 
            
  | 15:58 | <aude> | Started scap: Wikidata bug fixes and fix rollback bug in core | [production] | 
            
  | 15:19 | <bd808> | Updated scap to include 4a63a63 (Copy l10n CDB files to rebuildLocalisationCache.php tmp dir) | [production] | 
            
  | 15:19 | <bd808> | trebuchet checkout of scap failed on mw1113, mw1222, and mw1104 with return code 30 | [production] | 
            
  | 15:18 | <bd808> | trebuchet fetch of scap failed on mw1222 with return code 128 | [production] | 
            
  | 07:43 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Mar 25 07:42:46 UTC 2015 (duration 42m 45s) | [production] | 
            
  | 03:11 | <LocalisationUpdate> | completed (1.25wmf22) at 2015-03-25 03:10:38+00:00 | [production] | 
            
  | 03:06 | <l10nupdate> | Synchronized php-1.25wmf22/cache/l10n: (no message) (duration: 06m 44s) | [production] | 
            
  | 02:48 | <LocalisationUpdate> | completed (1.25wmf21) at 2015-03-25 02:47:07+00:00 | [production] |