| 2016-04-14
      
      ยง | 
    
  | 19:35 | <godog> | force puppet run on cache_upload in eqiad | [production] | 
            
  | 19:26 | <godog> | force puppet run for cache_upload in esams | [production] | 
            
  | 19:11 | <godog> | depool upload/eqiad | [production] | 
            
  | 19:01 | <demon@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.21 | [production] | 
            
  | 18:58 | <godog> | force puppet run on cache_upload in codfw | [production] | 
            
  | 18:51 | <godog> | forcing puppet run on cache_upload in eqiad and codfw | [production] | 
            
  | 18:36 | <demon@tin> | Finished scap: sync some symlink removals (duration: 04m 54s) | [production] | 
            
  | 18:31 | <demon@tin> | Started scap: sync some symlink removals | [production] | 
            
  | 18:23 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: ldap logging tune (duration: 00m 34s) | [production] | 
            
  | 18:05 | <cwd> | updated crm from 5877ee71abc21140e60934aef627003cfb2d11cc to 2f40e829195dec1cec71d08dc9c656eb247631ae | [production] | 
            
  | 17:14 | <godog> | set zone access for all - private wikis in codfw | [production] | 
            
  | 16:49 | <godog> | run on tin: mwscript extensions/WikimediaMaintenance/filebackend/setZoneAccess.php commonswiki --backend=local-multiwrite | [production] | 
            
  | 16:22 | <godog> | rollback varnish backends to eqiad for thumbs | [production] | 
            
  | 16:13 | <godog> | route upload backends to codfw - T129089 | [production] | 
            
  | 16:08 | <filippo@tin> | Synchronized wmf-config/filebackend-production.php: swift codfw sync replication T129089 (duration: 00m 26s) | [production] | 
            
  | 16:00 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable GuidedTour extension on sq.wikipedia (T132412) (duration: 00m 26s) | [production] | 
            
  | 15:54 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Babel configuration for uz.wikipedia (part 1/2) (T131924) (duration: 00m 26s) | [production] | 
            
  | 15:51 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable Kartographer on pl.wikimedia (T132510) (duration: 00m 26s) | [production] | 
            
  | 15:48 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Set wgKartographerWikivoyageMode (duration: 00m 26s) | [production] | 
            
  | 15:42 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: HD logo for lad.wikipedia (T132120, 3/3) (duration: 00m 26s) | [production] | 
            
  | 15:42 | <dereckson@tin> | Synchronized static/images/project-logos/ladwiki-2x.png: HD logo for lad.wikipedia (T132120, 2/3) (duration: 00m 25s) | [production] | 
            
  | 15:41 | <dereckson@tin> | Synchronized static/images/project-logos/ladwiki-1.5x.png: HD logo for lad.wikipedia (T132120, 1/3) (duration: 00m 25s) | [production] | 
            
  | 15:38 | <dereckson@tin> | Synchronized static/images/project-logos/vecwikisource.png: New logo for vec.wikisource (T132157) (duration: 00m 26s) | [production] | 
            
  | 15:37 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Add task identifier comment to vec.wikisource logo change (no-op, T132157) (duration: 00m 27s) | [production] | 
            
  | 15:33 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Add museumcommons.wikimedia.nl to wgCopyUploadsDomains (T131841) (duration: 00m 26s) | [production] | 
            
  | 15:29 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Add bio.acousti.ca to wgCopyUploadsDomains (T132140) (duration: 00m 27s) | [production] | 
            
  | 15:27 | <Dereckson> | Synchronized wmf-config/InitialiseSettings.php: Change voteWiki to fa language temporarily (T132667) (duration: 00m 34s) | [production] | 
            
  | 15:13 | <moritzm> | uploaded librsvg 2.40.5-1+deb8u1+wmf1 to carbon (T132584) | [production] | 
            
  | 14:24 | <ema> | rebooting cp3022 to test workaroud for T131961 | [production] | 
            
  | 14:20 | <paravoid> | cr1-esams: enabling IPv4/IPv6 BGP sessions with TeliaSonera | [production] | 
            
  | 12:41 | <Dereckson> | Ran initSiteStats.php for 10 wikis to fix negative/off-by-one statistics errors (T131306) | [production] | 
            
  | 11:53 | <elukey> | deployed new puppet-compiler version - 0.1.3 (adding submodules support) | [production] | 
            
  | 09:00 | <moritzm> | fixed stray salt minion processes on labsdb1003 (apparently caused by stale pidfile) | [production] | 
            
  | 03:43 | <Krinkle> | mwgrep deleteEqualMessages.php --wiki kawikiquote | [production] | 
            
  | 03:02 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Apr 14 03:02:03 UTC 2016 (duration 9m 25s) | [production] | 
            
  | 02:52 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.21) (duration: 12m 26s) | [production] | 
            
  | 02:31 | <bd808> | backfilled missing SAL entries from 2016-04-13T10:56Z to 2016-04-13T20:20Z to https://tools.wmflabs.org/sal/production | [production] | 
            
  | 02:25 | <mwdeploy@tin> | sync-l10n completed (1.27.0-wmf.20) (duration: 11m 13s) | [production] | 
            
  | 01:29 | <mutante> | mw1211 - restart hhvm | [production] | 
            
  | 01:26 | <mutante> | rebooting unresponsive serpens.wm.org | [production] | 
            
  | 01:06 | <mutante> | bast4001 back up unchanged - tftp wouldnt work across DC, probably network ACLs | [production] | 
            
  | 00:43 | <ori@tin> | Synchronized php-1.27.0-wmf.20/includes/libs/IEUrlExtension.php: Ie9799f5ea: Revert Hack IEUrlExtension::haveUndecodedRequestUri() to always return true (duration: 00m 30s) | [production] | 
            
  | 00:42 | <ori@tin> | Synchronized php-1.27.0-wmf.21/includes/libs/IEUrlExtension.php: Ie9799f5ea: Revert Hack IEUrlExtension::haveUndecodedRequestUri() to always return true (duration: 00m 32s) | [production] | 
            
  | 00:38 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: I08cfeca7c: Force ['SERVER_SOFTWARE'] to be"Apache" (duration: 00m 26s) | [production] | 
            
  | 00:28 | <maxsem@tin> | Synchronized php-1.27.0-wmf.20/extensions/TextExtracts/: https://gerrit.wikimedia.org/r/#/c/282640/ (duration: 00m 26s) | [production] | 
            
  | 00:27 | <maxsem@tin> | Synchronized php-1.27.0-wmf.21/extensions/TextExtracts/: https://gerrit.wikimedia.org/r/#/c/282640/ (duration: 00m 26s) | [production] | 
            
  | 00:23 | <dereckson@tin> | Synchronized wmf-config/abusefilter.php: Enable $wgAbuseFilterProfile for commonswiki ([[Gerrit:282806]], Task T132200) (duration: 00m 28s) | [production] | 
            
  | 00:13 | <dereckson@tin> | Synchronized php-1.27.0-wmf.21/extensions/AbuseFilter/AbuseFilter.class.php: Fixes to filter profiling ([[Gerrit:283333]], 3/3) (duration: 00m 26s) | [production] | 
            
  | 00:12 | <dereckson@tin> | Synchronized php-1.27.0-wmf.21/extensions/AbuseFilter/Views/AbuseFilterViewList.php: Fixes to filter profiling ([[Gerrit:283333]], 1/3) (duration: 00m 26s) | [production] | 
            
  | 00:11 | <dereckson@tin> | Synchronized php-1.27.0-wmf.21/extensions/AbuseFilter/Views/AbuseFilterViewEdit.php: Fixes to filter profiling ([[Gerrit:283333]], 1/3) (duration: 00m 26s) | [production] |