| 2014-02-11
      
      § | 
    
  | 22:19 | <maxsem> | finished scap: Guess what? MobileApp! (duration: 42m 13s) | [production] | 
            
  | 21:56 | <manybubbles> | starting reindex of Cirrus indexes for wikis that got the new deployment today | [production] | 
            
  | 21:37 | <maxsem> | started scap: Guess what? MobileApp! | [production] | 
            
  | 21:06 | <bblack> | libav-tools (libavcodec53, libavformat53, etc) upgraded to 0.8.10-0ubuntu0.12.04.1 on all applicable toollabs hosts | [production] | 
            
  | 20:15 | <bblack> | libav-tools (libavcodec53, libavformat53, etc) upgraded to 0.8.10-0ubuntu0.12.04.1 on all image/video scalers | [production] | 
            
  | 20:05 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: Move group1 wikis to wmf13 | [production] | 
            
  | 20:00 | <demon> | updated /a/common to {{Gerrit|I7530d4456}}: Revert "Non wikipedias to 1.23wmf12" | [production] | 
            
  | 19:56 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: Move group2 wikis back to wmf12 where they belong | [production] | 
            
  | 19:28 | <demon> | synchronized wikiversions.cdb  'manually syncing cuz sync-wikiversions is busted for me' | [production] | 
            
  | 19:28 | <demon> | synchronized wikiversions.dat  'manually syncing cuz sync-wikiversions is busted for me' | [production] | 
            
  | 19:26 | <demon> | rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.23wmf12 | [production] | 
            
  | 19:01 | <reedy> | updated /a/common to {{Gerrit|Iecde9fe5a}}: Set enwiki back to 'All articles needing copy edit' | [production] | 
            
  | 18:51 | <mflaschen> | synchronized wmf-config/InitialiseSettings.php  'Sync InitialiseSettings.php for Growth deploy after fixing enwiki cat' | [production] | 
            
  | 18:14 | <mflaschen> | synchronized wmf-config/InitialiseSettings.php  'Sync InitialiseSettings.php for Growth deploy' | [production] | 
            
  | 18:13 | <mflaschen> | synchronized wmf-config/CommonSettings.php  'Sync CommonSettings.php for Growth deploy' | [production] | 
            
  | 18:06 | <mflaschen> | synchronized php-1.23wmf13/extensions/GettingStarted/  'Sync GettingStarted on wmf13 again to fix our foreachwiki script' | [production] | 
            
  | 18:05 | <mflaschen> | synchronized php-1.23wmf12/extensions/GettingStarted/  'Sync GettingStarted on wmf12 again to fix our foreachwiki script' | [production] | 
            
  | 17:48 | <mflaschen> | synchronized php-1.23wmf13/extensions/GettingStarted/  'Sync GettingStarted on wmf13 for i18n rollout' | [production] | 
            
  | 17:46 | <mflaschen> | synchronized php-1.23wmf12/extensions/GettingStarted/  'Sync GettingStarted on wmf12 for i18n rollout' | [production] | 
            
  | 16:18 | <mutante> | revoking puppet cert for locke | [production] | 
            
  | 16:01 | <mutante> | locke is being decom'ed momentarily (purchase date 2006-12-04, heh) | [production] | 
            
  | 15:56 | <bd808> | mw1094 segfaulting since 2014-02-11T22:42. Current rate ~45/hr. | [production] | 
            
  | 15:56 | <bd808> | mw1185 continues to segfault at a rate of ~1000/hr | [production] | 
            
  | 15:48 | <mutante> | DNS update - removing harmon | [production] | 
            
  | 08:39 | <nikerabbit> | synchronized wmf-config/CommonSettings.php  'uls prep' | [production] | 
            
  | 08:38 | <nikerabbit> | synchronized wmf-config/InitialiseSettings.php  'uls prep' | [production] | 
            
  | 08:10 | <nikerabbit> | updated /a/common to {{Gerrit|Ib325d4aa9}}: Update ULS config | [production] | 
            
  | 07:47 | <gwicke> | deployed parsoid hotfix to avoid recursive log spew filling up the logs | [production] | 
            
  | 03:39 | <RoanKattouw> | Freed up disk space on wtp* by blanking /var/log/parsoid/parsoid.log | [production] | 
            
  | 03:30 | <RoanKattouw> | Managed to restart Parsoid cleanly in the end. Turns out dsh -g parsoid service restart parsoid doesn't work but dsh -cM -g parsoid /etc/init.d/parsoid restart does work | [production] | 
            
  | 03:23 | <RoanKattouw> | Doing rolling restart of the Parsoid cluster | [production] | 
            
  | 03:21 | <RoanKattouw> | Copying wtp1005's Parsoid log for future reference | [production] | 
            
  | 02:43 | <Tim> | restarting apache on servers with workers in a futex wait: mw1056,mw1082,mw1189,mw1196,mw1199,mw1201,mw1202,mw1203,mw1204,mw1208 | [production] | 
            
  | 02:40 | <LocalisationUpdate> | ResourceLoader cache refresh completed at 2014-02-11 02:40:11+00:00 | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.23wmf13) at 2014-02-11 02:19:13+00:00 | [production] | 
            
  | 02:10 | <LocalisationUpdate> | completed (1.23wmf12) at 2014-02-11 02:10:38+00:00 | [production] | 
            
  | 02:02 | <awight> | update crm from 7e5786aaf71363c04e5c766e6b403fa4767fe51a to 06f7e4d6d6c2653f1d4aef1e8b8e6293a82b39ef | [production] | 
            
  | 01:25 | <mwalker> | updated fundraising civicrm from d96164f76877d75ab97c02e6b47449f7a45b31b3 to 7e5786aaf71363c04e5c766e6b403fa4767fe51a for unsbuscribe and quick search changes | [production] | 
            
  | 00:56 | <^demon> | gerrit upgraded from 2.8.1 stable to 2.8.1-1-g83098d0 (custom build) to work around mysql issue pending upstream release. | [production] | 
            
  | 00:34 | <maxsem> | finished scap: MobileApp deployment (duration: 28m 19s) | [production] | 
            
  | 00:06 | <maxsem> | started scap: MobileApp deployment | [production] | 
            
  | 00:04 | <maxsem> | scap aborted: MobileApp deployment (duration: 06m 33s) | [production] |