751-800 of 10000 results (18ms)
2012-02-18 §
10:41 <catrope> synchronized php-1.19/resources/mediawiki/mediawiki.user.js 'touch' [production]
10:40 <catrope> synchronized php-1.19/resources/mediawiki/mediawiki.js 'touch' [production]
08:56 <apergos> restarted all the searchpool1 lsearchds [production]
02:35 <LocalisationUpdate> completed (1.19) at Sat Feb 18 02:35:12 UTC 2012 [production]
02:18 <LocalisationUpdate> completed (1.18) at Sat Feb 18 02:18:33 UTC 2012 [production]
01:59 <aaron> synchronized php-1.19/extensions/CentralAuth/CentralAuth.php 'disabled AntiSpoof hooks which broken account creation with DB errors' [production]
01:00 <andrew> synchronizing Wikimedia installation... : [production]
00:58 <Andrew> Running scap to ensure a consistent environment [production]
00:51 <andrew> synchronized php-1.19/resources/mediawiki/mediawiki.user.js 'Attempt to repush [[rev:111695|r111695]]' [production]
00:44 <andrew> synchronized php-1.19/resources/Resources.php 'Deploy [[rev:111809|r111809]]' [production]
00:43 <aaron> synchronized php-1.19/resources/mediawiki.special/mediawiki.special.preferences.js 'deployed [[rev:111808|r111808]]' [production]
00:21 <andrew> synchronized php-1.19/extensions/Vector/modules/ext.vector.collapsibleNav.js 'Deploy [[rev:111806|r111806]]' [production]
00:16 <andrew> synchronized php-1.19/extensions/Vector/modules/ext.vector.collapsibleNav.js 'Deploy [[rev:111804|r111804]]' [production]
2012-02-17 §
22:51 <andrew> synchronized php-1.19/includes/actions/HistoryAction.php 'Deploy [[rev:111800|r111800]]' [production]
22:22 <andrew> synchronized php-1.19/includes/Linker.php 'deploy [[rev:111798|r111798]]' [production]
21:30 <notpeter> remounted nfs mounts on searchidx2. to protect our house of cards [production]
21:03 <notpeter> unmounting ms nfs mounts from searchidx2 [production]
20:44 <notpeter> restarting puppet on brewster [production]
20:33 <nikerabbit> synchronized wmf-config/InitialiseSettings.php 'Bug 34235 - Enable WebFonts on am.wikipedia' [production]
20:13 <maplebed> sending thumbnail traffic back to swift; head bug is fixed. [production]
20:10 <RobH> reinstalling search1001 and searchidx1001 [production]
19:53 <RobH> search1001 down for reinstall [production]
19:37 <RobH> ran dsh command to remove all the /tmp/mw-cache-1.17 [production]
19:27 <LeslieCarr> manually cleaned up tmp on mw41 [production]
19:27 <RobH> manually cleaned up tmp on mw21 [production]
19:01 <LeslieCarr> changed sockpuppet's post-merge hook so that you need to have ssh keys forwarded (though you really would anyways due to brokenness) [production]
18:51 <aaron> synchronized php-1.18/includes/api/ApiQueryAllUsers.php [production]
18:50 <reedy> synchronized wmf-config/ 'Sync ExtensionMessages' [production]
18:44 <reedy> synchronized php-1.19/extensions/WikimediaMessages/ [production]
18:43 <reedy> synchronized php-1.18/extensions/WikimediaMessages/ [production]
18:22 <aaron> synchronized php-1.18/includes/api/ApiQueryAllUsers.php [production]
18:19 <aaron> synchronized php-1.18/includes/api/ApiQueryAllUsers.php 'force index' [production]
18:06 <maplebed> sending thumbnail traffic back to ms5, taking swift out of production [production]
18:00 <notpeter> temporarily stopping puppet on brewster. please let me know if you need to turn it back on [production]
17:52 <maplebed> changing squids to send 100% of thumbnail traffic to swift [production]
16:58 <maplebed> turned swift live for 50% of all thumbnail requests [production]
15:02 <hashar> synchronized php-1.19/LocalSettings.php 'make jobrunners for testwiki to use the apache CommonSettings file instead of the non existant /home/wikipedia one' [production]
14:59 <reedy> synchronized php-1.19/includes/specials/SpecialDeletedContributions.php '[[rev:111752|r111752]]' [production]
14:58 <hashar> synchronized php-1.19/LocalSettings.php [production]
14:40 <hashar> synchronized php-1.19/LocalSettings.php 'debug statement with argv join' [production]
14:37 <hashar> synchronized php-1.19/LocalSettings.php 'syslog debug statement to investigate TESTWIKI issue' [production]
13:40 <^demon> srv233: removed /tmp/mw-cache-1.17 to give it a little more space for now [production]
09:58 <mark> Shutdown ragweed for decommissioning [production]
07:42 <binasher> upgraded mysql on db40 to 5.1.53-facebook-[[rev:3753|r3753]], enabled innodb_use_purge_thread [production]
05:39 <tstarling> synchronized wmf-config/InitialiseSettings.php [production]
05:38 <tstarling> synchronized wmf-config/CommonSettings.php [production]
05:35 <Tim> on db40: reduced to 10M, should be causing massive delays, but the site's not down and the purge rate is lower if anything. Going to disable the mysql parser cache entirely. [production]
05:26 <Tim> on db40: purge lag is still increasing at 108 per second, so reducing innodb_max_purge_lag to 50M [production]
05:21 <Tim> on db40: giving the innodb manual the benefit of the doubt and following its advice, setting innodb_max_purge_lag to 100M, which should give a delay of 4.5ms [production]
05:13 <Tim> killing purgeParserCache.php since it is probably doing more harm than good [production]