6401-6450 of 10000 results (13ms)
2010-02-16 §
13:16 <domas> apparently my squid rule for Apple browsers didn't really work, hence the continuing spikes [production]
03:16 <domas> blocked MacOSX Atom syndication on the edge, this will save terabytes of diskspace on unsuspecting Safari user computers :-) [production]
02:13 <logmsgbot_> tstarling synchronized php-1.5/wmf-config/checkers.php [production]
2010-02-15 §
23:42 <logmsgbot_> midom synchronized php-1.5/includes/StubObject.php 'uninstrumenting' [production]
23:09 <logmsgbot_> midom synchronized php-1.5/wmf-config/checkers.php [production]
23:09 <domas> banned all UA-less requests [production]
22:53 <logmsgbot_> midom synchronized php-1.5/wmf-config/checkers.php 'un-disabling UA check on API' [production]
22:14 <RoanKattouw> Resynced srv114, was returning empty responses [production]
22:10 <logmsgbot_> mark synchronized php-1.5/wmf-config/CommonSettings.php 'Test with 220px default thumb size on enwiki (bug #21117)' [production]
22:10 <logmsgbot_> mark synchronized php-1.5/wmf-config/InitialiseSettings.php 'Test with 220px default thumb size on enwiki (bug #21117)' [production]
22:02 <logmsgbot_> catrope synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' [production]
21:58 <logmsgbot_> catrope synchronized php-1.5/extensions/UsabilityInitiative/Vector/Vector.combined.min.js 'r62553' [production]
21:39 <logmsgbot_> catrope synchronized php-1.5/includes/api/ApiMain.php 'r62550' [production]
21:30 <logmsgbot_> mark synchronized php-1.5/wmf-config/InitialiseSettings.php 'raised wgSearchSuggestCacheExpiry from 1200 to 86400' [production]
21:27 <logmsgbot_> catrope synchronized php-1.5/includes/api/ApiOpenSearch.php 'r62548' [production]
21:27 <logmsgbot_> catrope synchronized php-1.5/includes/api/ApiMain.php 'r62548' [production]
21:27 <logmsgbot_> catrope synchronized php-1.5/includes/DefaultSettings.php 'r62548' [production]
20:54 <logmsgbot_> catrope synchronized php-1.5/includes/api/ApiBase.php 'r62546' [production]
20:54 <logmsgbot_> catrope synchronized php-1.5/api.php 'r62546' [production]
20:53 <domas> Roan and me are doing some perf engineering on opensearch & related stuff. \\o/ [production]
20:40 <logmsgbot_> midom synchronized php-1.5/includes/StubObject.php 'readding stub trace' [production]
20:34 <logmsgbot_> midom synchronized php-1.5/wmf-config/checkers.php 'perf comment action' [production]
20:30 <logmsgbot_> midom synchronized php-1.5/includes/StubObject.php 'removing trace hooks' [production]
20:28 <logmsgbot_> midom synchronized php-1.5/includes/StubObject.php [production]
20:24 <logmsgbot_> catrope synchronized php-1.5/includes/api/ApiOpenSearch.php 'r62543' [production]
19:32 <mark> Allowing API requests to be sent to the regular app servers temporarily [production]
19:27 <mark> Restarted sq31 and sq31 API backend squids with slightly reduced memory settings [production]
19:18 <logmsgbot_> mark synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
17:51 <Rob> set srv127 to false on lvs3, will re-enabled once in DC to reboot it manually [production]
17:49 <logmsgbot_> root synchronized php-1.5/wmf-config/mc.php 'srv127 down taking out of mc rotation' [production]
16:02 <RoanKattouw> Resynced srv134 to fix HTTP 500 [production]
15:13 <RoanKattouw> Resynced srv232, was serving HTTP 500s [production]
02:02 <mark> Fixed stale PHP file removal apache cron job in Puppet [production]
2010-02-14 §
19:25 <mark> srv206 spontaneously rebooted [production]
17:12 <mark> Added sq32 to the API backend squid group (with an empty cache) [production]
16:38 <mark> Confined all API requests to sq31 backend Squid [production]
12:54 <RoanKattouw> logmsgbot is broken [production]
2010-02-13 §
17:44 <mark> Made 64 bit java exception for search13 in puppet [production]
17:37 <mark> Converted srv214-218 and srv86-87 into API servers [production]
17:02 <mark> Throwing all API requests at the new API app server cluster [production]
16:49 <mark> Converted srv187-srv189 and srv250-srv253 into API app servers [production]
15:46 <mark> Created new Ganglia group "API application servers", deploying with Puppet [production]
15:31 <mark> Created API app servers group in Puppet, deploying on srv254-257 to start with [production]
15:24 <mark> Created API LVS service on lvs3 and restarted PyBal [production]
15:10 <mark> Added DNS entry for api.svc.pmpta.wmnet (LVS ip) [production]
14:18 <mark> Enabled more verbose logging on all squids: debug message level 1 for all message categories [production]
14:18 <mark> Disabled cache digests on all squids [production]
13:58 <mark> Removing sq30 and lower from the Text CARP pool [production]
13:51 <mark> Reducing persistent_connection_timeout and request_timeout from 1 min to 20s on all frontend squids, to reduce FD usage [production]
12:50 <mark> Restarting knsq* frontend squids with FD limit raised from 32k to 64k [production]