751-800 of 4171 results (7ms)
2009-08-28 §
17:11 <domas> srv194 seems to be deciding not to use APC, somewhere at apc_cache_busy() or somewhere near - same problem seen few times before on other servers [production]
15:23 <domas> compression that is, not encoding ;-) [production]
15:22 <midom> synchronized php-1.5/includes/OutputHandler.php 'bumped up encoding from 3 to 9' [production]
15:12 <Tim> added mobile1 to the tiertwo ACL so that it gets X-Cache headers [production]
15:09 <midom> synchronized php-1.5/includes/AutoLoader.php 'removing profiling hook' [production]
14:50 <midom> synchronized php-1.5/includes/OutputHandler.php 'ooooops' [production]
14:49 <midom> synchronized php-1.5/includes/OutputHandler.php 'compression profiling hook' [production]
14:33 <mark> Set up blocking of unnecessary http headers in squid [production]
2009-08-27 §
20:50 <brion> rerunning past commit parser tests as i deleted them all by mistake :P [production]
20:22 <brion> re-disabling pdfhandler on wikitech, something ain't rendering right yet [production]
20:15 <midom> synchronized php-1.5/wmf-config/db.php [production]
20:14 <rainman_> move eswiki highlighting from search4 to search11 to balance out the load a bit better [production]
20:02 <brion> installing PdfHandler on wikitech; udpating to current wmf-deployment [production]
19:52 <brion> re-running parsertests for rev 55603 and above after updating php packages [production]
19:29 <brion_> attempting to apt-get upgrade on wikitech, see if that helps crashy tests [production]
18:25 <mark> Restarted squid frontend on eiximenis [production]
17:53 <Tim> fixing missing blobs tables on ms3 cluster rc1 [production]
17:44 <Tim> running recompressTracked.sh on hume [production]
17:40 <mark> Shutdown MySQL on ms2 for reboot [production]
17:28 <mark> Replication on ms2 caught up with master ms3 [production]
17:08 <mark> Recovered data on ms2 by rebuilding raid-arrays, started mysql, started replication [production]
16:44 <midom> synchronized php-1.5/wmf-config/InitialiseSettings.php 'remove optin for performance reasons' [production]
16:43 <midom> synchronized php-1.5/wmf-config/InitialiseSettings.php 'remove optin for performance reasons' [production]
16:28 <mark> Installed gmond on mayflower [production]
16:20 <mark> Power cycled mayflower again [production]
16:06 <mark> Recovering RAID arrays on ms2 [production]
15:43 <brion> updating to wmf-deployment r55629 -- fixes to api, (un)delete storage, and collection [production]
15:33 <tstarling> synchronized php-1.5/includes/Revision.php 'r55628' [production]
15:26 <midom> synchronized php-1.5/includes/AutoLoader.php 'profiling' [production]
15:10 <domas> bunch of servers in srv190+ range have intermittent network problems, leading to connection failures, etc [production]
14:58 <tstarling> synchronized php-1.5/includes/Revision.php 'testing archive issue pre-commit' [production]
10:03 <mark> Power cycled mayflower (svn) [production]
2009-08-26 §
21:56 <Tim> observing overload on s4 slaves due to long-running ApiQueryBacklinks queries, will kill [production]
21:29 <brion> update to r55616 -- fixlets and api limit tweak [production]
18:11 <midom> synchronized php-1.5/includes/AutoLoader.php 'profiling hook' [production]
17:08 <brion> rerunning parser tests for r55603; temporary failure on the test box [production]
2009-08-25 §
15:52 <midom> synchronized php-1.5/wmf-config/db.php 'mwahahaha' [production]
15:47 <midom> synchronized php-1.5/wmf-config/db.php [production]
15:44 <midom> synchronized php-1.5/wmf-config/db.php 'load testing, muhaha' [production]
15:40 <midom> synchronized php-1.5/wmf-config/db.php 'putting storage1 to cluster22' [production]
14:21 <brion> synchronized php-1.5/wmf-config/InitialiseSettings.php 'enable PdfHandler sitewide; forgot to do this earlier :D' [production]
2009-08-24 §
00:45 <domas> CPU 100% on apache cluster for few minutes, reason unknown :) (thats what 'unbalanced load' probably means, hehe) [production]
00:12 <brion> unbalanced load; db16 reporting too many connected threads [production]
2009-08-23 §
23:32 <brion> synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 20363: namespace fixes' [production]
23:14 <Fred> HD in db18 Enclosure 0 Slot 21 failed and needs to be replaced. [production]
23:12 <Fred> HD in db21 - Enclosure0 Slot 7 needs to be replaced. [production]
22:55 <Fred> restarted apache on srv140 [production]
22:55 <Fred> restarted memcached on srv197 [production]
16:43 <Fred> restarted memcached on srv211 [production]
00:50 <brion> synchronized php-1.5/wmf-config/InitialiseSettings.php '20338 Enable Collection on Bengali Wikipedia' [production]