|
2008-11-04
§
|
| 21:36 |
<Tim> |
added nagios monitoring of HTTP on image backends |
[production] |
| 21:14 |
<Tim> |
installed NRPE stuff on db19 |
[production] |
| 19:37 |
<Tim> |
killed the broken NFS mount on db21:/mnt with umount -l. The processes that are waiting for it will probably hang until system restart |
[production] |
| 18:33 |
<brion_> |
enabling ja-wikipedia notice for testing :D |
[production] |
| 18:32 |
<Tim> |
installed nagios stuff on db21,db22,db23 |
[production] |
| 18:27 |
<Tim> |
srv104 done, cluster18 re-added to the write list |
[production] |
| 18:15 |
<Tim> |
installed NRPE on srv159,srv171,srv183 |
[production] |
| 17:25 |
<domas> |
bounced db16 after jfs deadlock |
[production] |
| 17:24 |
<brion> |
settin' centralnotice on wikibooks to test, should show up in a few minutes |
[production] |
|
2008-11-03
§
|
| 22:05 |
<brion> |
enabled extra file upload types for foundationwiki, since it's restricted-write-access |
[production] |
| 20:47 |
<brion> |
Special:ContributionTracking form submission intermediary live on foundationwiki |
[production] |
| 20:33 |
<brion> |
scapping for ContribtionTracking extension |
[production] |
| 19:59 |
<brion> |
enabled mp3 and aiff uploads for private wikis so jay can upload some radio PSAs for fundraiser |
[production] |
| 19:46 |
<brion> |
poking $wgSquidMaxage from 31 days to 1 hour on wikimediafoundation.org, since templates and funkypage URLs may do funky things and not get purged (extra parameters) |
[production] |
| 19:32 |
<brion> |
note there's no notice up yet ;) |
[production] |
| 19:32 |
<brion> |
enabling centralnotice loader on all wikis |
[production] |
| 11:00 |
<domas> |
''mount -o remount,nobarrier /a'' on db15, observed 20x more performance. I am an idiot. :) |
[production] |
| 02:36 |
<brion-away> |
got a test centralnotice notice running on test.wikipedia.org. rock on |
[production] |
| 02:23 |
<Krimpet> |
Hi, Mom!!! :D |
[production] |
| 02:18 |
<brion> |
set up every-10-minute cronjob on zwinger to regen the centralnotice template JS files |
[production] |
| 02:10 |
<brion> |
centralnotice .js file loader up on test and meta for poking at |
[production] |
| 01:12 |
<mark> |
level 3 blackholing of traffic disappeared, brought BGP sessions back up |
[production] |
| 00:59 |
<mark> |
shutdown BGP session to AS 30217, for blackholing of traffic behind it (L3?) |
[production] |
| 00:58 |
<brion> |
network problems at pmtpa |
[production] |
| 00:44 |
<brion> |
for fun, did some load-time optimization on wikitech. trimmed out unneeded user/site .js, consolidated several .js files, and enabled mod_deflate for .css/.js. ssl setup time still sucks, and it's still a 1.7GHz Celeron. :) |
[production] |
|
2008-11-02
§
|
| 23:43 |
<brion> |
added bot flag to domas's log bot so it doesn't get hit by the URL captcha |
[production] |
| 23:29 |
<domas> |
db19 jfs deadlocked |
[production] |
| 23:28 |
<brion> |
scapping for CentralNotice tweak update |
[production] |
| 23:11 |
<brion> |
setting up ContactFormFundraiser on wikimediafoundation.org for fundraiser templates |
[production] |
| 22:52 |
<brion> |
scapping for ContactPageFundraiser setup |
[production] |
| 22:41 |
<brion> |
poked spamregex update |
[production] |
| 22:14 |
<brion> |
added 403 block in checkers.php for 'speichern' GET parameter -- bug in a common dewiki user script allowing CSRF-type vandalism |
[production] |
| 14:49 |
<domas> |
few missing .frm files on db18 were causing trouble, resynced them from db19, resumed replication |
[production] |
| 13:02 |
<river> |
copying en from storage1 to ms1 |
[production] |
| 10:49 |
<domas> |
replaced XFS with JFS on db18, installed ganglia on db17-db30 |
[production] |
|
2008-11-01
§
|
| 22:48 |
<brion> |
fixed ContributionReporting to force a utf8 connection, now loads names in right charset |
[production] |
| 22:20 |
<brion> |
fixed $wgNoticeInfrastructure setting; defaults must have changed at some point |
[production] |
| 22:15 |
<domas> |
installed wikimedia-mysql4 on db21-23, established s1,s2,s3 replication. we now have full database copy in sdtpa \\o/ |
[production] |
| 20:53 |
<brion> |
deploying CentralNotice editing system on meta, woo |
[production] |
| 20:28 |
<brion> |
scapping to update reporting and centralnotice bits internally |
[production] |
| 19:38 |
<brion> |
rescapping to make sure 159 is unbroken |
[production] |
| 19:27 |
<brion> |
svn up'ing on wikitech just for domas |
[production] |
| 19:25 |
<brion> |
srv159 is out of space |
[production] |
| 19:20 |
<brion> |
scapping to update ContributionReporting ext |
[production] |
| 12:56 |
<mark> |
uppreffed traffic from knams to pmtpa via 6908/2828, as existing peering path had slight packet loss |
[production] |