6751-6800 of 8000 results (14ms)
2009-03-05 §
15:07 <domas> db21 needs 2.6.28, hit the 2.6.24 deadlock problem [production]
2009-03-04 §
21:41 <Rob> final errors in OCS configuration fixed. ocs.wikimania2009.wikimedia.org is now working properly [production]
20:36 <Rob> added singer to nagios [production]
20:22 <Rob> setup proper email sending for ocs software install [production]
14:54 <Rob> pushed changes to InitialiseSettings for bug 13055 Make newpage patrolling available to autoconfirmed users on jawp [production]
14:43 <Rob> pushed changes to InitialiseSettings for bug 16289 patrol function assigned to all users, not autoconfirmed users, on nlwiki [production]
14:16 <mark> Brought knsq7 back up [production]
07:38 <domas> [[srv217]] was acting funny - lots of hanging processes which all decided to quit at strace. system locked up eventually, and hardware powercycle was done :) [production]
07:37 <domas> [[db24]] hanged again (triple checked, not when producing a snapshot), nothing in dmesg or SP log [production]
2009-03-03 §
18:26 <brion> setting our nameservers for transferred wikpedia.org domain [production]
17:09 <domas> re-enabled db5 and db25, db25 is serving as snaprotate slave for s3. [production]
06:15 <river> depooled db5 instead to dump from, left adler out of rotation [production]
06:13 <river> adler mysqld crashed during dump, i/o error: sd 2:2:0:0: [sda] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK,SUGGEST_OK [production]
06:02 <river> restarted replication on db30 [production]
05:06 <river> repooled db11 since it's the master and depooled db1 instead [production]
05:04 <river> depooled db11 to dump s3 [production]
2009-03-02 §
18:57 <brion> updating Collection ext to r47946; includes coll-license_url message for per-wiki license URL override [production]
16:15 <Rob> Updated and synced InitialiseSettings for bug 15927 Enable Special:Nuke on pl.wikipedia [production]
03:56 <river> removed db30 from rotation to dump commons [production]
2009-03-01 §
17:30 <river> repooled db7 [production]
16:29 <river> unpooled db7 to dump externallinks [production]
09:54 <Tim> doing apt-get update and reboot test on srv188 [production]
07:45 <Andrew> Deploying AbuseFilter to ruwiki per bug 17729 [production]
07:06 <Tim> deleting files from khaldun:/srv/ubuntu/pool that are over 2 years old [production]
06:52 <Tim> khaldun out of disk space as expected [production]
05:51 <Tim> switched the ubuntu mirror to use the one at neu.edu, which is much closer (43ms RTT) and thus faster for small files than the osuosl.org one [production]
05:46 <Tim> updated ApiQueryUsers.php to r47865 [production]
05:06 <Tim> disabled mirror cron job on khaldun temporarily, while the update running in my terminal completes [production]
04:26 <Tim> testing ubuntu mirroring on khaldun [production]
2009-02-28 §
03:19 <river> put db7 back in rotation [production]
2009-02-27 §
22:37 <Rob> setup daily backups of web directories from singer to tridge [production]
22:25 <Rob> setup https on singer for ocs software [production]
21:37 <Rob> singer installed and up, running wikimania2009 OCS software only at present. Will migrate other services to it at a later date/time. [production]
21:03 <river> stopped replication on db7 to dump s1 [production]
19:24 <Rob> installing and setting up new r300 singer for OCS install and eventual blog migration. [production]
12:21 <river> mounted /mnt/upload5 on srv78 [production]
2009-02-26 §
23:07 <mark> Attempted Ubuntu install on ms2, but Ubuntu doesn't fully support systems with > 16 disks. Awaiting their fix. [production]
23:06 <mark> Downpreffed paths _2828_7473_ and _2828_4637_ [production]
22:37 <brion> installed swap-watchdog on erzurumi [production]
22:25 <brion> tom rebooting pdf1 by LOM [production]
22:20 <brion> swapping spike on pdf1 [production]
21:54 <mark> Set up link aggregation over two GigE links on ms3 [production]
21:49 <Rob> replaced the favicon file for wikibooks and synced out per bug 17049 New favicon for Wikibooks projects [production]
21:36 <Rob> setup futher log rotation on pdf1 [production]
21:31 <brion> enabling Collection on sourceswiki ("old wikisource"), was forgotten the other day [production]
21:15 <Rob> setup log rotation of mw-serve.log on pdf1 [production]
21:02 <mark> Upgraded iLOM/BIOS on ms2 [production]
20:32 <Rob> restarted apache on srv193, srv197, srv201, srv217, srv223 [production]
20:28 <Rob> restarted apache on srv62, srv78, srv100, srv133, srv170, srv173, srv175, srv190 [production]
20:18 <Rob> restarted apache on srv135 and srv163 due to segfaults [production]