1-50 of 2969 results (3ms)
2009-07-21 §
23:56 <Fred> rebooted pascal (for realz this time) [production]
23:15 <tomaszf> fred is pulling backups from ms4 onto storage2. [production]
23:07 <Fred> rebooting pascal as he fell over again [production]
22:45 <tomaszf> adding snapshot1,2,3 to DHCP [production]
22:03 <mark> Increased large object cache dir size to 120 GB on eiximenis [production]
18:28 <domas> srv122 booted into netinstall, apparently [production]
17:39 <Rob> updated both blog and techblog to newest stable release of wordpress [production]
16:36 <brion> internal UDP logging broken since 17 July; looks like udp2log isn't running on db20 since reboot? [production]
16:21 <robh> synchronized php-1.5/wmf-config/CommonSettings.php 'death to captcha' [production]
16:15 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php 'death to the uplaoder group' [production]
16:06 <robh> synchronized php-1.5/wmf-config/CommonSettings.php [production]
16:00 <Rob> updated sync-fiel script for new file locations [production]
16:00 <robh> synchronized php-1.5/wmf-config/CommonSettings.php [production]
15:50 <Rob> removing old whygive blog data from dns and archiving the database. [production]
15:07 <Rob> updated planet with http://meta.wikimedia.org/wiki/Planet_Wikimedia#Requests_for_inclusion [production]
14:43 <mark> Increased COSS cache dirs on pmtpa upload squids [production]
11:30 <domas> for i in $(ssh db20 findevilapaches); do ssh $i invoke-rc.d apache2 restart; done \\o/ [production]
11:29 <domas> killed brion's sync processes on zwinger, hanging since July17 :) [production]
09:15 <domas> mgmt-restarted srv156 [production]
2009-07-20 §
22:18 <mark> Rebooted pascal [production]
21:15 <mark> Doubled cache dir sizes on eiximenis, upped carp load from 20 to 30 [production]
18:09 <hcatlin> restarted mobile1 cluster to load in new software [production]
15:55 <Fred> bounced apache on srv193 [production]
07:18 <Tim> re-enabled CentralNotice [production]
07:18 <tstarling> synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
07:13 <apergos> enough data removed from ms1 to feel safe for a few days; started mass copy of remaining thumbs to ms4 in prep for complete repo switchover (running in root screen on ms1) [production]
04:48 <Tim> copying up all available MW release files from my laptop [production]
04:21 <Tim> mounted ms4:/export/dumps on zwinger [production]
04:16 <Tim> changed export options for ms4:/export/dumps to allow root access for the local subnet [production]
01:19 <hcatlin> On mobile1 we are now gzipping the log files after rotation in /srv/wikimedia-mobile/logs [production]
2009-07-19 §
22:02 <Fred> restarted memcached on srv159 [production]
20:43 <mark> eiximenis backend squid pooled [production]
20:10 <mark> Restarted deadlocked powerdns on bayle [production]
19:14 <mark> Installed eiximenis with a Squid OS install [production]
18:58 <mark> Moved eiximenis to vlan 100 (squids) [production]
18:55 <mark> Changed eiximenis' IP into 208.80.152.119 for Squid testing [production]
17:41 <hcatlin> Mobile1's web stack just got switched from Phusion Passenger to Nginx/Thin/Rack. [production]
2009-07-18 §
15:23 <apergos> some thumb directories on ms4 created at request of img scalers were created with owner root and perms 700... fixing [production]
03:55 <river> ms5 is ready [production]
01:20 <atglenn> continuing with removals of thumbs on ms1. 789G free now, need to reach about 1450 before we can just "maintain". but we're gaining on it. [production]
00:22 <brion> set up temporary data dump index, copied the dvd index (it's just offsite links). still need to track some MW releases [production]
00:07 <brion> recovering MediaWiki 1.6 through 1.10 release files and re-uploading them... [production]
2009-07-17 §
23:42 <brion> added a 404 page and recovered index.php for our temp download.wikimedia.org [production]
22:05 <brion> set wikitech to use vector skin by default :D [production]
22:03 <Andrew> Fixed morebots, which was relying on a fragile version check. Just deleted it :) [production]
22:02 <Andrew> testing [production]
20:43 <brion> fixed paths for noc.wikimedia.org/conf file highlighting [production]
20:38 <domas> ms2 has broken disks.. [production]
20:31 <brion> We're going to see about setting up the previously-idle ms5 so we can get our thumbnailing on [production]
20:01 <brion> rob's poking raid rebuild on storage2 (dumps server) [production]