7501-7550 of 10000 results (25ms)
2009-07-25 §
21:12 <RoanKattouw> Stopping Apache on prototype, because it gets stuck in OOM death or whatever it is after about 5 minutes every time [production]
20:46 <mark> Preffed traffic to 15169 (Google) via 13680 [production]
20:05 <RoanKattouw> Rebooted prototype [production]
2009-07-24 §
21:51 <hcatlin> pushed new mobile code to support multiple notices [production]
20:08 <brion> added $wgUseXVO = true to default config in InitialiseSettings so it'll be there when bug 19845 fix goes live [production]
19:11 <tomaszf> starting three xml snapshot threads [production]
18:59 <tomaszf> pointing storage2 to /export/dumps instead of /export/archive [production]
17:06 <domas> removed henbane & amaryllis from nagios [production]
10:54 <midom> synchronized php-1.5/wmf-config/../includes/specials/SpecialSearch.php 'livehack per rainmans suggestion' [production]
05:31 <Tim> download.wikimedia.org was totally broken, just showing a few empty directories. Changed the document root on storage2 to /export/archive/public, where there appears to be some useful files [production]
2009-07-23 §
22:16 <mark> Decommissioned all yaseo servers, wiped their disks [production]
20:35 <mark> Updated the glue record for ns1.wikimedia.org [production]
20:20 <mark> Changed IP of ns1.wikimedia.org to 208.80.152.142 (a svc ip on linne) [production]
19:58 <mark> Installed linne.wikimedia.org as auth DNS server [production]
19:12 <brion> synchronized wmf-deployment/wmf-config/CommonSettings.php 'restore FancyCaptcha now that image crisis is diverted' [production]
15:38 <Rob> setup strategywiki for the strategy planning whatever [production]
15:37 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
15:32 <robh> ran sync-common-all [production]
2009-07-22 §
21:20 <Fred> installing wikimedia-task-appserver on srv122. Incoming reboot [production]
15:11 <Tim> fixed firewall on browne to deny RC->IRC UDP packets from outside the local network [production]
09:57 <midom> synchronized php-1.5/wmf-config/../StartProfiler.php [production]
09:51 <domas> apparently someone decided that our profiling is not useful and should be disabled? :) [production]
2009-07-21 §
23:56 <Fred> rebooted pascal (for realz this time) [production]
23:15 <tomaszf> fred is pulling backups from ms4 onto storage2. [production]
23:07 <Fred> rebooting pascal as he fell over again [production]
22:45 <tomaszf> adding snapshot1,2,3 to DHCP [production]
22:03 <mark> Increased large object cache dir size to 120 GB on eiximenis [production]
18:28 <domas> srv122 booted into netinstall, apparently [production]
17:39 <Rob> updated both blog and techblog to newest stable release of wordpress [production]
16:36 <brion> internal UDP logging broken since 17 July; looks like udp2log isn't running on db20 since reboot? [production]
16:21 <robh> synchronized php-1.5/wmf-config/CommonSettings.php 'death to captcha' [production]
16:15 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php 'death to the uplaoder group' [production]
16:06 <robh> synchronized php-1.5/wmf-config/CommonSettings.php [production]
16:00 <Rob> updated sync-fiel script for new file locations [production]
16:00 <robh> synchronized php-1.5/wmf-config/CommonSettings.php [production]
15:50 <Rob> removing old whygive blog data from dns and archiving the database. [production]
15:07 <Rob> updated planet with http://meta.wikimedia.org/wiki/Planet_Wikimedia#Requests_for_inclusion [production]
14:43 <mark> Increased COSS cache dirs on pmtpa upload squids [production]
11:30 <domas> for i in $(ssh db20 findevilapaches); do ssh $i invoke-rc.d apache2 restart; done \\o/ [production]
11:29 <domas> killed brion's sync processes on zwinger, hanging since July17 :) [production]
09:15 <domas> mgmt-restarted srv156 [production]
2009-07-20 §
22:18 <mark> Rebooted pascal [production]
21:15 <mark> Doubled cache dir sizes on eiximenis, upped carp load from 20 to 30 [production]
18:09 <hcatlin> restarted mobile1 cluster to load in new software [production]
15:55 <Fred> bounced apache on srv193 [production]
07:18 <Tim> re-enabled CentralNotice [production]
07:18 <tstarling> synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
07:13 <apergos> enough data removed from ms1 to feel safe for a few days; started mass copy of remaining thumbs to ms4 in prep for complete repo switchover (running in root screen on ms1) [production]
04:48 <Tim> copying up all available MW release files from my laptop [production]
04:21 <Tim> mounted ms4:/export/dumps on zwinger [production]