701-750 of 3718 results (7ms)
2009-07-29 §
18:17 <Rob> srv118 and srv130 back online [production]
18:15 <Rob> rebooted srv131 for lockup [production]
18:13 <Rob> rebooting srv118 & srv130, locked up [production]
18:11 <Rob> srv110 and srv113 back online [production]
18:08 <Rob> rebooted srv110, srv113, both locked up [production]
16:18 <river> removed stale fingerprint for ns1.wikimedia.org on bayle [production]
14:01 <Rob> shutting down mysql on db12, when done will shut down system and replace bad battery on controller [production]
13:30 <Rob> upgraded dobson memory for squid ssh testing [production]
13:24 <Rob> shutdown eiximenis, upgraded ram [production]
04:36 <Tim> running svn cleanup on locked directories as indicated by find -name lock [production]
04:19 <Tim> resharing ms1:/export/upload with root allowed, so that the above command actually works [production]
04:15 <Tim> fixing ExtensionDistributor permissions with: find -not -user extdist -exec chown extdist {} \\; [production]
04:11 <Tim> reduced the number of svn-invoker threads on zwinger to 1, to hopefully avoid permanent "lock held" errors (bug 19889) [production]
2009-07-28 §
21:35 <brion> updating to wmf-deployment branch r53906 - adds search API output details [production]
18:06 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php 'setting skin to vector on strategywiki' [production]
17:58 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php 'setting subpages and lang for strategywiki' [production]
16:55 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '#19908 - remove some redundant settings for wmgUseCollection' [production]
16:55 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '#19908 - remove some redundant settings for wmgUseCollection' [production]
16:54 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '#19908 - remove some redundant settings for wmgUseCollection' [production]
09:40 <Tim> updating SecurePoll via branch [production]
2009-07-27 §
23:03 <atglenn> installed sudo and added george wilson (sun guy) to sudoers on ms1 [production]
20:41 <mark> Shut down BGP transit session to AS 13680 on seemingly faulty blade 8 in csw5-pmtpa [production]
18:05 <atglenn> added account for george wilson (sun zks dev) on spence and ms1 [production]
17:52 <tomaszf> adding one more worker to snapshots taking total to eight [production]
17:05 <mark> Shutdown BGP peer 8342 (RTComm) to see if it resolves the reachability issues from Russia [production]
2009-07-26 §
21:54 <hcatlin_> just pushed UI tweaks to the mobile server [production]
2009-07-25 §
21:17 <RoanKattouw> Reenabled Apache on prototype with a disallow-all robots.txt; it seems GoogleBot was DoSing us [production]
21:12 <RoanKattouw> Stopping Apache on prototype, because it gets stuck in OOM death or whatever it is after about 5 minutes every time [production]
20:46 <mark> Preffed traffic to 15169 (Google) via 13680 [production]
20:05 <RoanKattouw> Rebooted prototype [production]
2009-07-24 §
21:51 <hcatlin> pushed new mobile code to support multiple notices [production]
20:08 <brion> added $wgUseXVO = true to default config in InitialiseSettings so it'll be there when bug 19845 fix goes live [production]
19:11 <tomaszf> starting three xml snapshot threads [production]
18:59 <tomaszf> pointing storage2 to /export/dumps instead of /export/archive [production]
17:06 <domas> removed henbane & amaryllis from nagios [production]
10:54 <midom> synchronized php-1.5/wmf-config/../includes/specials/SpecialSearch.php 'livehack per rainmans suggestion' [production]
05:31 <Tim> download.wikimedia.org was totally broken, just showing a few empty directories. Changed the document root on storage2 to /export/archive/public, where there appears to be some useful files [production]
2009-07-23 §
22:16 <mark> Decommissioned all yaseo servers, wiped their disks [production]
20:35 <mark> Updated the glue record for ns1.wikimedia.org [production]
20:20 <mark> Changed IP of ns1.wikimedia.org to 208.80.152.142 (a svc ip on linne) [production]
19:58 <mark> Installed linne.wikimedia.org as auth DNS server [production]
19:12 <brion> synchronized wmf-deployment/wmf-config/CommonSettings.php 'restore FancyCaptcha now that image crisis is diverted' [production]
15:38 <Rob> setup strategywiki for the strategy planning whatever [production]
15:37 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
15:32 <robh> ran sync-common-all [production]
2009-07-22 §
21:20 <Fred> installing wikimedia-task-appserver on srv122. Incoming reboot [production]
15:11 <Tim> fixed firewall on browne to deny RC->IRC UDP packets from outside the local network [production]
09:57 <midom> synchronized php-1.5/wmf-config/../StartProfiler.php [production]
09:51 <domas> apparently someone decided that our profiling is not useful and should be disabled? :) [production]
2009-07-21 §
23:56 <Fred> rebooted pascal (for realz this time) [production]