501-550 of 6022 results (10ms)
2010-02-01 §
20:50 <Rob> srv217 shutdown until checked [production]
20:50 <Rob> srv217 not responsive to network, but LOM works and system is jut not working online, possible bad cable, will check in DC tomorrow [production]
20:43 <mark> synchronized php-1.5/wmf-config/CommonSettings.php 'Added 36 new Squid servers, removed bart' [production]
20:39 <mark> Deployed new wikimedia-base package that no longer manages sysctl.conf post Hardy, letting puppet handle it [production]
20:10 <atglenn> restarted webserver on ms7 to read new conf (fix bug 22321) [production]
20:09 <mark> Granted cary access to the OTRS db from fenari [production]
19:27 <RoanKattouw> srv9 reported down, pinging yields Host Unreachable. srv9 is not in Nagios but seems to be in use [production]
18:51 <Fred> swapped memcache node from srv145 to srv196 [production]
2010-01-31 §
21:18 <domas> db28 has a failed dimm [production]
2010-01-30 §
22:29 <RoanKattouw> Scheduling more batches for import overnight using at(1), see http://commons.wikimedia.org/wiki/Commons:Batch_uploading/Geograph#Progress [production]
22:13 <RoanKattouw> Running image imports overnight on hume, three parallel import scripts started each five hours, see http://commons.wikimedia.org/wiki/Commons:Batch_uploading/Geograph for details [production]
22:12 <apergos> restarted morebots, must have died after last night's freenode irc move [production]
04:40 <Tim> fixed broken /etc/rc.local on wikitech [production]
2010-01-29 §
23:21 <domas> restarted sq37 for being in bad shape. [production]
22:25 <tomaszf> starting xml snapshots back up on snapshots3 [production]
21:31 <atglenn> cleared out cruft from /tmp on srv158 (how about a cron job? :-P ) [production]
18:39 <catrope> synchronized php-1.5/maintenance/importImages.php 'Deploy r59908' [production]
16:20 <Rob> db28 mainboard replaced, updated LOM to work, updated dhcp with new mac address info [production]
02:50 <apergos> started copy of media data from ms7 to ms8 (nc running in screen as root on both hosts) [production]
01:51 <andrew> synchronized php-1.5/cache/interwiki.cdb 'Updating interwiki cache for new wikitech entry' [production]
2010-01-28 §
22:58 <domas> test [production]
20:15 <Rob> racked sq51-sq68, all drac accessible, wired, ready for install [production]
19:05 <Rob> updated dns for management ranges on new squid servers [production]
13:56 <mark> Added DNS entries for 36 new Squid servers [production]
13:28 <mark> Storage1 went down due to I/O failure [production]
13:00 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Remove aliases made obsolete by r61632' [production]
12:55 <catrope> synchronized php-1.5/languages/messages/MessagesMl.php 'Deploying r61632' [production]
10:57 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'supressredirect for rollbackers on ruwikisource' [production]
09:30 <aaron> synchronized php-1.5/wmf-config/flaggedrevs.php 'Removed redundant huwiki settings' [production]
2010-01-27 §
18:04 <mark> Fixed ExtensionDistributor, which broke due to the image server migration [production]
18:02 <mark> synchronized php-1.5/extensions/ExtensionDistributor/svn-invoker.php 's/upload5/upload6/' [production]
16:10 <mark> Added a timeout to puppet's apt-get update execution; hopefully this will prevent things from getting stuck for weeks [production]
16:08 <mark> Shutdown sq20 once again, please decommission this broken box [production]
16:05 <mark> Fixed puppet on db7 [production]
16:05 <mark> Killed stuck apt-get update processes on all servers [production]
15:58 <mark> Made puppet manage NFS mounts /mnt/upload6, /mnt/thumbs and the absence of /mnt/upload5 on all application servers and image scalers [production]
13:37 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Fix Category talk alias on mlwiki' [production]
11:57 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Also add a Unicode 5.1 alias for Category talk on mlwiki' [production]
11:52 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 22286: Unicode 5.1 namespace alias for Category on mlwiki' [production]
11:46 <catrope> synchronized php-1.5/includes/api/ApiQueryBacklinks.php 'Deploying r61571' [production]
08:12 <andrew> synchronized php-1.5/extensions/LiquidThreads/lqt.js [production]
08:11 <andrew> synchronized php-1.5/extensions/LiquidThreads_alpha/lqt.js [production]
2010-01-26 §
23:44 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Enable file uploads.' [production]
23:34 <Fred> restarted morebot [production]
21:10 <atglenn> copying uploaded data since last replication, from ms1 to ms7 [production]
21:05 <atglenn> turned off file uploads temporarily [production]
21:04 <ariel> synchronized wmf-deployment/wmf-config/CommonSettings.php [production]
20:50 <Rob> rebooted srv125 per dc task entry by fred [production]
20:35 <tomaszf> enabling global file uploads notice [production]
20:29 <catrope> synchronized php-1.5/extensions/GlobalUsage/GlobalUsage.php 'Deploying r61534' [production]