51-100 of 4696 results (1ms)
2009-11-23 §
20:11 <mark> Finished migrating NFS off db20 to a DRBD cluster of nfs2 (primary) and nfs1 (secondary) [production]
19:14 <RoanKattouw> prototype got stuck, rebooted it. Linode sucks and we should not use it ever again [production]
16:53 <mark> Re-signed puppet cert for fenari... why was it gone? [production]
12:39 <domas> spence was taken down by runaway rrdtool process, http://p.defau.lt/?8FAf9FtfQTbkSQKCcP_qmw [production]
11:00 <Andrew> Scapping to prod message updates [production]
10:49 <andrew> synchronized php-1.5/extensions/LiquidThreads_alpha/pages/NewUserMessagesView.php 'Merge r59353' [production]
10:35 <Andrew> Scapping [production]
10:34 <Andrew> Updating LiquidThreads to trunk state on alpha only [production]
08:28 <domas> sq14 has failed sdc [production]
02:05 <Tim> fixed clear-profile so that it works on fenari and other ubuntu hosts [production]
01:54 <tstarling> synchronized php-1.5/index.php 'test' [production]
01:54 <Tim> set up fenari's /root/.ssh/config like the one on zwinger, with its user known hosts file pointing to the global one [production]
01:41 <Tim> Moved logmsgbot to fenari. Opened up its UDP port to zwinger and added firewall rules to /etc/rc.local for honour-system access control. [production]
01:21 <Tim> commented out the nagios-specific nickserv stuff in ircecho, so that logmsgbot doesn't ghost nagios-wm [production]
01:11 <Tim> installed udprec at fenari:/usr/local/bin/udprec [production]
00:55 <Tim> on fenari, symlinked ddsh -> dsh (dancer's) so that the sync scripts can work [production]
2009-11-22 §
14:15 <domas> powercycled locke after 10h downtime [production]
10:45 <RoanKattouw> Reports that file deletion and undeletion on Commons is broken [production]
03:35 <rainman-sr> rebuilding mwsuggest index for en.wp which throws strange lucene exceptions, hopefully fresh built is going to solve it [production]
01:24 <rainman-sr> deployed latest lucene-search to test liquidthreads integration [production]
2009-11-21 §
21:03 <domas> sq13 needs reboot and probably hardware maintenance [production]
21:03 <domas> sq43 and sq37 need hdd replacements. [production]
20:46 <domas> squid peermonitor is receiving 504s from peers... [production]
20:45 <domas> firewalled too. [production]
20:44 <domas> cleaned up sq13 crap in remote logs on db20, was full / fs [production]
2009-11-20 §
22:11 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Adding 2009_Notice35 to whitelist' [production]
22:10 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Adding Notice30_EML to whitelist' [production]
19:13 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Added Help_Us_Change_the_World to allowed targets' [production]
18:44 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Added Help_Us_Change_the_World to allowed targets' [production]
18:41 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Enabling tracking of 2009_Notice30_EML' [production]
13:56 <mark> OS-installed nfs1 [production]
13:09 <mark> Renamed auth1 to nfs1 in DNS [production]
13:00 <mark> apt-get upgrade and reboot on fenari [production]
12:48 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Re-enabling ClickTracking with throttle 1:1000' [production]
12:46 <catrope> synchronized php-1.5/extensions/UsabilityInitiative/ClickTracking/ClickTracking.php 'Deploying r59284' [production]
12:46 <catrope> synchronized php-1.5/extensions/UsabilityInitiative/ClickTracking/ClickTracking.js 'Deploying r59284' [production]
04:51 <midom> synchronized php-1.5/wmf-config/db.php 'load test' [production]
04:49 <midom> synchronized php-1.5/wmf-config/db.php 'load test' [production]
2009-11-19 §
23:56 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'whitelisting 2009_Notice_30_EML' [production]
22:56 <fvassard> synchronized php-1.5/wmf-config/CommonSettings.php 'Enabling GeoIP for HU.' [production]
21:08 <mark> Shutting down bayle for decommissioning [production]
21:04 <mark> Stopped pdns recursor on bayle [production]
20:20 <andrew> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Fix error by Aaron allowing anybody to edit foundationwiki, which has wgRawHTML on...' [production]
19:57 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'NS_MEDIAWIKI edit rights for all users on foundationwiki' [production]
17:35 <mark> Upgrading pdns-recursor on lily to 3.1.7.1 [production]
17:33 <mark> Moved service ip 208.80.152.131 (first DNS resolver ip) from bayle to dobson [production]
17:25 <mark> Deployed new PowerDNS recursor on mchenry, with puppet [production]
15:14 <mark> Deploying new sudoers file on search servers with puppet, correcting sudo access to /usr/bin/jstack for rainman [production]
15:08 <mark> Removed stale spamassassin lock files on lily [production]
14:58 <mark> Rebooting lily [production]