2009-09-05
§
|
15:31 |
<apergos> |
apt-get clean on a few (srv220-224) hosts to buy us a tiny bit of disk space |
[production] |
13:13 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'added Proposal NS to default search on strategywiki' |
[production] |
13:00 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' |
[production] |
12:59 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' |
[production] |
12:32 |
<mark> |
Ganglia tmpfs filesystem on zwinger ran out of memory, removed some obsolete RRDs in there, and in the on-disk copy |
[production] |
11:18 |
<mark> |
Restarted confused gmetad_pmtpa on zwinger |
[production] |
11:15 |
<mark> |
Rebooting all new apache servers |
[production] |
11:15 |
<mark> |
Updating Nagios with the new servers failed. Could someone please update the docs? |
[production] |
11:06 |
<mark> |
Running apt-get dist-upgrade on all new servers |
[production] |
10:54 |
<mark> |
scap |
[production] |
10:53 |
<mark> |
Added new servers to dsh node groups |
[production] |
10:34 |
<mark> |
Installed puppet on srv227-srv253, signed all certificates |
[production] |
10:30 |
<mark> |
OS-installed srv227-srv253, except broken srv245 |
[production] |
08:27 |
<mark> |
Installed srv226 as mediawiki application server |
[production] |
08:15 |
<mark> |
Removed 29 GB of access.log in /usr/logs/ on mobile1 (why is it there and not logrotated?). Restarted thin, memcached. Test URL does not work, but the site itself does seem to work. Please check/update the docs! |
[production] |
2009-09-03
§
|
21:35 |
<atglenn> |
huh guess I should log this, gmond installed on ms5 (from old ts repo spec, v3.1 can't coexist with v3.0x), fred started collecting stats on it (yesterday) |
[production] |
17:48 |
<atglenn> |
first incremental zfs rep from ms1 to ms5, still using cat on the receiving end, mbuffer + zfs recv is just too slow |
[production] |
16:43 |
<mark> |
Installed gmond on mobile1 |
[production] |
16:39 |
<mark> |
Power cycled mobile1 |
[production] |
16:37 |
<brion> |
mobile1 not responding to ping, needs a reboot |
[production] |
02:34 |
<tstarling> |
synchronized php-1.5/wmf-config/CommonSettings.php 'removed PovWatch' |
[production] |
02:12 |
<rainman-sr> |
rsyncd died for some misterious reason on searchidx1, needs restarting |
[production] |
2009-09-01
§
|
22:42 |
<aaron> |
synchronized php-1.5/wmf-config/abusefilter.php 'log detail rights for autoconfirmed on dewiki' |
[production] |
21:31 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'removed unused flood flag added to eswikinews; eswikibooks was the correct wiki' |
[production] |
20:54 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'Re-sync for srv220' |
[production] |
20:16 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php |
[production] |
20:12 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'Cleaned-up redundant settings and a few instances of improper setting of autopromote array' |
[production] |
18:39 |
<Fred> |
Added Ganglia stats for /export usage on export2 |
[production] |
18:39 |
<Fred> |
Added Ganglia stats for /export usage |
[production] |
18:27 |
<Fred> |
rebooted srv156 after it went OOM |
[production] |
13:56 |
<mark> |
Power cycled mayflower |
[production] |
09:07 |
<domas> |
lily pdns was dead probably because of my tampering with defunct processes |
[production] |
02:27 |
<river> |
restarted pdns_recursor on lily as it had died somehow |
[production] |
2009-08-31
§
|
23:32 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'rollback group for arwiki' |
[production] |
23:24 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'autopatrol for rollbackers on svwiki' |
[production] |
22:02 |
<aaron> |
synchronized php-1.5/wmf-config/abusefilter.php 'log detail rights for autoconfirmed on zhwiki' |
[production] |
21:55 |
<aaron> |
synchronized php-1.5/wmf-config/abusefilter.php 'itwiki abusefilter settings' |
[production] |
20:26 |
<aaron> |
synchronized php-1.5/wmf-config/abusefilter.php 'itwiki abusefilter settings' |
[production] |
20:08 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'rollback, autoreviewer, and confirmed groups for zh_yuewiki' |
[production] |
19:49 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'flood flag for eswikibooks' |
[production] |
12:18 |
<domas> |
restarted srv183 via drac |
[production] |