|
2009-09-05
§
|
| 16:34 |
<apergos> |
cleared out some stuff in /tmp on srv220-224 to free up more space. this is only a TEMPORARY FIX |
[production] |
| 16:32 |
<MC8> |
Testing the log; please don't eat me |
[production] |
| 16:29 |
<hcatlin> |
Setup autoclearing logs on mobile1 |
[production] |
| 15:46 |
<midom> |
synchronized php-1.5/includes/GlobalFunctions.php 'removing extended profiling' |
[production] |
| 15:31 |
<apergos> |
apt-get clean on a few (srv220-224) hosts to buy us a tiny bit of disk space |
[production] |
| 13:13 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'added Proposal NS to default search on strategywiki' |
[production] |
| 13:00 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' |
[production] |
| 12:59 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' |
[production] |
| 12:32 |
<mark> |
Ganglia tmpfs filesystem on zwinger ran out of memory, removed some obsolete RRDs in there, and in the on-disk copy |
[production] |
| 11:18 |
<mark> |
Restarted confused gmetad_pmtpa on zwinger |
[production] |
| 11:15 |
<mark> |
Rebooting all new apache servers |
[production] |
| 11:15 |
<mark> |
Updating Nagios with the new servers failed. Could someone please update the docs? |
[production] |
| 11:06 |
<mark> |
Running apt-get dist-upgrade on all new servers |
[production] |
| 10:54 |
<mark> |
scap |
[production] |
| 10:53 |
<mark> |
Added new servers to dsh node groups |
[production] |
| 10:34 |
<mark> |
Installed puppet on srv227-srv253, signed all certificates |
[production] |
| 10:30 |
<mark> |
OS-installed srv227-srv253, except broken srv245 |
[production] |
| 08:27 |
<mark> |
Installed srv226 as mediawiki application server |
[production] |
| 08:15 |
<mark> |
Removed 29 GB of access.log in /usr/logs/ on mobile1 (why is it there and not logrotated?). Restarted thin, memcached. Test URL does not work, but the site itself does seem to work. Please check/update the docs! |
[production] |
|
2009-09-03
§
|
| 21:35 |
<atglenn> |
huh guess I should log this, gmond installed on ms5 (from old ts repo spec, v3.1 can't coexist with v3.0x), fred started collecting stats on it (yesterday) |
[production] |
| 17:48 |
<atglenn> |
first incremental zfs rep from ms1 to ms5, still using cat on the receiving end, mbuffer + zfs recv is just too slow |
[production] |
| 16:43 |
<mark> |
Installed gmond on mobile1 |
[production] |
| 16:39 |
<mark> |
Power cycled mobile1 |
[production] |
| 16:37 |
<brion> |
mobile1 not responding to ping, needs a reboot |
[production] |
| 02:34 |
<tstarling> |
synchronized php-1.5/wmf-config/CommonSettings.php 'removed PovWatch' |
[production] |
| 02:12 |
<rainman-sr> |
rsyncd died for some misterious reason on searchidx1, needs restarting |
[production] |
|
2009-09-01
§
|
| 22:42 |
<aaron> |
synchronized php-1.5/wmf-config/abusefilter.php 'log detail rights for autoconfirmed on dewiki' |
[production] |
| 21:31 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'removed unused flood flag added to eswikinews; eswikibooks was the correct wiki' |
[production] |
| 20:54 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'Re-sync for srv220' |
[production] |
| 20:16 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php |
[production] |
| 20:12 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'Cleaned-up redundant settings and a few instances of improper setting of autopromote array' |
[production] |
| 18:39 |
<Fred> |
Added Ganglia stats for /export usage on export2 |
[production] |
| 18:39 |
<Fred> |
Added Ganglia stats for /export usage |
[production] |
| 18:27 |
<Fred> |
rebooted srv156 after it went OOM |
[production] |
| 13:56 |
<mark> |
Power cycled mayflower |
[production] |
| 09:07 |
<domas> |
lily pdns was dead probably because of my tampering with defunct processes |
[production] |
| 02:27 |
<river> |
restarted pdns_recursor on lily as it had died somehow |
[production] |