6551-6600 of 10000 results (14ms)
2009-09-06 §
21:12 <mark> Puppetised srv151-160 [production]
20:54 <mark> Restarted all job runners to use the local mediawiki copy instead of /home [production]
20:53 <mark> synchronized php-1.5/maintenance/jobs-loop.sh 'Update path to use wmf-deployment branch' [production]
20:41 <mark> Puppetised srv211-218 [production]
20:38 <mark> Puppetised srv201-srv210 [production]
20:34 <mark> Puppetised srv191-srv200 [production]
20:30 <mark> Puppetised srv181-srv190 [production]
20:22 <mark> Not puppetising srv151-160 because of job queue runners [production]
20:15 <mark> Puppetised srv141-srv150 [production]
20:11 <mark> Puppetised srv131-srv140 [production]
20:07 <mark> Puppetised srv121-srv130 [production]
20:02 <mark> Puppetised srv111-srv120 [production]
19:57 <mark> Puppetised srv103-srv110 [production]
19:46 <mark> Puppetised srv102 [production]
19:45 <mark> Puppetised srv101 [production]
19:13 <mark> Converted eiximenis into a text squid [production]
16:38 <mark> synchronized php-1.5/wmf-config/CommonSettings.php 'Added eiximenis to the Squid list, and removed obsolete entries' [production]
01:05 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'rollback group for simplewiktionary' [production]
2009-09-05 §
23:47 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'desirability rating on strategywiki' [production]
23:36 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'rollback group for simplewiktionary' [production]
21:10 <domas> amane has I/O failures [production]
20:13 <mark> Pooled application servers srv226-253 [production]
17:41 <domas> svn switch --relocate http://svn.wikimedia.org/ svn+ssh://svn.wikimedia.org/ [production]
16:34 <apergos> cleared out some stuff in /tmp on srv220-224 to free up more space. this is only a TEMPORARY FIX [production]
16:32 <MC8> Testing the log; please don't eat me [production]
16:29 <hcatlin> Setup autoclearing logs on mobile1 [production]
15:46 <midom> synchronized php-1.5/includes/GlobalFunctions.php 'removing extended profiling' [production]
15:31 <apergos> apt-get clean on a few (srv220-224) hosts to buy us a tiny bit of disk space [production]
13:13 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'added Proposal NS to default search on strategywiki' [production]
13:00 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' [production]
12:59 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed ruwikiquote config' [production]
12:32 <mark> Ganglia tmpfs filesystem on zwinger ran out of memory, removed some obsolete RRDs in there, and in the on-disk copy [production]
11:18 <mark> Restarted confused gmetad_pmtpa on zwinger [production]
11:15 <mark> Rebooting all new apache servers [production]
11:15 <mark> Updating Nagios with the new servers failed. Could someone please update the docs? [production]
11:06 <mark> Running apt-get dist-upgrade on all new servers [production]
10:54 <mark> scap [production]
10:53 <mark> Added new servers to dsh node groups [production]
10:34 <mark> Installed puppet on srv227-srv253, signed all certificates [production]
10:30 <mark> OS-installed srv227-srv253, except broken srv245 [production]
08:27 <mark> Installed srv226 as mediawiki application server [production]
08:15 <mark> Removed 29 GB of access.log in /usr/logs/ on mobile1 (why is it there and not logrotated?). Restarted thin, memcached. Test URL does not work, but the site itself does seem to work. Please check/update the docs! [production]
2009-09-04 §
22:27 <brion> rerunning parser tests for revs that had negatives to clear out the false failures [production]
22:09 <brion> added 1gig swap file to wikitech to see if that helps let the parser tests complete [production]
17:22 <brion> started rsyncd on searchidx1 per robert's note on broken updates [production]
03:24 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'fixed wiki name typo' [production]
01:30 <atglenn> turned on automatic zfs replication from ms1 to ms5; copying over incrementals every ten minutes out of cron [production]
2009-09-03 §
21:35 <atglenn> huh guess I should log this, gmond installed on ms5 (from old ts repo spec, v3.1 can't coexist with v3.0x), fred started collecting stats on it (yesterday) [production]
17:48 <atglenn> first incremental zfs rep from ms1 to ms5, still using cat on the receiving end, mbuffer + zfs recv is just too slow [production]
16:43 <mark> Installed gmond on mobile1 [production]