51-100 of 4038 results (5ms)
2009-10-07 §
15:47 <mark> Installed puppet on lvs2-4 [production]
15:42 <Rob> redeployed sq43 [production]
15:41 <mark> Installed puppet on storage1-3 [production]
15:35 <Rob> srv130 was down, out of warranty, decommissioned, removed from node groups and lvs, wiping in rack [production]
15:32 <mark> Shutdown srv9 for decommissioning [production]
15:31 <mark> Installed puppet on amane and erzurumi [production]
15:25 <mark> Installed puppet on fenari and mobile1 [production]
15:20 <mark> Installed puppet on ms2 and ms3 [production]
15:19 <Rob> srv122 decommissioning, pulled from nodes and lvs, wiping in rack [production]
15:10 <mark> Installed puppet on hume [production]
15:10 <Rob> srv90 pulled, decommissioned, wiped, and out of node groups and nagios [production]
15:07 <Rob> lucene group in nagios sync was halting it, since no hosts exist in that group anymore. commented out group in nagios conf.php and synced. [production]
15:00 <Rob> server rose decommissioning, removed from nodegroups, pulled from rack, removed from server roles [production]
14:57 <Rob> srv118 running wipe, removed network connection. [production]
14:56 <Rob> srv118 down, reboots for no good reason, out of warranty, decommissioning, removed from LVS, nodegroups, wiping in rack [production]
14:43 <Rob> decommissioned coronelli, pulled from rack, removed from server roles, removed from node groups [production]
14:39 <Rob> decommissioned maurus, pulled from rack, removed from server roles, removed from node groups [production]
02:21 <Tim> hard reset of mobile1, was not responding on ssh or serial [production]
02:18 <brion> mobile1 been down for a bit; Tim is poking at remote console to reboot it [production]
01:54 <brion> testing svn up on test [production]
2009-10-06 §
23:24 <brion> synchronized php-1.5/extensions/OggHandler/OggHandler.php 'update defualt search path for oggThumb' [production]
22:49 <brion> synchronized php-1.5/extensions/OggHandler/OggHandler_body.php 'update with oggThumb support' [production]
22:49 <brion> synchronized php-1.5/extensions/OggHandler/OggHandler.php [production]
17:24 <Fred> Loudon.w.o has been commissioned for use by the Usability team for a couple days/weeks. [production]
15:47 <robh> ran sync-common-all [production]
15:11 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php '20973 Additional transwiki import sources on Incubator' [production]
15:06 <Rob> updating dns for ro.planet [production]
14:49 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php '20986 Please change the Bengali Wikibooks sitename' [production]
14:39 <robh> synchronized php-1.5/wmf-config/InitialiseSettings.php 'enabling uploads on vewikimedia' [production]
14:34 <robh> ran sync-common-all [production]
14:31 <robh> ran sync-common-all [production]
13:53 <mark> Fixed srv237 [production]
12:42 <mark> Fixed situation for home-mounted apaches in puppet [production]
11:57 <mark> scap [production]
11:53 <mark> Shut down coronelli, rose, maurus: these should all be decommissioned [production]
11:44 <mark> Fixed up search node group [production]
11:31 <mark> Made puppet manage ganglia on all core dbs [production]
11:16 <mark> Installed puppet on adler as well ;) [production]
11:10 <mark> Installed puppet on all core databases [production]
2009-10-05 §
23:20 <mark> Deployed net NTP client configuration on all application servers and all squids (via puppet) [production]
20:21 <Andrew> Deploying LiquidThreads updates [production]
19:50 <midom> synchronized php-1.5/wmf-config/db.php 'boring' [production]
18:58 <midom> synchronized php-1.5/wmf-config/db.php 'load test' [production]
17:37 <domas> fixed the slack at db10. what were sysadmins doing?! [production]
17:36 <mark> Set up NTP server on linne, to replace zwinger [production]
2009-10-04 §
15:31 <domas> implemented a mutex for update-special-pages jobs [production]
2009-10-03 §
13:29 <hcatlin> cleared out cache and logs on mobile1 [production]
2009-10-02 §
20:36 <jeluf> synchronized php-1.5/wmf-config/db.php 'adding db22 back to the pool' [production]
20:34 <jeluf> synchronized php-1.5/wmf-config/db.php 'take db22 out of the pool for a few minutes' [production]
20:26 <JeLuF> killed two long running sql queries on db22 [production]