2801-2850 of 10000 results (27ms)
2012-01-16 §
15:55 <cmjohnson1> shutting down srv199 for main board replacement [production]
15:09 <mutante> torrus was broken ([[RT:2279]]) and did not start due to corrupted berkeleydb, used db4.8_recover, service started again [production]
12:38 <mark> Running puppet on freshly installed sodium [production]
09:15 <apergos> cleaned up /tmp on srv223... seems like cleanup once an hour by cron isn't often enough any more, scalers are doing too much work [production]
02:05 <LocalisationUpdate> completed (1.18) at Mon Jan 16 02:05:05 UTC 2012 [production]
2012-01-15 §
15:45 <petan> ran live/extensions/TrustedXFF/generate.php [releng]
11:20 <petan> updated to latest head all wikis [releng]
02:45 <reedy> synchronized php-1.18/extensions/CentralNotice/CentralNotice.db.php '[[rev:108949|r108949]]' [production]
02:05 <LocalisationUpdate> completed (1.18) at Sun Jan 15 02:05:26 UTC 2012 [production]
2012-01-14 §
23:37 <Ryan_Lane> shutting down virt1 [production]
20:29 <Ryan_Lane> stopping opendj on virt1 [production]
20:07 <Ryan_Lane> stopping pdns on virt1 [production]
18:49 <petan> enabled global blocking [releng]
18:21 <johnduhart> Removed myself from the project. [releng]
14:32 <petan> separated common to own deployment file [releng]
14:30 <hexmode> enabled webfonts for mywiki properly in IntialiseSettingsDeploy.php [releng]
14:25 <johnduhart> Updated wmf-config/InitialiseSettings.php from production [releng]
14:25 <johnduhart> Reverted change to wmf-config/InitialiseSettings.php [releng]
14:24 <hexmode> enabled webfonts for mywiki [releng]
02:15 <Reedy> That was me testing something [production]
02:14 <LocalisationUpdate> failed: SVN update of extensions failed [production]
02:04 <LocalisationUpdate> completed (1.18) at Sat Jan 14 02:04:46 UTC 2012 [production]
01:00 <Ryan_Lane> brought pdns on virt1 back up [production]
00:53 <Ryan_Lane> stopping pdns on virt1 again to test dns [production]
00:19 <Ryan_Lane> powercycling formey [production]
2012-01-13 §
22:40 <Ryan_Lane> force running puppet on all instances [production]
22:40 <Ryan_Lane> re-generated certificates for all instances [production]
22:40 <Ryan_Lane> deleted all puppet certificates on all instances [production]
22:31 <LeslieCarr> restarting ganglia1001 [production]
21:41 <Ryan_Lane> changing virt1 to be a cname of virt0 [production]
21:34 <petan> assigning new dns [releng]
21:33 <petan> moved deployment to beta.wmf... [releng]
21:17 <Ryan_Lane> killed pdns on virt1 [production]
20:40 <Ryan_Lane> stopped pdns on virt1 [production]
20:32 <reedy> synchronized php-1.18/extensions/Contest/specials/ '[[rev:108843|r108843]]' [production]
20:28 <Ryan_Lane> changed NS records for wmflabs.org and wmflabs to point to virt0 [production]
20:28 <Ryan_Lane> changed recursor to point wmflabs domain to virt0 [production]
20:16 <K4-713> synchronized payments cluster to [[rev:108833|r108833]] [production]
19:30 <Ryan_Lane> shutting down virt1 to ensure migration was completed [production]
19:12 <LeslieCarr> restarting gmond on cp1043 [production]
18:55 <LeslieCarr> hard powercycling ms1002 [production]
18:48 <LeslieCarr> rebooting ms1002 due to kswapd 100% cpu bug https://bugs.launchpad.net/ubuntu/+bug/721896 [production]
16:44 <mutante> added alswiktionary & alswikibooks to closed.dblist [production]
16:43 <dzahn> synchronized closed.dblist [production]
16:33 <mutante> syncing InitialiseSettings.php after changing as wiki namespace per bz 33507 [production]
16:33 <dzahn> synchronized ./wmf-config/InitialiseSettings.php [production]
16:07 <mutante> updated blog theme and installed a plugin per RT 2271 [production]
14:34 <mutante> srv191 - has now fresh OS, re-issued puppet certs, ran puppet, restart memcached, etc. - all back in monitoring [production]
13:07 <petan|w> installed jdk on search [releng]
12:59 <Guest45399> PXE booting srv191, installing OS [production]