8351-8400 of 10000 results (30ms)
2011-01-11 §
20:42 <rainman-sr> enwiki.spell index somehow got corrupt, investigating and rebuilding it now on searchidx1 [production]
18:57 <RobH> sq59-sq61 coming back offline, bad partitioning in automatied install, need to update squid configuration for these hosts [production]
18:47 <RobH> sq59 having reinstall issues, skipping it and moving on [production]
18:36 <RobH> sq61 reinstalled and back online [production]
18:30 <RobH> sq60 reinstalled, back in service [production]
18:03 <RobH> sq59-sq61 depooled for upgrade [production]
16:15 <RobH> sync-docroot run to push updated tenwiki favicon [production]
14:27 <mark_> Depooled amssq31 and amssq32 for SSD install [production]
2011-01-10 §
21:01 <Ryan_Lane> patching python-nova on nova-compute*.tesla (see bug #lp700015) [production]
20:59 <Ryan_Lane> err make that #lp681164 for ldap driver [production]
20:59 <Ryan_Lane> patching ldap driver on nova-* (see bug #lp681030) [production]
20:57 <Ryan_Lane> patching ec2 api on nova-controller.tesla (see bug #lp701216) [production]
19:56 <RobH> updated dns with virt!-virt4 mgmt info [production]
16:10 <RobH> singer was crashed, investigating why it suddenly had issues. It was pulling down db9, but it halted before it could damage anything. [production]
16:04 <RobH> secure server, as well as blogs, offline, investigating server issue on singer [production]
16:02 <RobH> db9 having issues and singer is as well, taking singer down since its already crashed [production]
2011-01-09 §
22:04 <Ryan_Lane> powercycling srv217 [production]
22:03 <Ryan_Lane> powercycling srv271 [production]
22:01 <Ryan_Lane> powercycling srv262 [production]
19:21 <apergos> rebooting amssq61 hoping to clear up its problem. I guess puppet restarts squid instances every so often *sigh* [production]
18:50 <apergos> stopping squid front and back end instances on amssq61, has network issue [production]
14:15 <mark> Reduced Varnish max worker threads from 8000 to 2000 per threadpool [production]
13:52 <mark> Pooled knsq6 and knsq7 as bits.esams [production]
13:43 <mark> Converted knsq6 and knsq7 into bits.esams machines [production]
13:16 <mark> Stopping squid instances on knsq6 and knsq7 [production]
13:16 <mark> Depooled knsq6 and knsq7 from the knams.text pool [production]
2011-01-08 §
16:14 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' [production]
16:14 <catrope> synchronized php-1.5/skins/common/edit.js 'r79866' [production]
2011-01-07 §
23:42 <davidstrauss> Cloning civicrm -> dev_civicrm on Fundraising infrastructure. [production]
23:33 <Ryan_Lane> installed dnsmasq on nova-controller.tesla [production]
22:47 <Ryan_Lane> rebooting nova-* [production]
22:45 <Ryan_Lane> reconfiguring network on nova-* to remove bridges (FlatDHCPManager handles that) [production]
22:10 <Ryan_Lane> rebooting nova-controller.tesla [production]
22:01 <Ryan_Lane> changing to FlatDHCPManager for networking driver on nova-controller.tesla [production]
22:00 <Ryan_Lane> installing bridge-utils on nova-controller.tesla [production]
21:52 <RobH> srv217 offline, but shows no errors in drac log, rebooted [production]
19:03 <Ryan_Lane> disabling apparmor on nova-compute1/2 to ensure it isn't causing instance creation to fail [production]
16:40 <Ryan_Lane|sleep> adding CNAME svn.mediawiki.org -> svn.wikimedia.org per bug 26474 [production]
14:44 <RoanKattouw> Installed xdebug on prototype so I can turn it on when debugging fatals [production]
00:51 <tfinc> synchronized php-1.5/extensions/CentralNotice/CentralNotice.php [production]
00:31 <tfinc> synchronized php-1.5/extensions/CentralNotice/CentralNotice.php [production]
00:30 <tfinc> synchronized php-1.5/extensions/CentralNotice/centralnotice.js [production]
00:30 <tfinc> synchronized php-1.5/extensions/CentralNotice/SpecialNoticeTemplate.php [production]
00:30 <tfinc> synchronized php-1.5/extensions/CentralNotice/SpecialBannerController.php [production]
00:29 <tfinc> synchronized php-1.5/extensions/CentralNotice/CentralNotice.i18n.php [production]
2011-01-06 §
22:21 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php 'Set $wgCodeReviewRepoStatsCacheTime to 1 hour, requested by Sam' [production]
22:18 <Ryan_Lane> added awjrichards to storage3 [production]
16:29 <Ryan_Lane> upgrade nova-* packages on nova-*.tesla, as the current branch packages are broken [production]
12:37 <mark> Powercycled amssq33 [production]
04:04 <Ryan_Lane> powercycling mobile1, that is [production]