5401-5450 of 10000 results (28ms)
2012-03-08 §
18:27 <RoanKattouw> Pushing new AFTv5 code to testwiki, do not sync to the live site just yet [production]
17:46 <reedy> synchronized wmf-config/InitialiseSettings.php 'ptwikipedia to ptwiki' [production]
17:14 <cmjohnson1> shutting down db18 for memory testing [production]
16:57 <RobH> search1014 still down per rt2483 [production]
16:47 <maplebed> took ms-be5 out of rotation in the swift cluster - it's crashed 3 times now. [production]
16:36 <reedy> synchronized php-1.19/extensions/ExtensionDistributor/ExtensionDistributor_body.php '[[rev:113368|r113368]]' [production]
16:31 <reedy> synchronized php-1.19/extensions/ExtensionDistributor/ExtensionDistributor_body.php 'Revert live hack because it works, will come in properly' [production]
16:30 <reedy> synchronized php-1.19/extensions/ExtensionDistributor/ExtensionDistributor_body.php 'Test for [[bugzilla:27246|bug 27246]]' [production]
16:16 <RobH> search1008 repaired [production]
15:52 <RobH> mw1103 finally repaired and ready for os and such [production]
14:48 <pp-pdf1> installed python faulthandler 2.1 [production]
14:47 <pp-pdf3> installed python faulthandler 2.1 [production]
14:47 <pp-pdf2> installed python faulthandler 2.1 [production]
14:24 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bug 35012 - Namespace aliases for wikipedia and wikipedia-talk namespaces on Sanskrit wiki' [production]
09:17 <mutante> running puppet on mw1010 - finished quickly without problems - uh, wonder why Nagios reported puppet freshness then [production]
08:22 <mutante> cp1019 - Hitting F1 to continue reboot ( "Alert! System fatal error during previous boot") [production]
08:21 <mutante> cp1019 went down, then rebooted by itself (i think) after showing "idrac-8W82BP1 Severity: Non Recoverable, SEL:CPU Machine Chk: Processor sensor, transition to non-recoverable was asserted" [production]
07:54 <mutante> cadmium fixed by adding groups::wikidev [production]
07:41 <mutante> puppet on cadmium broken due to dependency Group[500] for User[catrope] [production]
07:20 <mutante> ms1004 ran out of disk - caused by 17G HTCPurger.log.1, trying to gzip it now [production]
06:52 <tstarling> synchronized multiversion/MWMultiVersion.php [production]
06:51 <tstarling> rebuilt wikiversions.cdb and synchronized wikiversions files: [production]
03:04 <Guest32353> powercycled ms-be5; it has been unresponsive for 2 hours. [production]
02:18 <LocalisationUpdate> completed (1.19) at Thu Mar 8 02:18:02 UTC 2012 [production]
01:32 <AaronSchulz> fixBug34995.php done [production]
01:26 <AaronSchulz> running fixBug34995 on all wikis [production]
00:17 <Ryan_Lane> adding zero cnames [production]
00:16 <Ryan_Lane> installing newer wikimedia-task-dns-auth on all dns servers [production]
00:15 <Ryan_Lane> added wikimedia-task-dns-auth_0.18 to the repo, to add support for zero [production]
2012-03-07 §
23:05 <aaron> synchronized php-1.19/includes/filerepo/file/LocalFile.php 'deployed [[rev:113319|r113319]]' [production]
22:39 <maplebed> set swift weight for ms1 to 0 initiating the process to move data off the host in preparation for decomissioning it. [production]
21:17 <Jeff_Green> running apt upgrades and puppetd --test on srv194, srv197, srv203, srv212, srv213, srv230, srv244, srv245, srv252, srv282 and manually restarting nrpe because they're reporting funky in nagios [production]
20:20 <catrope> synchronized php-1.19/resources/startup.js 'touch' [production]
20:17 <Jeff_Green> yet another redirects.conf change, per RT#2498 redirect wikimedia.com-->wikimedia.org [production]
20:05 <binasher> reverted no-pagecache rsync on search nodes - without corresponding index warmup in lsearchd, it just pushes back the pain a bit and does more harm than good [production]
20:04 <binasher> deployed support for zero.wikipedia.org and carrier tagging to mobile varnish servers [production]
19:38 <catrope> synchronized php-1.19/includes/resourceloader/ '[[rev:113278|r113278]]' [production]
19:28 <Jeff_Green> manual apt-upgrade, puppetd --refresh, and repeat on srv265 because it was running on outdated apache config [production]
18:44 <RobH> correction sq39 [production]
18:36 <RobH> pulled sq39 from text pybal config, pulled sq46 from upload pybal config [production]
18:36 <catrope> synchronized php-1.19/resources/startup.js 'touch' [production]
18:36 <catrope> synchronized php-1.19/extensions/CustomUserSignup/modules/AccountCreationUserBucket.js 'touch' [production]
18:12 <RobH> shutting down sq38 and sq46 per rt 2581 for testing [production]
16:02 <cmjohnson1> replacing hdd for disk 10 on db22 [production]
16:00 <cmjohnson1> pulling disk 10 from db22 [production]
13:28 <mark> Removed torrus from streber [production]
13:00 <pp-pdf2> updated mwlib to 0.13.6 [production]
13:00 <pp-pdf3> updated mwlib to 0.13.6 [production]
13:00 <pp-pdf1> updated mwlib to 0.13.6 [production]
11:29 <hashar> synchronizing Wikimedia installation... : trigger a rebuild of l10n cache [production]