501-550 of 10000 results (13ms)
2012-10-02 §
01:16 <binasher> streaming hotbackup of db1019 to db64 (s3) [production]
01:12 <binasher> stopping mysql on db25 and powering down - logging lots of ecc chipkill errors and periodically unresponsive. building db64 as a perm replacement [production]
01:00 <awjrichards> Finished syncing Wikimedia installation... : Updating MobileFrontend, per https://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments/2012-10-01 [production]
00:50 <asher> synchronized wmf-config/db.php 'pulling db25, returning es10' [production]
00:07 <awjrichards> Started syncing Wikimedia installation... : Updating MobileFrontend, per https://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments/2012-10-01 [production]
2012-10-01 §
22:10 <awjrichards> synchronized wmf-config/mobile.php 'Eanble wgMFEnableDesktopResources on testwiki' [production]
22:09 <awjrichards> synchronized wmf-config/InitialiseSettings.php 'Eanble wgMFEnableDesktopResources on testwiki' [production]
21:40 <preilly> synchronized php-1.21wmf1/extensions/ZeroRatedMobileAccess/ 'zero weekly carrier test' [production]
21:18 <preilly> synchronized php-1.20wmf12/extensions/ZeroRatedMobileAccess/ 'zero weekly carrier test' [production]
20:44 <reedy> synchronized php-1.21wmf1/includes/specials/SpecialUserlogin.php '[[bugzilla:40668|bug 40668]]' [production]
20:23 <reedy> synchronized php-1.21wmf1/includes/OutputPage.php [production]
20:21 <reedy> synchronized php-1.21wmf1/includes/OutputPage.php [production]
20:16 <reedy> synchronized php-1.21wmf1/includes/OutputPage.php [production]
20:13 <reedy> synchronized php-1.21wmf1/includes/OutputPage.php [production]
19:33 <paravoid> pushing new rewrite.py to swift servers ([[rev:24303|r24303]], [[rev:24514|r24514]], [[rev:24576|r24576]]) [production]
19:31 <reedy> synchronized php-1.21wmf1/includes/job/Job.php [production]
19:24 <reedy> synchronized php-1.20wmf12/includes/job/Job.php [production]
18:51 <notpeter> stopping puppet on brewster [production]
18:22 <asher> synchronized wmf-config/db.php 'pulling es10, crashed over weekend, needs to catchup on repl' [production]
18:01 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki and mediawikiwiki to 1.21wmf1 [production]
15:52 <reedy> Finished syncing Wikimedia installation... : test2wiki to 1.21wmf1, rebuild cache [production]
15:41 <^demon> restarted gerrit on manganese. [production]
15:36 <^demon> gracefully shut down gerrit until we figure out why manganese is swapping [production]
14:18 <reedy> Started syncing Wikimedia installation... : test2wiki to 1.21wmf1, rebuild cache [production]
14:08 <reedy> Started syncing Wikimedia installation... : test2wiki to 1.21wmf1, rebuild cache [production]
14:06 <mark> Added cp1029 and cp1030 to the frontend varnish upload pool in eqiad (PyBal) [production]
13:59 <reedy> synchronized php-1.21wmf1/ [production]
13:53 <reedy> synchronized live-1.5/ [production]
13:53 <reedy> synchronized wmf-config/ [production]
13:48 <reedy> synchronized php-1.21wmf1 [production]
13:10 <cmjohnson1> powering down db62 to replace raid controller card [production]
12:38 <reedy> synchronized live-1.5 [production]
12:34 <Reedy> Make that, deleting wmf10 php source files [production]
12:32 <Reedy> Deleting wmf12 php source files [production]
12:30 <Reedy> Deleting wmf11 localisation cache [production]
11:11 <mark> Added cp1029 and cp1030 to the Varnish upload.eqiad pool (10 mins ago) [production]
09:17 <mark> Rebooting cp3001, both ports in LACP block [production]
02:25 <LocalisationUpdate> completed (1.20wmf12) at Mon Oct 1 02:25:14 UTC 2012 [production]
2012-09-30 §
23:58 <MaxSem> Ran mwscript extensions/WikimediaMaintenance/migrateWlmUploads.php testwiki --do-it>wlm.log [production]
19:26 <maxsem> synchronized wmf-config 'Remove WLM banner / https://gerrit.wikimedia.org/r/#/c/25771/' [production]
02:23 <LocalisationUpdate> completed (1.20wmf12) at Sun Sep 30 02:23:14 UTC 2012 [production]
2012-09-29 §
10:39 <mark> Started rsync of /export/upload (respecting /etc/rsync.includes) to /mnt (nas1-a:vol/originals/) on ms7 in a screen session [production]
10:35 <mark> Manually mounted nas1-a:/vol/originals on ms7, fenari [production]
10:33 <mark> Created 40 TB volume 'originals' inside 36-drive aggregate 'media1' on nas1-a [production]
04:07 <mutante> reinstalled cp1031 (new mainboard, thx RobH) [production]
02:24 <LocalisationUpdate> completed (1.20wmf12) at Sat Sep 29 02:24:45 UTC 2012 [production]
01:59 <mutante> restarting cp1031 after hardware replacement [production]
01:24 <mutante> checking/fixing puppet runs on cp103x servers [production]
2012-09-28 §
23:54 <binasher> rebooting db1047 to new kernel [production]
21:28 <apergos> disbaled puppet and stopped swift processes on ms-be6 again. noticed four drives in "Unconfigured" state in megacli output after disk replacement,don'tknow more details about how that went. [production]