2009-12-08
§
|
16:20 |
<Rob> |
running diagnostics on srv217, please do not try to put it into service. |
[production] |
16:06 |
<Rob> |
srv229 memory replaced, system restarted. |
[production] |
15:58 |
<Rob> |
shutting down srv229 to swap out faulty dimm |
[production] |
15:46 |
<Rob> |
sq43 disk replaced, system back online and in rotation |
[production] |
15:31 |
<Rob> |
replaced bad disk in sq43 |
[production] |
15:23 |
<Rob> |
replaced bad disk in sq37, detected, restarted squid backend |
[production] |
15:18 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
15:09 |
<Rob> |
db27 back up with mysql running. |
[production] |
15:07 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
15:03 |
<Rob> |
mysql stopped normally on db27, restarting it. |
[production] |
15:02 |
<Rob> |
was able to hotswap the fan, shutdown was not needed |
[production] |
14:58 |
<Rob> |
stopping mysql on db27 to shut it down and swap out a bad fan assembly. |
[production] |
14:56 |
<Rob> |
disregard, did not receive part for db28, just db27 |
[production] |
14:53 |
<Rob> |
db28 powered down already, pulling to replace bad fan |
[production] |
11:12 |
<rainman-sr> |
searchidx1 rebooted by domas, restarting indexing |
[production] |
11:00 |
<rainman-sr> |
searchidx1 has a "cp -lr" process stuck in I/O, cannot be killed, dmesg says "aacraid: Host adapter reset request. SCSI hang ?". Stopping indexing until someone sorts this out. Hardware check, reboot? |
[production] |
01:38 |
<domas> |
new s2 position db30-bin.000001:106 |
[production] |
01:28 |
<domas> |
s2 is pure 5.1 now |
[production] |
01:27 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
01:22 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
01:22 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
01:21 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'up up up' |
[production] |
00:37 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
00:36 |
<fvassard> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Added Site_Notice41 to tracking.' |
[production] |
00:19 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
2009-12-07
§
|
22:16 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'taking out one more server for a clone' |
[production] |
21:47 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Lower $wgClickTrackThrottle to 1 on strategywiki, requested by Eugene and Nimish' |
[production] |
19:37 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Lower $wgClickTrackThrottle from 1000 to 100' |
[production] |
19:36 |
<RoanKattouw> |
Cranking up click tracking ratio from 1:1000 to 1:100 now that we're only tracking toolbars |
[production] |
19:34 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/ClickTracking/ClickTracking.php 'Deploy r59793, r59794: disable clicktracking for left navigation' |
[production] |
19:33 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/ClickTracking/ClickTracking.js 'Deploy r59793, r59794: disable clicktracking for left navigation |
[production] |
19:29 |
<RoanKattouw> |
Issues mentioned by Rob probably caused by running svn up as root. Please don't do that again |
[production] |
19:26 |
<Rob> |
spoke with Roan and Brion and updated the permissions of the wmf-deployment to put all files to wikidev group and all writable by that group |
[production] |
19:24 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php '... and add w:en' |
[production] |
19:22 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 20552: Remove b: prefix from import sources on ptwikibooks' |
[production] |
18:41 |
<RoanKattouw> |
Running namespaceDupes on ttwiki for bug 21656 |
[production] |
18:40 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 21656: Add Portal namespace on ttwiki' |
[production] |
18:25 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 21506: add import sources for plwiki' |
[production] |
18:11 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 21755: add commons as import source on testwiki' |
[production] |
17:09 |
<Fred> |
removed locke from wmnet zonefile since locke doesn't have internal address. |
[production] |
17:04 |
<aaron> |
ran sync-common-all |
[production] |
16:27 |
<aaron> |
ran sync-common-all |
[production] |
16:17 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'flaggedrevs for plwiktionary' |
[production] |
16:10 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed duplicate ptwikisource config (autopromote setting must have been broken)' |
[production] |
14:37 |
<mark> |
Drive 0 SMART predicted failure on fuchsia |
[production] |
14:36 |
<mark> |
Power cycling fuchsia |
[production] |
14:31 |
<mark> |
Enabled knsq7 frontend squid in pybal |
[production] |
14:31 |
<RoanKattouw> |
Running namespaceDupes on nlwiki for bug 21722 |
[production] |
14:30 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 21722: Add WP, H, P aliases for nlwiki' |
[production] |
13:59 |
<mark> |
synchronized php-1.5/wmf-config/mc.php 'Removed decommissioned servers, added in a few more spares' |
[production] |