2009-10-07
§
|
22:51 |
<AaronSchulz> |
running populateLogSearch.php to fill suppression log search filter data |
[production] |
22:39 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/FlaggedArticle.php 'deployed r57501' |
[production] |
21:30 |
<Fred> |
powercycling pdf1 -> c�gone unresponsive even from serial console |
[production] |
21:29 |
<brion> |
synchronized php-1.5/includes/specials/SpecialContributions.php |
[production] |
21:27 |
<brion> |
pdf1 unreachable |
[production] |
20:12 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' |
[production] |
20:11 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' |
[production] |
19:41 |
<Fred> |
ganglia 3.1.2 has been installed on spence. Configuration still in progress, but mostly done. http://ganglia3.wikimedia.org |
[production] |
19:28 |
<Rob> |
resynced nagios for all the removed and decommissioned servers |
[production] |
19:28 |
<Rob> |
decommissioned srv142 & srv143. wiped, unracked |
[production] |
19:12 |
<Rob> |
srv85 decommissioned |
[production] |
19:10 |
<Rob> |
srv148 dead, decommissioned, removed from dsh, lvs, and server roles |
[production] |
19:04 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed second level for now' |
[production] |
19:00 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' |
[production] |
18:59 |
<Rob> |
decommissioning srv51, removed from server roles, node groups, lvs, and wiping in rack |
[production] |
18:56 |
<Rob> |
decommissioned srv48, srv49, srv50. removed from node groups, server roles, wiped, unracked. |
[production] |
18:50 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57480' |
[production] |
18:41 |
<mark> |
Installed puppet on grosley |
[production] |
18:39 |
<brion> |
synchronized php-1.5/includes/specials/SpecialContributions.php 'sync r57479 spacing fix for contribs tools links' |
[production] |
18:34 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' |
[production] |
18:33 |
<brion> |
cleared flaggedrevs, flaggedpage_config tables on flaggedrevs_labwikimedia: prep for new config test |
[production] |
18:28 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57475' |
[production] |
18:28 |
<mark> |
Manually updated ntp.conf on isidore |
[production] |
18:18 |
<brion> |
synchronized php-1.5/includes/OutputPage.php 'r57473 fix for fatals in edge case' |
[production] |
18:12 |
<mark> |
Manually updated ntp.conf on srv1, srv2 and bart |
[production] |
18:06 |
<brion> |
synchronized php-1.5/includes/HistoryPage.php 'r57471 perm fix for show/hide revs box on history page' |
[production] |
17:46 |
<brion> |
synchronized php-1.5/includes/OutputPage.php 'sync r57468 fix -- mdale changes to script loading broke wgStylePath again' |
[production] |
17:46 |
<mark> |
Installed puppet on loudon and locke |
[production] |
17:43 |
<mark> |
Installed puppet on sq1 |
[production] |
17:41 |
<mark> |
Installed puppet on tridge |
[production] |
17:28 |
<brion> |
js2-borne code is breaking wikibits.js again; mdale please make sure $wgStylePath is respected |
[production] |
17:22 |
<brion> |
during update some brief borkage with missing stylesheets. inconsistency in file update order? seems ok now |
[production] |
16:58 |
<Rob> |
decommissioning srv48, srv49, srv50. removed from server_roles, node groups, running wipe in rack |
[production] |
16:52 |
<Rob> |
srv81 crashed, decommissioning, removed from node groups, server roles, lvs, wiping in rack |
[production] |
16:35 |
<Rob> |
pulled srv44-srv47 from rack, decommissioned |
[production] |
16:17 |
<Rob> |
srv31 already wiped, unracked |
[production] |
16:15 |
<mark> |
Installed puppet on singer |
[production] |
16:14 |
<Rob> |
srv31 still racked, but is crashed, decommissioning. |
[production] |
16:12 |
<mark> |
Installed puppet on streber |
[production] |
16:10 |
<Rob> |
decommissioning srv137, pulled from rack, wiped, pulled from nodegroups and lvs |
[production] |
16:09 |
<mark> |
Installed puppet on mchenry and sanger |
[production] |
16:08 |
<mark> |
Removed puppet again on isidore; it's ubuntu 7.04 and really needs to be replaced soon |
[production] |
16:06 |
<mark> |
Installed puppet on isidore |
[production] |
16:05 |
<mark> |
Installed puppet on pdf1 |
[production] |
16:00 |
<mark> |
Installed puppet on bayle and bayes |
[production] |
15:59 |
<mark> |
Installed puppet on db20 |
[production] |
15:58 |
<Rob> |
negate that, not depooling. |
[production] |
15:58 |
<Rob> |
depooling sq43 until later today when i can poke at it. |
[production] |