|
2009-10-07
§
|
| 21:30 |
<Fred> |
powercycling pdf1 -> c�gone unresponsive even from serial console |
[production] |
| 21:29 |
<brion> |
synchronized php-1.5/includes/specials/SpecialContributions.php |
[production] |
| 21:27 |
<brion> |
pdf1 unreachable |
[production] |
| 20:12 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' |
[production] |
| 20:11 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' |
[production] |
| 19:41 |
<Fred> |
ganglia 3.1.2 has been installed on spence. Configuration still in progress, but mostly done. http://ganglia3.wikimedia.org |
[production] |
| 19:28 |
<Rob> |
resynced nagios for all the removed and decommissioned servers |
[production] |
| 19:28 |
<Rob> |
decommissioned srv142 & srv143. wiped, unracked |
[production] |
| 19:12 |
<Rob> |
srv85 decommissioned |
[production] |
| 19:10 |
<Rob> |
srv148 dead, decommissioned, removed from dsh, lvs, and server roles |
[production] |
| 19:04 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed second level for now' |
[production] |
| 19:00 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' |
[production] |
| 18:59 |
<Rob> |
decommissioning srv51, removed from server roles, node groups, lvs, and wiping in rack |
[production] |
| 18:56 |
<Rob> |
decommissioned srv48, srv49, srv50. removed from node groups, server roles, wiped, unracked. |
[production] |
| 18:50 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57480' |
[production] |
| 18:41 |
<mark> |
Installed puppet on grosley |
[production] |
| 18:39 |
<brion> |
synchronized php-1.5/includes/specials/SpecialContributions.php 'sync r57479 spacing fix for contribs tools links' |
[production] |
| 18:34 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' |
[production] |
| 18:33 |
<brion> |
cleared flaggedrevs, flaggedpage_config tables on flaggedrevs_labwikimedia: prep for new config test |
[production] |
| 18:28 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57475' |
[production] |
| 18:28 |
<mark> |
Manually updated ntp.conf on isidore |
[production] |
| 18:18 |
<brion> |
synchronized php-1.5/includes/OutputPage.php 'r57473 fix for fatals in edge case' |
[production] |
| 18:12 |
<mark> |
Manually updated ntp.conf on srv1, srv2 and bart |
[production] |
| 18:06 |
<brion> |
synchronized php-1.5/includes/HistoryPage.php 'r57471 perm fix for show/hide revs box on history page' |
[production] |
| 17:46 |
<brion> |
synchronized php-1.5/includes/OutputPage.php 'sync r57468 fix -- mdale changes to script loading broke wgStylePath again' |
[production] |
| 17:46 |
<mark> |
Installed puppet on loudon and locke |
[production] |
| 17:43 |
<mark> |
Installed puppet on sq1 |
[production] |
| 17:41 |
<mark> |
Installed puppet on tridge |
[production] |
| 17:28 |
<brion> |
js2-borne code is breaking wikibits.js again; mdale please make sure $wgStylePath is respected |
[production] |
| 17:22 |
<brion> |
during update some brief borkage with missing stylesheets. inconsistency in file update order? seems ok now |
[production] |
| 16:58 |
<Rob> |
decommissioning srv48, srv49, srv50. removed from server_roles, node groups, running wipe in rack |
[production] |
| 16:52 |
<Rob> |
srv81 crashed, decommissioning, removed from node groups, server roles, lvs, wiping in rack |
[production] |
| 16:35 |
<Rob> |
pulled srv44-srv47 from rack, decommissioned |
[production] |
| 16:17 |
<Rob> |
srv31 already wiped, unracked |
[production] |
| 16:15 |
<mark> |
Installed puppet on singer |
[production] |
| 16:14 |
<Rob> |
srv31 still racked, but is crashed, decommissioning. |
[production] |
| 16:12 |
<mark> |
Installed puppet on streber |
[production] |
| 16:10 |
<Rob> |
decommissioning srv137, pulled from rack, wiped, pulled from nodegroups and lvs |
[production] |
| 16:09 |
<mark> |
Installed puppet on mchenry and sanger |
[production] |
| 16:08 |
<mark> |
Removed puppet again on isidore; it's ubuntu 7.04 and really needs to be replaced soon |
[production] |
| 16:06 |
<mark> |
Installed puppet on isidore |
[production] |
| 16:05 |
<mark> |
Installed puppet on pdf1 |
[production] |
| 16:00 |
<mark> |
Installed puppet on bayle and bayes |
[production] |
| 15:59 |
<mark> |
Installed puppet on db20 |
[production] |
| 15:58 |
<Rob> |
negate that, not depooling. |
[production] |
| 15:58 |
<Rob> |
depooling sq43 until later today when i can poke at it. |
[production] |
| 15:55 |
<Rob> |
srv131 decommissioning, removed from lvs, node groups and server roles, wiping in rack. |
[production] |
| 15:49 |
<mark> |
Installed puppet on spence and williams |
[production] |
| 15:47 |
<mark> |
Installed puppet on lvs2-4 |
[production] |
| 15:42 |
<Rob> |
redeployed sq43 |
[production] |