251-300 of 4286 results (3ms)
2009-10-07 §
21:30 <Fred> powercycling pdf1 -> c�gone unresponsive even from serial console [production]
21:29 <brion> synchronized php-1.5/includes/specials/SpecialContributions.php [production]
21:27 <brion> pdf1 unreachable [production]
20:12 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' [production]
20:11 <aaron> synchronized php-1.5/wmf-config/InitialiseSettings.php 'deleted content rights for checkusers on frwiki' [production]
19:41 <Fred> ganglia 3.1.2 has been installed on spence. Configuration still in progress, but mostly done. http://ganglia3.wikimedia.org [production]
19:28 <Rob> resynced nagios for all the removed and decommissioned servers [production]
19:28 <Rob> decommissioned srv142 & srv143. wiped, unracked [production]
19:12 <Rob> srv85 decommissioned [production]
19:10 <Rob> srv148 dead, decommissioned, removed from dsh, lvs, and server roles [production]
19:04 <aaron> synchronized php-1.5/wmf-config/flaggedrevs.php 'removed second level for now' [production]
19:00 <aaron> synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' [production]
18:59 <Rob> decommissioning srv51, removed from server roles, node groups, lvs, and wiping in rack [production]
18:56 <Rob> decommissioned srv48, srv49, srv50. removed from node groups, server roles, wiped, unracked. [production]
18:50 <aaron> synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57480' [production]
18:41 <mark> Installed puppet on grosley [production]
18:39 <brion> synchronized php-1.5/includes/specials/SpecialContributions.php 'sync r57479 spacing fix for contribs tools links' [production]
18:34 <aaron> synchronized php-1.5/wmf-config/flaggedrevs.php 'update flaggedrevs_labs wiki config' [production]
18:33 <brion> cleared flaggedrevs, flaggedpage_config tables on flaggedrevs_labwikimedia: prep for new config test [production]
18:28 <aaron> synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.hooks.php 'deployed r57475' [production]
18:28 <mark> Manually updated ntp.conf on isidore [production]
18:18 <brion> synchronized php-1.5/includes/OutputPage.php 'r57473 fix for fatals in edge case' [production]
18:12 <mark> Manually updated ntp.conf on srv1, srv2 and bart [production]
18:06 <brion> synchronized php-1.5/includes/HistoryPage.php 'r57471 perm fix for show/hide revs box on history page' [production]
17:46 <brion> synchronized php-1.5/includes/OutputPage.php 'sync r57468 fix -- mdale changes to script loading broke wgStylePath again' [production]
17:46 <mark> Installed puppet on loudon and locke [production]
17:43 <mark> Installed puppet on sq1 [production]
17:41 <mark> Installed puppet on tridge [production]
17:28 <brion> js2-borne code is breaking wikibits.js again; mdale please make sure $wgStylePath is respected [production]
17:22 <brion> during update some brief borkage with missing stylesheets. inconsistency in file update order? seems ok now [production]
16:58 <Rob> decommissioning srv48, srv49, srv50. removed from server_roles, node groups, running wipe in rack [production]
16:52 <Rob> srv81 crashed, decommissioning, removed from node groups, server roles, lvs, wiping in rack [production]
16:35 <Rob> pulled srv44-srv47 from rack, decommissioned [production]
16:17 <Rob> srv31 already wiped, unracked [production]
16:15 <mark> Installed puppet on singer [production]
16:14 <Rob> srv31 still racked, but is crashed, decommissioning. [production]
16:12 <mark> Installed puppet on streber [production]
16:10 <Rob> decommissioning srv137, pulled from rack, wiped, pulled from nodegroups and lvs [production]
16:09 <mark> Installed puppet on mchenry and sanger [production]
16:08 <mark> Removed puppet again on isidore; it's ubuntu 7.04 and really needs to be replaced soon [production]
16:06 <mark> Installed puppet on isidore [production]
16:05 <mark> Installed puppet on pdf1 [production]
16:00 <mark> Installed puppet on bayle and bayes [production]
15:59 <mark> Installed puppet on db20 [production]
15:58 <Rob> negate that, not depooling. [production]
15:58 <Rob> depooling sq43 until later today when i can poke at it. [production]
15:55 <Rob> srv131 decommissioning, removed from lvs, node groups and server roles, wiping in rack. [production]
15:49 <mark> Installed puppet on spence and williams [production]
15:47 <mark> Installed puppet on lvs2-4 [production]
15:42 <Rob> redeployed sq43 [production]