|
2010-01-04
§
|
| 21:51 |
<RoanKattouw> |
Running rebuildLocalisationCache.php in an attempt to shut up exceptions thrown by srv218 |
[production] |
| 21:29 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'bug 20312: Re-enable GIF scaling on all wikis' |
[production] |
| 21:09 |
<RoanKattouw> |
srv205 is throwing fatal errors because the geoip PHP module is not installed |
[production] |
| 20:51 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'fix typo' |
[production] |
| 20:45 |
<RoanKattouw> |
srv218 has a full disk |
[production] |
| 20:45 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'plus proxy setting' |
[production] |
| 20:44 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 20512: Enable $wgCopyUploads on test and commons' |
[production] |
| 20:44 |
<mark> |
OS-installed Karmic on search13, search14, search16, search17, search20 |
[production] |
| 20:40 |
<RoanKattouw> |
Restarting refreshGlobalimageusage.php on Commons after it mysteriously disappeared |
[production] |
| 20:00 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Enabling GIF scaling on testwiki' |
[production] |
| 19:39 |
<RoanKattouw> |
Running refreshGlobalimagelinks.php on Commons again |
[production] |
| 19:38 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Enabling GlobalUsage on commons again' |
[production] |
| 19:35 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Turning on GlobalUsage on testwiki' |
[production] |
| 19:33 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsageQuery.php 'Seems I forgot this file' |
[production] |
| 19:20 |
<RoanKattouw> |
Running rebuildLocalisationCache.php in an attempt to kill "MagicWordArray::parseMatch: parameter not found" error |
[production] |
| 19:08 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Disable GlobalUsage again, blank pages on commons' |
[production] |
| 19:06 |
<RoanKattouw> |
Running rebuildGlobalimagelinks.php on Commons |
[production] |
| 19:03 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Re-enabling GlobalUsage' |
[production] |
| 18:57 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsage.i18n.php 'r60611' |
[production] |
| 18:56 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/SpecialGlobalUsage.php 'r60611' |
[production] |
| 18:56 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsage.php 'r60611' |
[production] |
| 18:56 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsageHooks.php 'r60611' |
[production] |
| 18:56 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsage_body.php 'r60611' |
[production] |
| 18:56 |
<catrope> |
synchronized php-1.5/extensions/GlobalUsage/ApiQueryGlobalUsage.php 'r60611' |
[production] |
| 18:55 |
<RoanKattouw> |
Deploying r60611 (GlobalUsage update) with individual sync-file's |
[production] |
| 18:49 |
<RoanKattouw> |
Truncating globalimagelinks table on commonswiki |
[production] |
| 18:48 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Temp disable GlobalUsage' |
[production] |
| 18:46 |
<RoanKattouw> |
Disabling GlobalUsage temporarily for software update |
[production] |
| 18:41 |
<catrope> |
synchronized php-1.5/wmf-config/ExtensionMessages.php 'Enabling WikimediaLicenseTexts on Commons' |
[production] |
| 18:40 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Enabling WikimediaLicenseTexts on Commons' |
[production] |
| 18:31 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Enabling WikimediaLicenseTexts on testwiki' |
[production] |
| 18:31 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Enabling WikimediaLicenseTexts on testwiki' |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.i18n.php 'r60608' |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaMessages.i18n.php 'r60608' |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaMessages.php 'r60608' |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.php 'r60608' |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaGrammarForms.php 'r60608' |
[production] |
| 18:23 |
<RoanKattouw> |
Deploying r60608 (WikimediaMessages update) using sync-file |
[production] |
| 17:47 |
<Rob> |
search13-search20 racked and ready for install |
[production] |
| 17:17 |
<Rob> |
updating dns for new search servers |
[production] |
| 14:57 |
<mark> |
synchronized php-1.5/wmf-config/mc.php 'Replace downed memcached box srv84' |
[production] |
| 14:46 |
<Rob> |
moved power for asw-b3-pmtpa, srv86 and srv87 may flap. |
[production] |
| 14:43 |
<mark> |
synchronized php-1.5/wmf-config/mc.php 'Replace downed memcached boxes srv120, srv121' |
[production] |
| 14:31 |
<Rob> |
decommissioned srv120, srv121 to make room for new search servers. |
[production] |
| 14:29 |
<Rob> |
pulling srv34 from rack to decommission, need the space for new search servers. |
[production] |
| 14:09 |
<mark> |
synchronized php-1.5/wmf-config/mc.php 'Replace memcached on just decommissioned host srv82' |
[production] |
| 13:57 |
<Rob> |
srv82, srv83, srv84 decommissioned to make room for new search servers in rack |
[production] |
| 12:56 |
<Tim> |
started squid-frontend on knsq8, knsq10, knsq11, knsq13, knsq14, knsq15, all crashed at roughly the same time as knsq9 |
[production] |
| 12:52 |
<Tim> |
started squid-frontend on knsq9, died at ~17:30 on the 3rd. Syslog shows many crashes, followed by "out of socket memory" a couple of hundred times, then silence |
[production] |