|
2010-03-09
§
|
| 20:22 |
<rainman-sr> |
this morning's search api outage seems to be connected with index update on search8 which triggered high GC load and stuck threads, removing enwp spell index from search8 |
[production] |
| 15:37 |
<hcatlin> |
message before was referring to mobile site. |
[production] |
| 15:37 |
<hcatlin> |
deployed new languages. cs homepages. |
[production] |
| 14:58 |
<domas> |
forgot to log - yesterday's API fail was repeated today too, all API nodes were blocked on talking to lucene, and search cluster was idle too, and... |
[production] |
| 14:54 |
<catrope> |
synchronized php-1.5/languages/messages/MessagesEt.php 'force recache to solve l10ncache issue' |
[production] |
| 14:51 |
<catrope> |
synchronized php-1.5/includes/LocalisationCache.php 'r63417' |
[production] |
| 00:41 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs_alpha/FlaggedRevs.hooks.php 'deployed r63447' |
[production] |
| 00:40 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs_alpha/FlaggedRevs.class.php 'deployed r63447' |
[production] |
|
2010-03-08
§
|
| 23:59 |
<tstarling> |
synchronized php-1.5/includes/Sanitizer.php 'r63426' |
[production] |
| 23:57 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php |
[production] |
| 23:52 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed labs config cruft' |
[production] |
| 23:32 |
<AaronSchulz> |
deployed updates MFT to FlaggedRevs_alpha |
[production] |
| 23:30 |
<Fred> |
updated search nodefile to contain search[13..20]. |
[production] |
| 23:10 |
<AaronSchulz> |
finally got labs msgs working it seems |
[production] |
| 23:09 |
<aaron> |
synchronized php-1.5/wmf-config/CommonSettings.php 'do not override flaggedrevs_alpha msg dirs for lab sites' |
[production] |
| 22:40 |
<tstarling> |
synchronized php-1.5/thumb.php 'r63432' |
[production] |
| 22:04 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs_alpha/language/OldReviewedPages.i18n.php |
[production] |
| 21:54 |
<catrope> |
synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.i18n.php 'r63423' |
[production] |
| 21:41 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php |
[production] |
| 21:38 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php |
[production] |
| 21:36 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'disable LU on labs sites' |
[production] |
| 21:09 |
<catrope> |
synchronized php-1.5/includes/LocalisationCache.php 'r63417' |
[production] |
| 20:57 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'revert, no effect on msg issue' |
[production] |
| 20:53 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'settings labs cache dir' |
[production] |
| 20:31 |
<aaron> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Switched labs sites to FlaggedRevs_alpha' |
[production] |
| 20:30 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'custom cache dir config for labs sites' |
[production] |
| 19:18 |
<tstarling> |
synchronized wmf-deployment/cache/trusted-xff.cdb |
[production] |
| 18:15 |
<Fred> |
disabled regular http check for mobile1 (leaving the longer timeout one in place) |
[production] |
| 13:58 |
<catrope> |
synchronized php-1.5/cache/l10n/l10nupdate-et.cache 'Sync file *after* touching it' |
[production] |
| 13:55 |
<catrope> |
synchronized php-1.5/cache/l10n/l10nupdate-et.cache 'Sync LU cache file' |
[production] |
| 13:52 |
<catrope> |
synchronized php-1.5/languages/messages/MessagesEt.php 'Try again' |
[production] |
| 13:48 |
<catrope> |
synchronized php-1.5/languages/messages/MessagesNds_nl.php 'Fix message that didn't get picked up' |
[production] |
| 13:46 |
<catrope> |
synchronized php-1.5/languages/messages/MessagesEt.php 'See if this works' |
[production] |
| 13:20 |
<RoanKattouw> |
Rebuilding all l10n caches to prep debugging a LocalisationUpdate issue |
[production] |
| 13:16 |
<domas> |
something was wrong with sq31/sq32 - cpu/network shot through roof, can't correlate load |
[production] |
| 10:42 |
<domas> |
*sigh*, squid conf: added highPrecedence to defaults, so it is picked up by configuration builder. also, checked in files into RCS (had to take over locks from mr.Starling, sorry!). unbroke test.wikipedia API |
[production] |
| 09:43 |
<domas> |
where did test api,php fix go?! |
[production] |
| 04:38 |
<Fred> |
removed Bart's ACL in squid cache conf since it was a duplicate ACL. |
[production] |