|
2011-08-03
§
|
| 12:21 |
<mark> |
Rebooting both nas1001 controllers with corrected network config |
[production] |
| 10:02 |
<root> |
synchronized wmf-config/mc.php 'swapped out all down servers returning 0 with ones returning 100, cleaned up spares and down list to be accurate' |
[production] |
| 09:44 |
<RobH> |
swapping out down memcached servers iwth tested up ones |
[production] |
| 09:44 |
<RobH> |
incorrect, turns out there are some down, they reply but do not return full weight |
[production] |
| 09:44 |
<robh> |
synchronized wmf-config/mc.php 'replacing down servers' |
[production] |
| 09:40 |
<RobH> |
nagios shows spence memcached error, yet manual testing shows all memcached are pooled fine. |
[production] |
| 09:01 |
<Ryan_Lane> |
installing ssl1001-4 |
[production] |
| 08:09 |
<apergos> |
live hack to /usr/share/etherpad/etherpad/bin/run-local.sh on hooper to force maxthreads to 512 for etherpad. restarted etherpad, this may or may not help connection issues (maybe we'll just oom instead?) |
[production] |
| 07:40 |
<domas> |
stupid bot and its quotes, http://p.defau.lt/?UUberPb2hRtPxOzG7Q6OwQ is the url |
[production] |
| 07:39 |
<midom> |
synchronized php/includes/db/DatabaseMysql.php 'livehacking out sql_mode and set charset code - http://p.defau.lt/?UUberPb2hRtPxOzG7Q6OwQ' |
[production] |
| 02:20 |
<LocalisationUpdate> |
completed at Wed Aug 3 02:22:48 UTC 2011 |
[production] |
|
2011-08-02
§
|
| 23:25 |
<binasher> |
done with that epic test |
[production] |
| 23:04 |
<binasher> |
redeploying revised mobile acls with the redirector only matching /wiki/ urls for brief (15min) test |
[production] |
| 22:19 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'added $wgExtendedVersionNumber (Het Deploy), should have no effect now' |
[production] |
| 19:19 |
<binasher> |
reverted mobile redirect acls |
[production] |
| 18:58 |
<binasher> |
deploying mobile redirect acls/helper to all frontend text squids (--slow) |
[production] |
| 18:16 |
<jeluf> |
synchronized wmf-config/InitialiseSettings.php '30186 - Install WikiLove on the Hebrew Wikipedia' |
[production] |
| 18:03 |
<notpeter> |
restarting torrus again. cuz it's my favorite thing to do... |
[production] |
| 17:16 |
<Reedy> |
As part of fatal coming from OAIRepository decreased by 10% from 50 to 45. No fatals in logs for nearly a week though |
[production] |
| 17:15 |
<reedy> |
synchronized wmf-config/CommonSettings.php '[[bugzilla:29304|bug 29304]] Set to 45' |
[production] |
| 17:04 |
<reedy> |
synchronized php-1.17/extensions/OAI/OAIRepo_body.php '[[rev:93770|r93770]]' |
[production] |
| 17:03 |
<reedy> |
synchronized php-1.17/extensions/OAI/OAIRepo.php '[[rev:93770|r93770]]' |
[production] |
| 17:02 |
<reedy> |
synchronized php-1.17/includes/parser/Preprocessor_DOM.php '[[rev:93763|r93763]]' |
[production] |
| 15:28 |
<catrope> |
synchronized php/includes/media/SVG.php '[[rev:93750|r93750]]' |
[production] |
| 14:23 |
<laner> |
synchronized wmf-config/InitialiseSettings.php 'Changing main namespace for ladwiki' |
[production] |
| 12:49 |
<midom> |
synchronized wmf-config/InitialiseSettings.php 'reenabling disk cache' |
[production] |
| 12:42 |
<domas> |
synced http://p.defau.lt/?Jze2xAwLV4Fvh8JC2B_KqQ to fix memcached side of pcache |
[production] |
| 12:40 |
<midom> |
synchronized php/includes/objectcache/MemcachedClient.php |
[production] |
| 12:07 |
<midom> |
synchronized wmf-config/InitialiseSettings.php 'disabling disk cache' |
[production] |
| 12:00 |
<Ryan_Lane> |
changing management dns entry for phosphorus to ssl1004 |
[production] |
| 11:57 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php 'removed l10n debug log group' |
[production] |
| 11:56 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'reverted live hack' |
[production] |
| 11:52 |
<RobH> |
updated wikibugs on mchenry per rt#1179, restarted the service |
[production] |
| 11:44 |
<tstarling> |
synchronized multiversion/MWVersion.php '[[rev:93727|r93727]] fix l10n cache' |
[production] |
| 11:38 |
<RobH> |
restarted pdns on linne |
[production] |
| 11:31 |
<RobH> |
updated dns for ssl and silicon servers |
[production] |
| 11:31 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'log l10n file list changes' |
[production] |
| 11:30 |
<preilly> |
synchronized php/extensions/MobileFrontend/MobileFrontend.php 'Removed unmatched wfProfileOut()' |
[production] |
| 11:26 |
<RobH> |
phosphorus changed to sl1004 in dns and racktables |
[production] |
| 11:20 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'enough data' |
[production] |
| 11:16 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'more logging' |
[production] |
| 11:15 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'more logging' |
[production] |
| 11:11 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php 'logging hack for recache tracking' |
[production] |
| 11:10 |
<tstarling> |
synchronized php-1.17/includes/LocalisationCache.php 'logging hack for recache tracking' |
[production] |
| 11:04 |
<preilly> |
synchronized php/extensions/MobileFrontend/MobileFrontend.php 'Removed unmatched wfProfileOut()' |
[production] |
| 11:04 |
<laner> |
synchronized wmf-config/InitialiseSettings.php 'Adding sitename for ladwiki, per [[bugzilla:30181|bug 30181]]' |
[production] |
| 10:16 |
<mark> |
Restarting all PyBal instances in a controlled manner |
[production] |
| 10:13 |
<mark> |
Split LVS class high-traffic into high-traffic1 (text, bits) and high-traffic2 (upload), and made a separate class for https with BGP disabled |
[production] |
| 09:29 |
<Ryan_Lane> |
powercycling srv281 |
[production] |
| 08:14 |
<mark> |
Increased TTL of bits.pmtpa.wikimedia.org from 60 to 1H |
[production] |