|
2011-09-27
ยง
|
| 19:48 |
<catrope> |
synchronized php-1.18/cache/interwiki.cdb 'Attempting to make mw: et al local interwiki prefixes' |
[production] |
| 19:40 |
<Ryan_Lane> |
rebooting gurvin |
[production] |
| 19:34 |
<Ryan_Lane> |
purged all ssl proxy configuration (and certs/keys) from yvon and gurvin |
[production] |
| 19:29 |
<catrope> |
synchronized php-1.18/includes/specials/SpecialUserlogin.php '[[rev:98238|r98238]]' |
[production] |
| 19:26 |
<notpeter> |
restarting nagios on spence |
[production] |
| 19:21 |
<Jeff_Green> |
revised apache config puppetized and installed on grosley |
[production] |
| 19:17 |
<Ryan_Lane> |
repooling gurvin |
[production] |
| 19:14 |
<Ryan_Lane> |
depooling gurvin and yvon, and pooling ssl2 and ssl3 |
[production] |
| 19:05 |
<Ryan_Lane> |
depooling ssl1-4 and repooling gurvin and yvon |
[production] |
| 19:01 |
<Ryan_Lane> |
depooling gurvin for testing |
[production] |
| 18:55 |
<Ryan_Lane> |
depooling yvon, and adding ssl1-4 to https lvs group |
[production] |
| 18:52 |
<Ryan_Lane> |
pushed version of nginx with udplogging module to repo |
[production] |
| 18:25 |
<notpeter> |
restarting srv159 and srv189. swapdeath. |
[production] |
| 17:58 |
<RoanKattouw> |
Fixing corrupted article_feedback_revisions rows by hand in the enwiki DB |
[production] |
| 17:56 |
<apergos> |
restarted lighthttpd on dataset2, it had stopped |
[production] |
| 17:37 |
<Ryan_Lane> |
installing ssl1-4 |
[production] |
| 17:35 |
<py> |
synchronized wmf-config/mc.php 'putting mw24-mw27 into mc.php as memcache spares as part of RT 1550' |
[production] |
| 17:27 |
<catrope> |
synchronized php-1.17/extensions/ArticleFeedback/api/ApiArticleFeedback.php '[[rev:98232|r98232]]' |
[production] |
| 17:05 |
<Jeff_Green> |
stopping mysql on db1008 and cloning to db1048 |
[production] |
| 16:22 |
<catrope> |
synchronized php-1.18/resources/startup.js 'touch' |
[production] |
| 16:20 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Temporarily set $wgResourceLoaderValidateJS to false for [[bugzilla:31187|bug 31187]]' |
[production] |
| 16:20 |
<notpeter> |
stopping jobrunners on all external store apaches and removing from puppet/dsh group |
[production] |
| 15:56 |
<Jeff_Green> |
throwing payments4 back in the pool to test new firewall rules |
[production] |
| 15:22 |
<robh> |
updated dns for ssl1-ssl4 |
[production] |
| 15:05 |
<py> |
synchronized wmf-config/db.php 'putting srv180 and srv163 back into db.php as they are back up' |
[production] |
| 14:34 |
<notpeter> |
restarting srv180 |
[production] |
| 14:33 |
<notpeter> |
restarting srv163 (this time the right one...) |
[production] |
| 14:18 |
<ariel> |
synchronized php-1.18/includes/HistoryBlob.php 'mhash workaround from 117wmf1' |
[production] |
| 14:11 |
<notpeter> |
restarting srv161 |
[production] |
| 13:56 |
<notpeter> |
powercycling srv188 |
[production] |
| 13:54 |
<RoanKattouw> |
Fixed ownership of /apache/common/php-1.17/cache/l10n from nagios:wikidev to mwdeploy:mwdeploy |
[production] |
| 13:38 |
<notpeter> |
restarting srv171 |
[production] |
| 13:37 |
<catrope> |
synchronized wmf-config/db.php 'Comment out srv163 and srv180 from ES list, they are dead' |
[production] |
| 13:12 |
<notpeter> |
powercycled srv179 to bring it back up |
[production] |
| 12:19 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31172 - Deploy WikiLove on orwiki' |
[production] |
| 12:14 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31178 - Enable wikilove in Portuguese Wikipedia' |
[production] |
| 11:36 |
<RoanKattouw> |
Edited /home/wikipedia/bin/sync-common-file and added -o -oSetupTimeout=10 to the dsh command line. This makes sync-file not hang forever when an Apache is down. Thanks to maplebed for the tip |
[production] |
| 11:35 |
<catrope> |
synchronized php-1.18/extensions/WikiLove/modules/ext.wikiLove/ext.wikiLove.core.js '[[rev:98218|r98218]]' |
[production] |
| 11:35 |
<catrope> |
synchronized php-1.17/extensions/WikiLove/modules/ext.wikiLove/ext.wikiLove.core.js '[[rev:98218|r98218]]' |
[production] |
| 11:20 |
<RoanKattouw> |
Killed job runners on srv155 |
[production] |
| 10:45 |
<mark> |
Stopped job runner on srv161 |
[production] |
| 10:44 |
<mark> |
Stopped memcached on srv161 |
[production] |
| 09:56 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Disable interwiki-pr.cdb, again. I swear I disabled this before but I guess it came back' |
[production] |
| 09:52 |
<catrope> |
synchronized php-1.17/includes/parser/Parser.php 'Actually deploy [[rev:98197|r98197]], grr, forgot to ran svn up before scapping last night' |
[production] |
| 09:51 |
<catrope> |
synchronized php-1.18/includes/parser/Parser.php 'Actually deploy [[rev:98195|r98195]], grr' |
[production] |
| 05:45 |
<mutante> |
amssq34 - powercycle,dist-upgrade,puppet,squid clean,reboot |
[production] |
| 05:27 |
<mutante> |
amssq32 - powercycle,dist-upgrade,puppet,squid clean,reboot |
[production] |
| 04:47 |
<mutante> |
deleted files from /tmp that had not been read for 30 days+ on several srv's to free disk space (RT 1571) |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.18) at Tue Sep 27 02:31:52 UTC 2011 |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.17) at Tue Sep 27 02:28:40 UTC 2011 |
[production] |