|
2011-09-27
§
|
| 18:25 |
<notpeter> |
restarting srv159 and srv189. swapdeath. |
[production] |
| 17:58 |
<RoanKattouw> |
Fixing corrupted article_feedback_revisions rows by hand in the enwiki DB |
[production] |
| 17:56 |
<apergos> |
restarted lighthttpd on dataset2, it had stopped |
[production] |
| 17:37 |
<Ryan_Lane> |
installing ssl1-4 |
[production] |
| 17:35 |
<py> |
synchronized wmf-config/mc.php 'putting mw24-mw27 into mc.php as memcache spares as part of RT 1550' |
[production] |
| 17:27 |
<catrope> |
synchronized php-1.17/extensions/ArticleFeedback/api/ApiArticleFeedback.php '[[rev:98232|r98232]]' |
[production] |
| 17:05 |
<Jeff_Green> |
stopping mysql on db1008 and cloning to db1048 |
[production] |
| 16:22 |
<catrope> |
synchronized php-1.18/resources/startup.js 'touch' |
[production] |
| 16:20 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Temporarily set $wgResourceLoaderValidateJS to false for [[bugzilla:31187|bug 31187]]' |
[production] |
| 16:20 |
<notpeter> |
stopping jobrunners on all external store apaches and removing from puppet/dsh group |
[production] |
| 15:56 |
<Jeff_Green> |
throwing payments4 back in the pool to test new firewall rules |
[production] |
| 15:22 |
<robh> |
updated dns for ssl1-ssl4 |
[production] |
| 15:05 |
<py> |
synchronized wmf-config/db.php 'putting srv180 and srv163 back into db.php as they are back up' |
[production] |
| 14:34 |
<notpeter> |
restarting srv180 |
[production] |
| 14:33 |
<notpeter> |
restarting srv163 (this time the right one...) |
[production] |
| 14:18 |
<ariel> |
synchronized php-1.18/includes/HistoryBlob.php 'mhash workaround from 117wmf1' |
[production] |
| 14:11 |
<notpeter> |
restarting srv161 |
[production] |
| 13:56 |
<notpeter> |
powercycling srv188 |
[production] |
| 13:54 |
<RoanKattouw> |
Fixed ownership of /apache/common/php-1.17/cache/l10n from nagios:wikidev to mwdeploy:mwdeploy |
[production] |
| 13:38 |
<notpeter> |
restarting srv171 |
[production] |
| 13:37 |
<catrope> |
synchronized wmf-config/db.php 'Comment out srv163 and srv180 from ES list, they are dead' |
[production] |
| 13:12 |
<notpeter> |
powercycled srv179 to bring it back up |
[production] |
| 12:19 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31172 - Deploy WikiLove on orwiki' |
[production] |
| 12:14 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31178 - Enable wikilove in Portuguese Wikipedia' |
[production] |
| 11:36 |
<RoanKattouw> |
Edited /home/wikipedia/bin/sync-common-file and added -o -oSetupTimeout=10 to the dsh command line. This makes sync-file not hang forever when an Apache is down. Thanks to maplebed for the tip |
[production] |
| 11:35 |
<catrope> |
synchronized php-1.18/extensions/WikiLove/modules/ext.wikiLove/ext.wikiLove.core.js '[[rev:98218|r98218]]' |
[production] |
| 11:35 |
<catrope> |
synchronized php-1.17/extensions/WikiLove/modules/ext.wikiLove/ext.wikiLove.core.js '[[rev:98218|r98218]]' |
[production] |
| 11:20 |
<RoanKattouw> |
Killed job runners on srv155 |
[production] |
| 10:45 |
<mark> |
Stopped job runner on srv161 |
[production] |
| 10:44 |
<mark> |
Stopped memcached on srv161 |
[production] |
| 09:56 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Disable interwiki-pr.cdb, again. I swear I disabled this before but I guess it came back' |
[production] |
| 09:52 |
<catrope> |
synchronized php-1.17/includes/parser/Parser.php 'Actually deploy [[rev:98197|r98197]], grr, forgot to ran svn up before scapping last night' |
[production] |
| 09:51 |
<catrope> |
synchronized php-1.18/includes/parser/Parser.php 'Actually deploy [[rev:98195|r98195]], grr' |
[production] |
| 05:45 |
<mutante> |
amssq34 - powercycle,dist-upgrade,puppet,squid clean,reboot |
[production] |
| 05:27 |
<mutante> |
amssq32 - powercycle,dist-upgrade,puppet,squid clean,reboot |
[production] |
| 04:47 |
<mutante> |
deleted files from /tmp that had not been read for 30 days+ on several srv's to free disk space (RT 1571) |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.18) at Tue Sep 27 02:31:52 UTC 2011 |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.17) at Tue Sep 27 02:28:40 UTC 2011 |
[production] |
| 02:21 |
<aaron> |
rebuilt and synchronized wikiversions files... : enwikiquote, betawikiversity, eowiki to 1.18 |
[production] |
| 02:09 |
<aaron> |
rebuilt and synchronized wikiversions files... : metawiki,incubatorwiki to 1.18 |
[production] |
| 02:04 |
<tstarling> |
synchronized php-1.18/extensions/OggHandler/OggHandler_body.php |
[production] |
| 01:38 |
<aaron> |
synchronized php-1.18/includes/Skin.php 'fixed newFromName() related fatal' |
[production] |
| 01:03 |
<aaron> |
synchronized wikiversions.cdb |
[production] |
| 00:58 |
<aaron> |
rebuilt and synchronized wikiversions files... : switched nlwiki to 1.18 |
[production] |
| 00:44 |
<aaron> |
synchronized php-1.18/includes/cache/MessageCache.php 'deployed [[rev:98201|r98201]]' |
[production] |
| 00:35 |
<Tim> |
cleared the message cache on mediawikiwiki |
[production] |
| 00:18 |
<tstarling> |
synchronized php-1.18/languages/messages/MessagesEn.php |
[production] |
| 00:12 |
<ben> |
synchronized wmf-config/db.php 'retabbed the db.php; no content changes.' |
[production] |
| 00:00 |
<ben> |
synchronized wmf-config/db.php 'putting two apache hosts into rotation for cluster8 since they're up, happy, and have correct content.' |
[production] |