|
2012-03-16
§
|
| 16:43 |
<RobH> |
cp1019 back in full service |
[production] |
| 16:22 |
<reedy> |
synchronized php-1.19/extensions/CentralAuth/specials/SpecialCentralAuth.php '[[rev:114021|r114021]]' |
[production] |
| 16:22 |
<RobH> |
cp1017 memory error, coming down for troubleshooting. |
[production] |
| 16:18 |
<RobH> |
cp1019 memory error cleared after reseating, notes on rt 2651 |
[production] |
| 16:09 |
<mark> |
Migrated all varnish3 packages to newer varnish packages from git |
[production] |
| 16:08 |
<RobH> |
cp1019 coming down for memory error troubleshooting |
[production] |
| 15:58 |
<RobH> |
cp1040 repaired per rt 2611 |
[production] |
| 15:48 |
<RobH> |
cp1040 down for memory replacement |
[production] |
| 15:09 |
<reedy> |
synchronized stylize.php 'Test for hume' |
[production] |
| 15:04 |
<root> |
synchronized ufg.sql 'test sync to see if hume is fixed' |
[production] |
| 14:55 |
<reedy> |
synchronized php-1.19/extensions/WikimediaMaintenance/cleanupBug31576.php |
[production] |
| 14:04 |
<apergos> |
restarted swift-container-auditor on ms-be3, it had died for some reason |
[production] |
| 08:07 |
<mutante> |
i reverted that (star cert for wikitech), no worries i "shred"ded the files |
[production] |
| 07:51 |
<mutante> |
replaced self-signed cert on wikitech with the star cert |
[production] |
| 04:19 |
<mutante> |
on stafford, deleting spence's puppet report files to free some disk space (they are like the largest report files of all) |
[production] |
| 03:09 |
<mutante> |
stafford - - /var/lib/puppet/reports is getting quite large (18G), and we got the first disk space warning, do we want to keep those? |
[production] |
| 02:45 |
<mutante> |
killing nrpe on several hosts where it was running as the wrong user again (somehow through the use of dsh) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.19) at Fri Mar 16 02:21:35 UTC 2012 |
[production] |
| 01:12 |
<mutante> |
stopping nagios-wm temp. while changing nrpe config (will watch it manually until it's back) |
[production] |
| 00:54 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Add NS to stewardwiki at request of Philippe' |
[production] |
| 00:51 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Add NS to stewardwiki at request of Philippe' |
[production] |
|
2012-03-15
§
|
| 23:17 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedbackv5/ArticleFeedbackv5.hooks.php '[[rev:113974|r113974]]' |
[production] |
| 23:12 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/templates/DisableTemplate.php '[[rev:113973|r113973]], fixes [[bugzilla:35249|bug 35249]]' |
[production] |
| 23:10 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedbackv5/modules/ext.articleFeedbackv5/ext.articleFeedbackv5.js '[[rev:113972|r113972]]' |
[production] |
| 22:59 |
<catrope> |
synchronized php-1.19/resources/startup.js 'touch' |
[production] |
| 22:59 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Bump AFTv4 event logging percentage from 25% to 100%' |
[production] |
| 22:57 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedback/modules/jquery.articleFeedback/jquery.articleFeedback.js |
[production] |
| 22:48 |
<mutante> |
purging Lucene monitoring on indexer from db9, remove duplicate service definitions manually anyways (still tons left), run purge script, reload Nagios.. |
[production] |
| 22:24 |
<catrope> |
synchronized php-1.19/resources/startup.js 'touch' |
[production] |
| 22:23 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Raise AFTv4 event logging percentage from 5% to 25%' |
[production] |
| 22:21 |
<mutante> |
getting rid of Swift HTTP checks on non production machines manually (come on spence _purge_ ;P) |
[production] |
| 22:07 |
<catrope> |
synchronized php-1.19/resources/startup.js 'touch' |
[production] |
| 22:04 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Raise AFTv4 event logging percentage from 1% to 5%' |
[production] |
| 21:44 |
<catrope> |
synchronized php-1.19/resources/startup.js 'touch' |
[production] |
| 21:28 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedbackv5/ArticleFeedbackv5.hooks.php '[[rev:113961|r113961]]' |
[production] |
| 21:25 |
<pgehres> |
K4-713 synchronized payments cluster to [[rev:113956|r113956]] |
[production] |
| 21:25 |
<pgehres> |
disabled credit cards on donate.wikimedia.org |
[production] |
| 21:21 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedbackv5/ArticleFeedbackv5.hooks.php 'fix fatal' |
[production] |
| 21:20 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Bump AFTv4 event logging percentage from 0.27% to 1%' |
[production] |
| 21:19 |
<Ryan_Lane> |
rebalancing instances gluster volume |
[production] |
| 21:19 |
<RoanKattouw> |
That was [[rev:113959|r113959]] |
[production] |
| 21:18 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedback/modules/ext.articleFeedback/ext.articleFeedback.js |
[production] |
| 21:11 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedback/modules/ext.articleFeedback/ext.articleFeedback.js '[[rev:113958|r113958]]' |
[production] |
| 21:09 |
<catrope> |
synchronized php-1.19/extensions/ArticleFeedbackv5/ '[[rev:113957|r113957]]' |
[production] |
| 20:46 |
<mark> |
bits.pmtpa cluster back online |
[production] |
| 20:44 |
<RobH> |
dns update for silver and zhen servers |
[production] |
| 20:37 |
<reedy> |
synchronized php-1.19/extensions/WikimediaMaintenance/cleanupBug31576.php |
[production] |
| 19:54 |
<RobH> |
sq67-sq70 have been reinstalled, but not signed in puppet, not sure if they are ready for that or if there are other items mark needs to change first |
[production] |
| 19:11 |
<RobH> |
working on sq67-sq70 reinstalls, disregard alerts |
[production] |
| 19:00 |
<RobH> |
db1022 resetup and redeployed per rt 2537 and assigned back to asher |
[production] |