|
2011-11-08
§
|
| 20:03 |
<maplebed> |
changed replication topology for external store cluster; new ES hosts are all now replicating off es3, which is still replicating off ms3. |
[production] |
| 19:52 |
<AaronSchulz> |
ran fixBug32198.php and confirmed that there are no more affected rows atm |
[production] |
| 19:49 |
<tfinc> |
synchronized wmf-config/InitialiseSettings.php 'Upping resolution of wmf wiki logo to 35px' |
[production] |
| 19:46 |
<tfinc> |
synchronized wmf-config/InitialiseSettings.php 'Pushing config change again due to missing ssh agent' |
[production] |
| 19:01 |
<ben> |
synchronized wmf-config/db.php 'switching external store cluster6 from srv hosts to new ES hardware es3 and es4.' |
[production] |
| 19:00 |
<maplebed> |
switching external store cluster6 to new ES hardware. |
[production] |
| 18:14 |
<mark> |
Converted eth0 on sq67 to an aggregated interface of eth0-4 |
[production] |
| 17:25 |
<mark> |
Converted eth0 on sq68 to an aggregated interface of eth0-4 |
[production] |
| 15:15 |
<catrope> |
synchronized wmf-config/CommonSettings.php '[[bugzilla:28026|bug 28026]] trial - Enable $wgEnotifUserTalk on all wikis, but keep $wgShowUpdatedMarker disabled where it was disabled before' |
[production] |
| 15:07 |
<RoanKattouw> |
...after fixing permissions on cache/l10n AGAIN |
[production] |
| 15:07 |
<RoanKattouw> |
Ran sync-l10nupdate |
[production] |
| 12:22 |
<mutante> |
arsenic - alright known kernel issue with bonding, ack |
[production] |
| 12:17 |
<mutante> |
arsenic - power cycling |
[production] |
| 12:15 |
<mutante> |
arsenic - not reachable via ssh, mgmt shows BUG: soft lockup - CPU#6 stuck for 61s! |
[production] |
| 11:08 |
<catrope> |
synchronized php-1.18/cache/interwiki-pr.cdb 'Update interwiki cache for [[bugzilla:29591|bug 29591]]' |
[production] |
| 11:08 |
<catrope> |
synchronized php-1.18/cache/interwiki.cdb 'Update interwiki cache for [[bugzilla:29591|bug 29591]]' |
[production] |
| 11:06 |
<catrope> |
synchronized special.dblist 'Remove sourceswiki from special.dblist to make [[rev:102388|r102388]] work' |
[production] |
| 05:45 |
<Tim> |
on fenari: svn up finished, started puppet and xinetd |
[production] |
| 04:46 |
<Tim> |
increased read timeout on formey apache from 300 to 600 to increase the chances of a successful svn up on fenari extdist |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.18) at Tue Nov 8 02:31:23 UTC 2011 |
[production] |
|
2011-11-07
§
|
| 23:18 |
<awjrichards> |
synchronized wmf-config/CommonSettings.php 'Removing AU from list of priority countries for LandingCheck' |
[production] |
| 21:30 |
<awjr> |
reenabling donations queue consumption job in Jenkins on aluminium |
[production] |
| 21:10 |
<mark> |
Reenabled BGP session to AS1299 on br1-knams |
[production] |
| 20:22 |
<awjr> |
disabling donations queue consumption in jenkins on aluminium |
[production] |
| 20:17 |
<maplebed> |
full snapshot of external store data now resides on es1001 |
[production] |
| 19:38 |
<awjr> |
syncing payments cluster to [[rev:102314|r102314]] |
[production] |
| 18:37 |
<nikerabbit> |
synchronized php-1.18/languages/messages/ 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
| 18:36 |
<nikerabbit> |
synchronized php-1.18/skins/common/shared.css 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
| 18:35 |
<nikerabbit> |
synchronized php-1.18/extensions/WikimediaMessages/WikimediaMessages.i18n.php |
[production] |
| 18:33 |
<nikerabbit> |
synchronized php-1.18/extensions/Narayam/ 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
| 17:36 |
<awjr> |
pushing FUndraiserLandingPage updates, [[rev:102302|r102302]] |
[production] |
| 17:14 |
<awjr> |
Updating banner hiding configuration for CentralNotice to hide banners until 2012-01-31 |
[production] |
| 15:35 |
<apergos> |
wgContributionTrackingDBserver -> db1008 from db9 in reporting-setup.php, that should be the last of those |
[production] |
| 14:26 |
<apergos> |
wgContributionReportingDBserver -> db1025 after info from jeff green (but it's still access denied in the same fashion) |
[production] |
| 14:19 |
<mark> |
Shutdown BGP session to AS1299 on br1-knams |
[production] |
| 13:57 |
<apergos> |
changed wgContributionReportingDBserver in reporting-setup.php to point to db1008 instead of db10 (following jgreen's aug 18 note in server admin log) but getting Access denied for user 'public_reporting'. Jeff can you have a look? |
[production] |
| 13:26 |
<hashar:> |
contribution reporting DB is unreacheable: db10 |
[production] |
| 09:41 |
<Tim> |
stopping xinetd, puppet and extdist crontab on fenari to complete ED cleanup |
[production] |
| 06:50 |
<awjr> |
syncing payments cluster to [[rev:102270|r102270]] |
[production] |
| 06:34 |
<awjr> |
syncing payments cluster to [[rev:102268|r102268]] |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.18) at Mon Nov 7 02:22:25 UTC 2011 |
[production] |