2011-11-08
§
|
12:15 |
<mutante> |
arsenic - not reachable via ssh, mgmt shows BUG: soft lockup - CPU#6 stuck for 61s! |
[production] |
11:08 |
<catrope> |
synchronized php-1.18/cache/interwiki-pr.cdb 'Update interwiki cache for [[bugzilla:29591|bug 29591]]' |
[production] |
11:08 |
<catrope> |
synchronized php-1.18/cache/interwiki.cdb 'Update interwiki cache for [[bugzilla:29591|bug 29591]]' |
[production] |
11:06 |
<catrope> |
synchronized special.dblist 'Remove sourceswiki from special.dblist to make [[rev:102388|r102388]] work' |
[production] |
05:45 |
<Tim> |
on fenari: svn up finished, started puppet and xinetd |
[production] |
04:46 |
<Tim> |
increased read timeout on formey apache from 300 to 600 to increase the chances of a successful svn up on fenari extdist |
[production] |
02:28 |
<LocalisationUpdate> |
completed (1.18) at Tue Nov 8 02:31:23 UTC 2011 |
[production] |
2011-11-07
§
|
23:18 |
<awjrichards> |
synchronized wmf-config/CommonSettings.php 'Removing AU from list of priority countries for LandingCheck' |
[production] |
21:30 |
<awjr> |
reenabling donations queue consumption job in Jenkins on aluminium |
[production] |
21:10 |
<mark> |
Reenabled BGP session to AS1299 on br1-knams |
[production] |
20:22 |
<awjr> |
disabling donations queue consumption in jenkins on aluminium |
[production] |
20:17 |
<maplebed> |
full snapshot of external store data now resides on es1001 |
[production] |
19:38 |
<awjr> |
syncing payments cluster to [[rev:102314|r102314]] |
[production] |
18:37 |
<nikerabbit> |
synchronized php-1.18/languages/messages/ 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
18:36 |
<nikerabbit> |
synchronized php-1.18/skins/common/shared.css 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
18:35 |
<nikerabbit> |
synchronized php-1.18/extensions/WikimediaMessages/WikimediaMessages.i18n.php |
[production] |
18:33 |
<nikerabbit> |
synchronized php-1.18/extensions/Narayam/ 'i18ndeploy [[rev:102305|r102305]]' |
[production] |
17:36 |
<awjr> |
pushing FUndraiserLandingPage updates, [[rev:102302|r102302]] |
[production] |
17:14 |
<awjr> |
Updating banner hiding configuration for CentralNotice to hide banners until 2012-01-31 |
[production] |
15:35 |
<apergos> |
wgContributionTrackingDBserver -> db1008 from db9 in reporting-setup.php, that should be the last of those |
[production] |
14:26 |
<apergos> |
wgContributionReportingDBserver -> db1025 after info from jeff green (but it's still access denied in the same fashion) |
[production] |
14:19 |
<mark> |
Shutdown BGP session to AS1299 on br1-knams |
[production] |
13:57 |
<apergos> |
changed wgContributionReportingDBserver in reporting-setup.php to point to db1008 instead of db10 (following jgreen's aug 18 note in server admin log) but getting Access denied for user 'public_reporting'. Jeff can you have a look? |
[production] |
13:26 |
<hashar:> |
contribution reporting DB is unreacheable: db10 |
[production] |
09:41 |
<Tim> |
stopping xinetd, puppet and extdist crontab on fenari to complete ED cleanup |
[production] |
06:50 |
<awjr> |
syncing payments cluster to [[rev:102270|r102270]] |
[production] |
06:34 |
<awjr> |
syncing payments cluster to [[rev:102268|r102268]] |
[production] |
02:19 |
<LocalisationUpdate> |
completed (1.18) at Mon Nov 7 02:22:25 UTC 2011 |
[production] |
2011-11-04
§
|
21:45 |
<aaron> |
synchronized php-1.18/includes/Title.php 'deployed [[rev:102055|r102055]]' |
[production] |
21:00 |
<RobH> |
updated dns for mgmt on es1-es4 |
[production] |
20:48 |
<rainman-sr> |
restarted search11, had lots of stuck threads.. |
[production] |
17:51 |
<aaron> |
synchronized wmf-config/InitialiseSettings.php 'disabled $wgUseNPPatrol on ruwiki, [[bugzilla:31650|bug 31650]]' |
[production] |
16:44 |
<maplebed> |
purged binary logs from >14d ago on db9 to free up disk space, set expire_logs_days to 14. |
[production] |
14:08 |
<mark> |
Labs public NAT ip firewalled to tcp port 25 on lily |
[production] |
12:46 |
<mark> |
Firewalled labs IP addresses to tcp port 25 on mchenry. |
[production] |
11:40 |
<catrope> |
synchronized wmf-config/InitialiseSettings.php 'Enable ArticleFeedback dashboard on meta' |
[production] |
04:44 |
<Ryan_Lane> |
added npm, nodejs, and etherpad-lite to the lucid-wikimedia apt repo |
[production] |
02:51 |
<Tim> |
stopping puppet and xinetd and disabling extdist crontab on fenari to update extensions directory |
[production] |
02:32 |
<Tim> |
on db10: removed the deleted relay logs from mysqld-relay-bin.index with a text editor, then ran "reset slave" and "change master" to get replication working again |
[production] |
02:26 |
<LocalisationUpdate> |
completed (1.18) at Fri Nov 4 02:29:26 UTC 2011 |
[production] |