|
2009-11-12
§
|
| 18:39 |
<midom> |
synchronized php/cache/interwiki.cdb |
[production] |
| 18:28 |
<Rob> |
bad php error pushed by me, rolled it back, things should come back up now |
[production] |
| 18:28 |
<root> |
ran sync-common-all |
[production] |
| 18:22 |
<root> |
ran sync-common-all |
[production] |
| 16:59 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'LiquidThreads_alpha stuff doesn't seem to have taken effect, turned it off for lqt labs for now, will have another stab later' |
[production] |
| 16:50 |
<andrew> |
synchronized php-1.5/wmf-config/liquidthreads.php 'Fix name of LiquidThreads alpha variable (wmgLiquidThreadsAlpha)' |
[production] |
| 16:49 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Fix name of LiquidThreads alpha variable (wmgLiquidThreadsAlpha)' |
[production] |
| 16:47 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/classes/View.php 'commit live hack in r58954' |
[production] |
| 16:29 |
<Andrew> |
Re-scapping to update localisation for LiquidThreads alpha (which is technically a "new extension") |
[production] |
| 16:26 |
<Andrew> |
tomasz has left some non-group-writeable dirs around in our checkout, please change your umask drwxr-xr-x 3 tfinc wikidev 32 Nov 9 06:44 GeoLite |
[production] |
| 16:21 |
<Andrew> |
Which one is used is controlled by a new variable, wmgLiquidThreads_alpha -- true to use the alpha. Only activated on liquidthreads_labswikimedia. Scapping to apply updates. |
[production] |
| 16:20 |
<Andrew> |
Split LiquidThreads to LiquidThreads_alpha and LiquidThreads, LiquidThreads_alpha being the most recent version. |
[production] |
| 15:37 |
<Rob> |
bayes back online, let the statistic-crunching resume =] |
[production] |
| 15:29 |
<Rob> |
updating dns to reflect new mgmt ip for bayes |
[production] |
| 03:29 |
<tstarling> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'turning $wgHtml5 back off again due to bugs' |
[production] |
| 01:37 |
<tstarling> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Enabling $wgHtml5' |
[production] |
| 00:15 |
<tfinc> |
synchronized php-1.5/extensions/ContributionTracking/ContributionTracking_body.php |
[production] |
|
2009-11-09
§
|
| 23:15 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Disabling GlobalUsage due to major scaling issues, discussion on private-l' |
[production] |
| 22:56 |
<tstarling> |
synchronized docroot/secure/keys.html |
[production] |
| 22:55 |
<tstarling> |
synchronized docroot/secure/keys.txt |
[production] |
| 20:57 |
<Rob> |
wordpress upgraded for techblog. by upgraded we mean new install and manual copy of existing uplaoded files and customizations. |
[production] |
| 20:51 |
<Rob> |
techblog accessibility still spotty. Wordpress upgrades are sometimes painful. |
[production] |
| 20:12 |
<Rob> |
messing with updating wordpress for techblog. It failed before so techblog will be up and down during the next few minutes |
[production] |
| 20:11 |
<Fred> |
raised the number of apache threads on Singer to accommodate secure traffic. |
[production] |
| 19:29 |
<mark> |
Disconnected drbd resource nfshome on nfs2: RAID1 resync was still running, waiting for it to finish before attempting DRBD resync |
[production] |
| 19:15 |
<tfinc> |
synchronized php-1.5/extensions/ContributionReporting/ContributionHistory_body.php |
[production] |
| 18:59 |
<mark> |
Stopped NFS kernel server on db20 (yes, that's /home) |
[production] |
| 18:34 |
<mark> |
Turned off swap on db20: block device needed for DRBD external metadata |
[production] |
| 17:04 |
<mark> |
OS-installed nfs2 |
[production] |
| 16:40 |
<mark> |
Running restart of puppetd across the cluster |
[production] |
| 16:35 |
<mark> |
Running backup of db20 /home |
[production] |
| 16:28 |
<mark> |
Running dist-upgrade on locke |
[production] |
| 16:00 |
<mark> |
fsck repaired /var/backup on mchenry, filesystem remounted |
[production] |
| 15:55 |
<mark> |
Added tridge to the ALL node group |
[production] |
| 15:49 |
<mark> |
dist-upgrade and reboot of tridge |
[production] |
| 15:42 |
<mark> |
Running new fsck on mchenry while the system is up |
[production] |
| 15:41 |
<mark> |
/var/backups filesystem on mchenry is corrupt |
[production] |
| 15:22 |
<mark> |
Reset DRAC password of sanger |
[production] |
| 15:18 |
<mark> |
Rebooting mchenry |
[production] |
| 15:16 |
<mark> |
Running apt-get dist-upgrade on mchenry |
[production] |
| 15:06 |
<mark> |
Rebooting sanger |
[production] |
| 15:04 |
<mark> |
Running apt-get dist-upgrade on sanger |
[production] |
| 14:41 |
<mark> |
Shutdown bart for decommissioning |
[production] |
| 14:36 |
<mark> |
Deployed cron job to restart puppet daily |
[production] |
| 14:35 |
<mark> |
Deployed automatic updating of GeoIP database across the cluster |
[production] |
| 08:14 |
<brion> |
killed duplicate wikibugs irc bot connection, stopping double bug reporting in #mediawiki |
[production] |