|
2012-07-05
§
|
| 16:50 |
<mutante> |
powercycling downed db1015 |
[production] |
| 16:44 |
<mutante> |
powercycling and upgrading more mw10xx servers, 1017,1023,1025 ... |
[production] |
| 16:27 |
<mutante> |
mw1002, mw1007,mw1009,mw1011 - crashed,powercycling,dist-upgrading+kernel,reboot |
[production] |
| 16:18 |
<mutante> |
powercycling mw1002 |
[production] |
| 15:37 |
<mutante> |
argon back up with new kernel,mysql,grub,.. looks happy afaict |
[production] |
| 15:33 |
<mutante> |
argon (limesurvey) fscked, dist-upgrading |
[production] |
| 15:28 |
<mutante> |
powercycling argon |
[production] |
| 15:26 |
<hashar> |
updated Jenkins configuration on gallium : Updating f407ebe..4b669b9 |
[production] |
| 14:08 |
<cmjohnson1> |
HUME replacing disk 0 |
[production] |
| 14:08 |
<midom> |
synchronized wmf-config/InitialiseSettings.php 'disabling parser cache for now' |
[production] |
| 11:54 |
<mark> |
Inserted new pybal_1.02 package into APT distribution precise-wikimedia |
[production] |
| 11:17 |
<mark> |
Installed new pybal snapshot build for testing on lvs1005 |
[production] |
| 11:13 |
<mutante> |
add missing Russian locales on singer, run localegen, run ru.planet update |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.20wmf6) at Thu Jul 5 02:26:45 UTC 2012 |
[production] |
|
2012-07-04
§
|
| 16:32 |
<mutante> |
wikidata.org on now - redirect purged from squids |
[production] |
| 15:43 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'imports' |
[production] |
| 15:40 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Enable LQT on fiwikimedia' |
[production] |
| 15:39 |
<Reedy> |
Killed php-1.20wmf5 localisation cache from mediawiki-installation group |
[production] |
| 15:37 |
<Reedy> |
Created LQT tables on fiwikimedia |
[production] |
| 15:25 |
<mutante> |
wikidata.org works now, besides old redirect may still be cached on cp* boxes (not purged by purgeList.php via multicast?). http://www.wikidata.org/?notcached |
[production] |
| 15:06 |
<mutante> |
sync-common-file extract2.php, apache-graceful-all |
[production] |
| 15:04 |
<dzahn> |
synchronized extract2.php |
[production] |
| 13:23 |
<mutante> |
apache-graceful-all to add wikidata.org virtual host |
[production] |
| 13:21 |
<mutante> |
svn commiting gerrit 987, sync-apache |
[production] |
| 13:14 |
<mutante> |
git pull in /h/w/common/docroot . adding wikidata.org files on fenari. , then "sync-docroot" |
[production] |
| 12:44 |
<dzahn> |
synchronized php/cache/interwiki.cdb 'Updating interwiki cache' |
[production] |
| 12:44 |
<mutante> |
updating/syncing interwiki cache |
[production] |
| 09:32 |
<hashar> |
swift-container-auditor seems to get down from time. Nagios reporting 0 processes at 8:15am and 9:25am UTC (I guess it get restarted automatically by puppet) |
[production] |
| 07:34 |
<hashar> |
updating Jenkins copy of integration/jenkins from 0f069c3 to e264d1b. Bring new ant script + update to testswarm fetcher |
[production] |
| 07:09 |
<Tim> |
on srv193: ran dpkg --set-selections to revert holds on php5 packages and ran apt-get upgrade |
[production] |
| 07:07 |
<Tim> |
on srv193: fixing broken PHP packages causing puppet failure, nothing in the server admin log about them so I assume they were installed by accident |
[production] |
| 06:21 |
<Tim> |
deployed Idb6d9a8b and restarting apaches |
[production] |
| 06:11 |
<Tim> |
deployed Id7008681 and restarting apaches |
[production] |
| 05:45 |
<Tim> |
reniced apache processes to level 0 |
[production] |
| 05:04 |
<Tim> |
deploying apache nice level change per RT #664 |
[production] |
| 03:59 |
<Tim> |
on mw1: experimenting with renice methods for RT 664 |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.20wmf6) at Wed Jul 4 02:26:39 UTC 2012 |
[production] |
|
2012-07-03
§
|
| 23:03 |
<mlitn> |
synchronized php-1.20wmf6/extensions/ArticleFeedbackv5/ |
[production] |
| 22:36 |
<preilly> |
synchronized php-1.20wmf6/extensions/MobileFrontend 'weekly update' |
[production] |
| 22:27 |
<hashar> |
updating testswarm submitter on gallium |
[production] |
| 21:01 |
<mlitn> |
Finished syncing Wikimedia installation... : |
[production] |
| 20:37 |
<mlitn> |
Started syncing Wikimedia installation... : |
[production] |
| 20:18 |
<asher> |
synchronized wmf-config/db.php 'lowering db32 weight' |
[production] |
| 19:34 |
<asher> |
synchronized wmf-config/db.php 'lowering db36 weight' |
[production] |
| 19:31 |
<asher> |
synchronized wmf-config/db.php 're-add db36, db32 (low weight), es3 (innodb)' |
[production] |
| 18:11 |
<RobH> |
virt1006 mgmt serial not set correctly, fixed |
[production] |
| 17:51 |
<RobH> |
investigating stat1001 power issue |
[production] |
| 17:22 |
<RobH> |
fluorine offlining to test disks |
[production] |
| 17:22 |
<RobH> |
pulling helium offline for disk testing with fluorine disks |
[production] |
| 17:10 |
<RobH> |
db1047 disk0 rebuild in progress |
[production] |