|
2012-05-16
§
|
| 19:14 |
<Reedy> |
manually ran ddsh -cM -g mediawiki-installation -o -oSetupTimeout=30 -F30 "sudo -u mwdeploy rsync -a 10.0.5.8::common/*.dblist /usr/local/apache/common-local" because sync-dblist is woefully out of date.. |
[production] |
| 19:13 |
<notpeter> |
restarting ganglia on nickel |
[production] |
| 19:09 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: 12 more misc/wikimedia wikis to 1.20wmf3 |
[production] |
| 18:59 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All closed wikis to 1.20wmf3 |
[production] |
| 18:55 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All special wikis to 1.20wmf3 |
[production] |
| 18:54 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wikimedia wikis to 1.20wmf3 |
[production] |
| 18:52 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wikisource to 1.20wmf3 |
[production] |
| 18:50 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wikiquote to 1.20wmf3 |
[production] |
| 18:48 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wikiversity to 1.20wmf3 |
[production] |
| 18:45 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wiktibooks to 1.20wmf3 |
[production] |
| 18:42 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wiktionaries to 1.20wmf3 |
[production] |
| 18:40 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All wikinews to 1.20wmf3 |
[production] |
| 18:31 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: All non wikipedia en projects to 1.20wmf3 |
[production] |
| 18:27 |
<binasher> |
running recentchanges.rc_ip (ipv6) schema migration on s3 dbs via os������c (s4 already completed during prior testing) |
[production] |
| 18:25 |
<mutante> |
synced wikiversions.* files from NFS to spence local to prevent death of check_job_queue monitoring |
[production] |
| 18:21 |
<binasher> |
running recentchanges.rc_ip (ipv6) schema migration on s5 dbs via os������c |
[production] |
| 18:19 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: commonswiki to 1.20wmf3, again |
[production] |
| 18:17 |
<aaron> |
synchronized php-1.20wmf3/includes/ImagePage.php 'deployed 86e2372772e618c5d1238ae480d9f632789bbe50' |
[production] |
| 18:13 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: commonswiki back to 1.20wmf2 |
[production] |
| 18:10 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: commonswiki to 1.20wmf3 |
[production] |
| 18:10 |
<binasher> |
running recentchanges.rc_ip (ipv6) schema migration on all s6 dbs via os������c |
[production] |
| 18:03 |
<binasher> |
running recentchanges.rc_ip (ipv6) schema migration on all s7 dbs via os������c |
[production] |
| 17:43 |
<binasher> |
ipblocks migration completed for all wikis |
[production] |
| 17:38 |
<binasher> |
running ipblocks schema migration on all s2 dbs via os������c |
[production] |
| 17:35 |
<awjrichards> |
synchronized php-1.20wmf2/extensions/MobileFrontend 'Picking up fix for fatal in api in MobileFrontend at 9936e7a' |
[production] |
| 17:34 |
<awjrichards> |
synchronized php-1.20wmf3/extensions/MobileFrontend 'Picking up fix for fatal in api in MobileFrontend at 9936e7a' |
[production] |
| 17:17 |
<maplebed> |
deploying change to swift to make which containers write thumbs configurable |
[production] |
| 17:11 |
<preilly> |
synchronized php-1.20wmf3/extensions/MobileFrontend/ 'zero and mobile changes' |
[production] |
| 17:10 |
<preilly> |
synchronized php-1.20wmf2/extensions/MobileFrontend/ 'zero and mobile changes' |
[production] |
| 17:08 |
<RobH> |
aluminum back online |
[production] |
| 17:00 |
<binasher> |
running ipblocks schema migration on all s3 (819) dbs via os������c |
[production] |
| 16:59 |
<binasher> |
running ipblocks schema migration on all s4 dbs via os������c |
[production] |
| 16:58 |
<binasher> |
running ipblocks schema migration on s5/dewiki via osc |
[production] |
| 16:57 |
<RobH> |
aluminum shut down for hard disk additions |
[production] |
| 16:56 |
<binasher> |
running ipblocks schema migration on all s6 dbs via osc |
[production] |
| 16:51 |
<RobH> |
udpating dns for osm web servers |
[production] |
| 16:50 |
<binasher> |
running ipblocks schema migration on all s7 dbs via osc |
[production] |
| 16:49 |
<preilly> |
synchronized php-1.20wmf2/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing' |
[production] |
| 16:41 |
<aaron> |
synchronized php-1.20wmf3/includes/filerepo/backend/SwiftFileBackend.php 'deployed 634c3be2bba6a46e28aa997d7ab388ebf90b36a6' |
[production] |
| 16:31 |
<maplebed> |
clearing the mobile varnish cache |
[production] |
| 16:29 |
<maplebed> |
deploying gerrit change 7798 to the mobile varnish servers |
[production] |
| 07:41 |
<raindrift> |
synchronized php-1.20wmf3/extensions/PageTriage/api/ApiPageTriageTemplate.php 'fixing exception bug that makes lots of logspam' |
[production] |
| 07:41 |
<raindrift> |
synchronized php-1.20wmf2/extensions/PageTriage/api/ApiPageTriageTemplate.php 'fixing exception bug that makes lots of logspam' |
[production] |
| 06:20 |
<Ryan_Lane> |
restarted lucene on search1015 |
[production] |
| 05:58 |
<Tim> |
setting net.ipv4.tcp_tw_recycle=1 on cp1005 seems to have fixed it, doing it on cp1004 as well now |
[production] |
| 05:52 |
<Tim> |
on cp1005 setting tcp_tw_recycle=1 |
[production] |
| 05:29 |
<Tim> |
experimentally started squid on cp1004 |
[production] |
| 04:05 |
<hashar> |
updating a few plugins on Jenkins (host: gallium ) |
[production] |
| 03:34 |
<Ryan_Lane> |
stopped the squid process on cp1004 and stopped puppet to avoid it being restarted. it's having issues and I can't debug it right now. |
[production] |
| 03:22 |
<Ryan_Lane> |
repooling squid frontend on cp1004 |
[production] |