|
2017-09-26
ยง
|
| 13:00 |
<elukey> |
add mw132[7,8] to live traffic (new appservers) - weights will be increased incrementally from 5 to 20 |
[production] |
| 12:45 |
<addshore> |
Reloading Zuul to deploy - Low prio queue for libraryupdater [integration/config] - https://gerrit.wikimedia.org/r/380307 |
[releng] |
| 12:44 |
<gehel> |
restarting blazegraph on wdqs1004 / wdqs2001 for heap resive - T175919 |
[production] |
| 12:28 |
<addshore> |
fab docker_pull_image:wmfreleng/lintr:v2017.09.26.12.04 |
[releng] |
| 12:27 |
<marostegui> |
Drop redundant indexes from s2 - T174509 |
[production] |
| 12:26 |
<addshore> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/379818 |
[releng] |
| 12:12 |
<marostegui> |
Drop redundant indexes from enwiki on eqiad - T174509 |
[production] |
| 12:06 |
<addshore> |
docker push docker.io/wmfreleng/ & latest (PS6 of https://gerrit.wikimedia.org/r/378831 ) |
[releng] |
| 12:03 |
<kartik@tin> |
Finished deploy [cxserver/deploy@aa232ee]: Update cxserver, registry reconstruction (duration: 03m 03s) |
[production] |
| 12:00 |
<kartik@tin> |
Started deploy [cxserver/deploy@aa232ee]: Update cxserver, registry reconstruction |
[production] |
| 11:58 |
<moritzm> |
uploaded prometheus-apache-exporter 0.3-1+deb9u1 to apt.wikimedia.org/stretch-wikimedia |
[production] |
| 11:56 |
<marostegui> |
Drop redundant indexes from enwiki on codfw - T174509 |
[production] |
| 11:49 |
<moritzm> |
uploaded prometheus-hhvm-exporter 0.3.1+deb9u1 to apt.wikimedia.org/stretch-wikimedia |
[production] |
| 11:30 |
<kartik@tin> |
(no justification provided) |
[production] |
| 11:29 |
<kartik@tin> |
Finished deploy [cxserver/deploy@f1d4851]: Update cxserver, registry reconstruction (duration: 00m 52s) |
[production] |
| 11:28 |
<kartik@tin> |
Started deploy [cxserver/deploy@f1d4851]: Update cxserver, registry reconstruction |
[production] |
| 11:12 |
<JeanFred> |
Deploy latest from Git master: 2828a0f (T117327) |
[tools.heritage] |
| 11:01 |
<joal> |
Restart mediawiki-history-denormalize and mediawiki-history-druid jobs after deploy |
[analytics] |
| 10:58 |
<joal> |
Restart webrequest load job after deploy |
[analytics] |
| 10:52 |
<volans> |
uploaded cumin_1.1.1-1_amd64.deb to apt.wikimedia.org jessie-wikimedia |
[production] |
| 10:35 |
<joal> |
Deploying refinery onto HDFS |
[analytics] |
| 10:34 |
<joal@tin> |
Finished deploy [analytics/refinery@5d806c6]: Regular analytics deploy (duration: 08m 00s) |
[production] |
| 10:26 |
<joal@tin> |
Started deploy [analytics/refinery@5d806c6]: Regular analytics deploy |
[production] |
| 10:25 |
<joal> |
Deploy Refinery with scap |
[analytics] |
| 10:20 |
<_joe_> |
rebooting copper (again) |
[production] |
| 09:52 |
<JeanFred> |
Deploy latest from Git master: 263ccee (T174556) |
[tools.heritage] |
| 09:33 |
<joal> |
Releasing refinery-source v0.0.53 with Jenskins |
[analytics] |
| 09:12 |
<elukey> |
add mw132[4,5,6] to live traffic (new appservers) - weights will be increased incrementally from 5 to 20 |
[production] |
| 09:10 |
<_joe_> |
rebooting copper to verify docker setup is correct |
[production] |
| 08:46 |
<moritzm> |
installing apache updates on mw* app servers |
[production] |
| 08:44 |
<godog> |
run puppet on ms-fe* to reduce conntrack generated by swift internal clients towards backends - T173731 |
[production] |
| 08:24 |
<godog> |
roll-restart thumbor to upgrade to 1.5 - T173804 |
[production] |
| 08:09 |
<godog> |
roll-restart swift-proxy to apply https://gerrit.wikimedia.org/r/#/c/380483/ - T161535 |
[production] |
| 08:08 |
<marostegui> |
Drop old temporary tar.gz files from dbstore1001 to get back some disk space |
[production] |
| 08:07 |
<marostegui> |
Drop table trackbacks from s3 - T175051 |
[production] |
| 07:48 |
<mattflaschen@tin> |
Synchronized wmf-config/CommonSettings-labs.php: RCFilters: Beta Cluster only (duration: 00m 46s) |
[production] |
| 07:46 |
<marostegui> |
Drop trackbacks table from s7 - T175051 |
[production] |
| 07:28 |
<marostegui> |
Drop trackbacks table from s6 - T175051 |
[production] |
| 07:16 |
<moritzm> |
installing perl security updates |
[production] |
| 06:45 |
<_joe_> |
restarting varnish backend on cp3033, throwing 503s |
[production] |
| 06:29 |
<mobrovac@tin> |
Finished deploy [cpjobqueue/deploy@17c3833]: (no justification provided) (duration: 00m 28s) |
[production] |
| 06:28 |
<mobrovac@tin> |
Started deploy [cpjobqueue/deploy@17c3833]: (no justification provided) |
[production] |
| 06:18 |
<marostegui> |
Drop table trackbacks from s4 - T175051 |
[production] |
| 06:06 |
<marostegui> |
Drop table trackbacks from s5 (only exists on dewiki) - T175051 |
[production] |
| 05:48 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2047 - T176573 (duration: 00m 44s) |
[production] |
| 05:15 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove old db1055 comments (duration: 00m 46s) |
[production] |
| 04:08 |
<zhuyifei1999_> |
Restarting service 'uwsgi-quarry-web' on quarry-main-01, 'celery-quarry-worker' on quarry-runner-01 & quarry-runner-02 T176694 |
[quarry] |
| 03:59 |
<zhuyifei1999_> |
Switching REPLICA_HOST from 'enwiki.labsdb' to 'enwiki.analytics.db.svc.eqiad.wmflabs' T176694 (Executing `sudo -- sudo -u quarry sed -i 's/enwiki.labsdb/enwiki.analytics.db.svc.eqiad.wmflabs/' /srv/quarry/quarry/config.yaml` on all hosts) |
[quarry] |
| 02:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Sep 26 02:29:31 UTC 2017 (duration 5m 52s) |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.19) (duration: 07m 26s) |
[production] |