|
2016-05-02
ยง
|
| 21:26 |
<hashar> |
Nodepool is acting just fine: Demand from gearman: ci-trusty-wikimedia: 457 | <AllocationRequest for 455.0 of ci-trusty-wikimedia> |
[releng] |
| 21:25 |
<hashar> |
restarted qa-morebots "2016-05-02 21:22:23,599 ERROR: Died in main event loop" |
[releng] |
| 21:23 |
<hashar> |
gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log |
[releng] |
| 21:21 |
<cscott> |
starting OCG deploy (a little late) |
[production] |
| 21:20 |
<hashar> |
gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log |
[releng] |
| 21:19 |
<cscott> |
updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 |
[releng] |
| 21:18 |
<mforns> |
deployed browser-reports to unbreak production |
[analytics] |
| 20:23 |
<gehel> |
restarting elasticsearch server elastic2001.codfw.wmnet (T110236) |
[production] |
| 20:21 |
<gehel> |
starting rolling restart of elasticsearch codfw cluster to disable multicast (T110236) |
[production] |
| 20:15 |
<subbu> |
finished deploying parsoid version 0a26f3a4 |
[production] |
| 20:14 |
<hashar> |
MediaWiki phpunit jobs to run on Nodepool instances \O/ |
[releng] |
| 20:09 |
<subbu> |
synced code + restarted parsoid on wtp1001 as canary |
[production] |
| 20:05 |
<subbu> |
starting deploy of parsoid version 0a26f3a4 |
[production] |
| 19:27 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.22/includes/filebackend/FileBackendMultiWrite.php: 63b2d7b2eae (duration: 00m 32s) |
[production] |
| 19:17 |
<mutante> |
manually removing 2fa from my own wikitech account, adding it back .. |
[production] |
| 18:30 |
<joal> |
manually touch _SUCCESS file in hdfs://analytics-hadoop/wmf/data/raw/webrequest/webrequest_text/hourly/2016/05/02/14/ to launch refine process despites load job failure |
[analytics] |
| 18:24 |
<gehel> |
deploying latest WDQS version |
[production] |
| 17:38 |
<elukey> |
removed out of service banner from dashiki dashboards |
[analytics] |
| 17:33 |
<elukey> |
reverted Varnish config to return 503s for datasets and stats |
[analytics] |
| 17:23 |
<robh> |
restbase2004 offline for next few hours for comparison work for new systems T132976 |
[production] |
| 16:41 |
<urandom> |
Forcing puppet run and restarting Cassandra on deployment-restbase0[1-2] : T126629 |
[releng] |
| 16:40 |
<urandom> |
Cherry-picking https://gerrit.wikimedia.org/r/operations/puppet refs/changes/78/284078/12 to deployment-puppetmaster : T126629 |
[releng] |
| 16:24 |
<urandom> |
Restarat Cassandra on deployment-restbase0[1-2] : T126629 |
[releng] |
| 16:21 |
<urandom> |
forcing puppet run on deployment-restbase0[1-2] : T126629 |
[releng] |
| 16:20 |
<urandom> |
cherry-picking latest refs/changes/78/284078/11 onto deployment-puppetmaster : T126629 |
[releng] |
| 16:01 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286286/ (duration: 00m 26s) |
[production] |
| 15:53 |
<krenair@tin> |
Synchronized wikiversions-labs.json: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 25s) |
[production] |
| 15:53 |
<krenair@tin> |
Synchronized dblists/all-labs.dblist: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 26s) |
[production] |
| 15:44 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286287/ (duration: 00m 25s) |
[production] |
| 15:40 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286285/ (duration: 00m 25s) |
[production] |
| 15:32 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/286434/2 (duration: 02m 02s) |
[production] |
| 15:28 |
<bblack> |
re-pooling esams |
[production] |
| 15:22 |
<jynus> |
restarting db1040 for reimage |
[production] |
| 15:21 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Math/MathRestbaseInterface.php: https://gerrit.wikimedia.org/r/#/c/286412/ (duration: 00m 26s) |
[production] |
| 15:07 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/285700/ (duration: 00m 42s) |
[production] |
| 14:52 |
<moritzm> |
rolling restart of zookeeper to pick up Java update |
[production] |
| 14:22 |
<bblack> |
starting gdnsd on esams (esams is marked down there) |
[production] |
| 14:20 |
<bblack> |
stopped gdnsd on eeden |
[production] |
| 13:13 |
<jynus> |
stopping db1040 mysql for backup before cloning |
[production] |
| 12:15 |
<elukey> |
deployed Varnish change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
| 12:14 |
<elukey> |
deployed Varnish change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[analytics] |
| 12:13 |
<elukey> |
deployed Varnish cache::misc change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
| 12:12 |
<elukey> |
Merged Varnish cache::misc change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |
| 12:05 |
<elukey> |
enabled maintenance banner to dashiki based dashboards via https://meta.wikimedia.org/wiki/Dashiki:OutOfService |
[analytics] |
| 11:21 |
<elukey> |
deployed the last version of Event Logging from tin. Service also restarted. |
[production] |
| 11:21 |
<elukey> |
deployed last version of Event Logging. Service also restarted. |
[analytics] |
| 11:06 |
<moritzm> |
rolling restart of hhvm in eqiad for pcre security update |
[production] |
| 10:42 |
<moritzm> |
rolling restart of hhvm in codfw for pcre security update |
[production] |
| 09:58 |
<moritzm> |
uploaded openldap 2.4.41+wmf1 for jessie-wikimedia to carbon (T130593) |
[production] |
| 09:54 |
<gehel> |
restart elasticsearch cluster to ensure multicast configuration is disabled (T110236) |
[deployment-prep] |