|
2016-05-03
§
|
| 01:53 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.21) (duration: 12941m 41s) |
[production] |
| 01:53 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.22) (duration: 4303m 19s) |
[production] |
| 01:41 |
<Krenair> |
ran package updates on deployment-parsoid06 so that exim4 would start so puppet will run |
[deployment-prep] |
| 01:40 |
<mutante> |
irc.wm.org - see T123729 if any questions |
[production] |
| 01:39 |
<mutante> |
switching irc.wikimedia.org from old server argon to new server kraz. old server still running untouched as argon.wikimedia.org. no clients are kicked. appservers are sending RC to both. |
[production] |
| 00:50 |
<krenair@tin> |
Synchronized wmf-config/interwiki.php: https://gerrit.wikimedia.org/r/286552 - interwiki cache update including jamwiki, horizon, and other things (duration: 00m 26s) |
[production] |
| 00:41 |
<krenair@tin> |
Synchronized langlist: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:40 |
<krenair@tin> |
Synchronized static/images/project-logos: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:39 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:38 |
<krenair@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: create jamwiki - https://gerrit.wikimedia.org/r/286258 |
[production] |
| 00:36 |
<krenair@tin> |
Synchronized dblists: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 27s) |
[production] |
| 00:12 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286534/ (duration: 00m 30s) |
[production] |
|
2016-05-02
§
|
| 23:58 |
<krenair@tin> |
Finished scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes (duration: 25m 57s) |
[production] |
| 23:37 |
<ebernhardson> |
restart elastic2007, codfw cluster master, to resolve lingering issues after resolving frozen index race condition |
[production] |
| 23:32 |
<krenair@tin> |
Started scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes |
[production] |
| 23:30 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Echo: https://gerrit.wikimedia.org/r/#/c/286535/ and https://gerrit.wikimedia.org/r/#/c/286532/ (duration: 00m 30s) |
[production] |
| 23:10 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Flow/modules/flow/ui/widgets/editor/mw.flow.ui.EditorSwitcherWidget.js: https://gerrit.wikimedia.org/r/#/c/286527/ (duration: 00m 26s) |
[production] |
| 22:56 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.22/extensions/CirrusSearch/: Cirrus: Stop auto-creating frozen index (duration: 00m 31s) |
[production] |
| 22:56 |
<awight> |
CentralNotice fundraising campaigns disabled for CiviCRM outage |
[production] |
| 22:52 |
<ebernhardson@tin> |
Synchronized wmf-config/CirrusSearch-production.php: Config setting to stop auto-creating frozen index in cirrus (duration: 00m 33s) |
[production] |
| 22:18 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/286537/ (duration: 00m 42s) |
[production] |
| 22:13 |
<cwd> |
updated crm from b386a6821c71310950ccdcdcf2616add727e1af4 to f5e8f98d07a2280118b7153bc342bf52ee67edd5 |
[production] |
| 22:10 |
<papaul> |
restbase200[7-9]- signing puppet certs, salt-key, initial run |
[production] |
| 21:59 |
<mforns> |
deployed vital-signs |
[analytics] |
| 21:59 |
<mforns> |
deployed edit-analysis |
[analytics] |
| 21:35 |
<mforns> |
deployed language-reportcard |
[analytics] |
| 21:27 |
<cscott> |
updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 |
[releng] |
| 21:26 |
<cscott> |
updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 |
[production] |
| 21:26 |
<hashar> |
Nodepool is acting just fine: Demand from gearman: ci-trusty-wikimedia: 457 | <AllocationRequest for 455.0 of ci-trusty-wikimedia> |
[releng] |
| 21:25 |
<hashar> |
restarted qa-morebots "2016-05-02 21:22:23,599 ERROR: Died in main event loop" |
[releng] |
| 21:23 |
<hashar> |
gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log |
[releng] |
| 21:21 |
<cscott> |
starting OCG deploy (a little late) |
[production] |
| 21:20 |
<hashar> |
gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log |
[releng] |
| 21:19 |
<cscott> |
updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 |
[releng] |
| 21:18 |
<mforns> |
deployed browser-reports to unbreak production |
[analytics] |
| 20:23 |
<gehel> |
restarting elasticsearch server elastic2001.codfw.wmnet (T110236) |
[production] |
| 20:21 |
<gehel> |
starting rolling restart of elasticsearch codfw cluster to disable multicast (T110236) |
[production] |
| 20:15 |
<subbu> |
finished deploying parsoid version 0a26f3a4 |
[production] |
| 20:14 |
<hashar> |
MediaWiki phpunit jobs to run on Nodepool instances \O/ |
[releng] |
| 20:09 |
<subbu> |
synced code + restarted parsoid on wtp1001 as canary |
[production] |
| 20:05 |
<subbu> |
starting deploy of parsoid version 0a26f3a4 |
[production] |
| 19:27 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.22/includes/filebackend/FileBackendMultiWrite.php: 63b2d7b2eae (duration: 00m 32s) |
[production] |
| 19:17 |
<mutante> |
manually removing 2fa from my own wikitech account, adding it back .. |
[production] |
| 18:30 |
<joal> |
manually touch _SUCCESS file in hdfs://analytics-hadoop/wmf/data/raw/webrequest/webrequest_text/hourly/2016/05/02/14/ to launch refine process despites load job failure |
[analytics] |
| 18:24 |
<gehel> |
deploying latest WDQS version |
[production] |
| 17:38 |
<elukey> |
removed out of service banner from dashiki dashboards |
[analytics] |
| 17:33 |
<elukey> |
reverted Varnish config to return 503s for datasets and stats |
[analytics] |
| 17:23 |
<robh> |
restbase2004 offline for next few hours for comparison work for new systems T132976 |
[production] |
| 16:41 |
<urandom> |
Forcing puppet run and restarting Cassandra on deployment-restbase0[1-2] : T126629 |
[releng] |
| 16:40 |
<urandom> |
Cherry-picking https://gerrit.wikimedia.org/r/operations/puppet refs/changes/78/284078/12 to deployment-puppetmaster : T126629 |
[releng] |