|
2016-05-03
§
|
| 01:54 |
<RoanKattouw> |
Killed ssh processes on tin that had been hanging for days |
[production] |
| 01:53 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.21) (duration: 23019m 56s) |
[production] |
| 01:53 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.21) (duration: 12941m 41s) |
[production] |
| 01:53 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.22) (duration: 4303m 19s) |
[production] |
| 01:40 |
<mutante> |
irc.wm.org - see T123729 if any questions |
[production] |
| 01:39 |
<mutante> |
switching irc.wikimedia.org from old server argon to new server kraz. old server still running untouched as argon.wikimedia.org. no clients are kicked. appservers are sending RC to both. |
[production] |
| 00:50 |
<krenair@tin> |
Synchronized wmf-config/interwiki.php: https://gerrit.wikimedia.org/r/286552 - interwiki cache update including jamwiki, horizon, and other things (duration: 00m 26s) |
[production] |
| 00:41 |
<krenair@tin> |
Synchronized langlist: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:40 |
<krenair@tin> |
Synchronized static/images/project-logos: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:39 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) |
[production] |
| 00:38 |
<krenair@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: create jamwiki - https://gerrit.wikimedia.org/r/286258 |
[production] |
| 00:36 |
<krenair@tin> |
Synchronized dblists: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 27s) |
[production] |
| 00:12 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286534/ (duration: 00m 30s) |
[production] |
|
2016-05-02
§
|
| 23:58 |
<krenair@tin> |
Finished scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes (duration: 25m 57s) |
[production] |
| 23:37 |
<ebernhardson> |
restart elastic2007, codfw cluster master, to resolve lingering issues after resolving frozen index race condition |
[production] |
| 23:32 |
<krenair@tin> |
Started scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes |
[production] |
| 23:30 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Echo: https://gerrit.wikimedia.org/r/#/c/286535/ and https://gerrit.wikimedia.org/r/#/c/286532/ (duration: 00m 30s) |
[production] |
| 23:10 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Flow/modules/flow/ui/widgets/editor/mw.flow.ui.EditorSwitcherWidget.js: https://gerrit.wikimedia.org/r/#/c/286527/ (duration: 00m 26s) |
[production] |
| 22:56 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.22/extensions/CirrusSearch/: Cirrus: Stop auto-creating frozen index (duration: 00m 31s) |
[production] |
| 22:56 |
<awight> |
CentralNotice fundraising campaigns disabled for CiviCRM outage |
[production] |
| 22:52 |
<ebernhardson@tin> |
Synchronized wmf-config/CirrusSearch-production.php: Config setting to stop auto-creating frozen index in cirrus (duration: 00m 33s) |
[production] |
| 22:18 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/286537/ (duration: 00m 42s) |
[production] |
| 22:13 |
<cwd> |
updated crm from b386a6821c71310950ccdcdcf2616add727e1af4 to f5e8f98d07a2280118b7153bc342bf52ee67edd5 |
[production] |
| 22:10 |
<papaul> |
restbase200[7-9]- signing puppet certs, salt-key, initial run |
[production] |
| 21:26 |
<cscott> |
updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 |
[production] |
| 21:21 |
<cscott> |
starting OCG deploy (a little late) |
[production] |
| 20:23 |
<gehel> |
restarting elasticsearch server elastic2001.codfw.wmnet (T110236) |
[production] |
| 20:21 |
<gehel> |
starting rolling restart of elasticsearch codfw cluster to disable multicast (T110236) |
[production] |
| 20:15 |
<subbu> |
finished deploying parsoid version 0a26f3a4 |
[production] |
| 20:09 |
<subbu> |
synced code + restarted parsoid on wtp1001 as canary |
[production] |
| 20:05 |
<subbu> |
starting deploy of parsoid version 0a26f3a4 |
[production] |
| 19:27 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.22/includes/filebackend/FileBackendMultiWrite.php: 63b2d7b2eae (duration: 00m 32s) |
[production] |
| 19:17 |
<mutante> |
manually removing 2fa from my own wikitech account, adding it back .. |
[production] |
| 18:24 |
<gehel> |
deploying latest WDQS version |
[production] |
| 17:23 |
<robh> |
restbase2004 offline for next few hours for comparison work for new systems T132976 |
[production] |
| 16:01 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286286/ (duration: 00m 26s) |
[production] |
| 15:53 |
<krenair@tin> |
Synchronized wikiversions-labs.json: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 25s) |
[production] |
| 15:53 |
<krenair@tin> |
Synchronized dblists/all-labs.dblist: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 26s) |
[production] |
| 15:44 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286287/ (duration: 00m 25s) |
[production] |
| 15:40 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286285/ (duration: 00m 25s) |
[production] |
| 15:32 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/286434/2 (duration: 02m 02s) |
[production] |
| 15:28 |
<bblack> |
re-pooling esams |
[production] |
| 15:22 |
<jynus> |
restarting db1040 for reimage |
[production] |
| 15:21 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.22/extensions/Math/MathRestbaseInterface.php: https://gerrit.wikimedia.org/r/#/c/286412/ (duration: 00m 26s) |
[production] |
| 15:07 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/285700/ (duration: 00m 42s) |
[production] |
| 14:52 |
<moritzm> |
rolling restart of zookeeper to pick up Java update |
[production] |
| 14:22 |
<bblack> |
starting gdnsd on esams (esams is marked down there) |
[production] |
| 14:20 |
<bblack> |
stopped gdnsd on eeden |
[production] |
| 13:13 |
<jynus> |
stopping db1040 mysql for backup before cloning |
[production] |
| 12:15 |
<elukey> |
deployed Varnish change to force HTTP 503 for datasets.wikimedia.org, stats.wikimedia.org, metrics.wikimedia.org as prep-step for OS reimage. |
[production] |