|
2020-11-12
§
|
| 11:35 |
<mvolz@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . |
[production] |
| 11:30 |
<mvolz@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . |
[production] |
| 11:12 |
<mvolz@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 11:08 |
<mvolz@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 11:02 |
<mvolz@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . |
[production] |
| 09:19 |
<hashar@deploy1001> |
Synchronized php-1.36.0-wmf.16/includes/filerepo: Revert "filerepo: clean up shared cache keys to avoid key metrics clutter" - T267668 (duration: 01m 01s) |
[production] |
| 09:12 |
<hashar> |
Pulled https://gerrit.wikimedia.org/r/640746 on deployment server for # T267668 |
[production] |
| 04:04 |
<Krinkle> |
cleaned up and unlocked |
[production] |
| 03:53 |
<Krinkle> |
krinkle@deploy1001 I've locked scap deployments. See https://phabricator.wikimedia.org/T267668#6619762 |
[production] |
| 03:46 |
<ejegg> |
updated python fundraising tools from 7853f426ee to 68e054c9ad |
[production] |
|
2020-11-11
§
|
| 16:44 |
<XioNoX> |
Revert "temporarily route Italy to codfw" |
[production] |
| 16:38 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 16:38 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 16:30 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 16:30 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 15:52 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 15:52 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 14:29 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: name=cp3054.esams.wmnet |
[production] |
| 13:52 |
<akosiaris@cumin1001> |
conftool action : set/pooled=no; selector: name=cp3054.esams.wmnet |
[production] |
| 12:25 |
<Lucas_WMDE> |
EU backport&config window done |
[production] |
| 12:23 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/Wikibase.php: Config: [[gerrit:640676|Remove propagateChangeVisibility repo setting]] (duration: 00m 58s) |
[production] |
| 12:16 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:636453|Enable propagatePageDeletion on Wikidata]] (duration: 00m 59s) |
[production] |
| 12:11 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized php-1.36.0-wmf.16/extensions/DiscussionTools/includes/CommentParser.php: Backport: [[gerrit:640497|Fix getHeadlineNodeAndOffset() returning text nodes (T267284)]] (duration: 01m 01s) |
[production] |
| 10:34 |
<XioNoX> |
delete unused interfaces from asw-d-codfw |
[production] |
| 09:53 |
<XioNoX> |
prioritized DE-CIX IXP - T262681 |
[production] |
| 02:18 |
<ryankemper> |
(WDQS deploy completed) |
[production] |
| 00:48 |
<ryankemper> |
Restarting `wdqs-categories` one host at a time across all wdqs production instances: `sudo -E cumin -b 1 'A:wdqs-all and not A:wdqs-test' 'depool && sleep 60 && systemctl restart wdqs-categories && sleep 30 && pool'` |
[production] |
| 00:47 |
<ryankemper> |
Restarted `wdqs-categories` across wdqs test hosts: `sudo -E cumin 'A:wdqs-test' 'systemctl restart wdqs-categories'` |
[production] |
| 00:47 |
<ryankemper> |
Restarted `wdqs-updater` simultaneously across all wdqs hosts: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` |
[production] |
| 00:47 |
<ryankemper> |
[wdqs deploy] following deploy, example query succeeds on `query.wikidata.org`, proceeding to post deploy steps |
[production] |
| 00:46 |
<ryankemper@deploy1001> |
Finished deploy [wdqs/wdqs@03219df]: 0.3.55 (duration: 11m 24s) |
[production] |
| 00:46 |
<ryankemper> |
T222669 [Elasticsearch reindex] Began long-running reindex of cirrus elasticsearch for `codfw`, `eqiad`, and `cloudelastic`. 3 tmux sessions on `ryankemper@mwmaint1002`: `reindex_eqiad`, `reindex_codfw`, `reindex_cloudelastic` |
[production] |
| 00:38 |
<ryankemper> |
Following deploy to canary `wdqs1003`, automated tests are passing as is a manual test of an example query. Proceeding... |
[production] |
| 00:34 |
<ryankemper@deploy1001> |
Started deploy [wdqs/wdqs@03219df]: 0.3.55 |
[production] |
| 00:32 |
<ryankemper> |
About to begin wdqs deploy; before-deploy tests on canary `wdqs1003` are passing |
[production] |
| 00:09 |
<eileen> |
civicrm revision changed from d0cd7f6dbb to e5d12cc46c, config revision is e2d133eff4 |
[production] |
|
2020-11-10
§
|
| 22:14 |
<mholloway-shell@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . |
[production] |
| 22:14 |
<mholloway-shell@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 22:08 |
<mholloway-shell@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . |
[production] |
| 22:08 |
<mholloway-shell@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 22:05 |
<mholloway-shell@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 21:59 |
<mholloway-shell@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 21:58 |
<jgleeson> |
update civicrm revision changed from c36a5cc1b1 to d0cd7f6dbb |
[production] |
| 21:57 |
<mholloway-shell@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 21:55 |
<mholloway-shell@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 21:47 |
<ebernhardson> |
unban elastic1050 from eqiad search psi cluster |
[production] |
| 21:28 |
<cstone> |
civicrm revision changed from b1342c4129 to c36a5cc1b1 |
[production] |
| 21:24 |
<brennen@deploy1001> |
sync-file aborted: Testing: README.md sync-file with ssh -n for T223287 (duration: 00m 37s) |
[production] |
| 21:23 |
<brennen> |
testing some scap operations, modified to use ssh -n for debugging T223287 |
[production] |
| 21:11 |
<ebernhardson> |
ban elastic1050 from eqiad psi cluster due to excessive load |
[production] |