|
2020-04-06
ยง
|
| 17:39 |
<arturo> |
[codfw1dev] `openstack zone create --email root@wmflabs.org --type PRIMARY --ttl 3600 --description "floating IPs subnet" 57.15.185.in-addr.arpa.` (T247972) |
[admin] |
| 17:05 |
<bstorm_> |
running 'kubectl delete pods refill-api-6c78d8cdd-49krm' |
[tools.refill-api] |
| 16:54 |
<elukey@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 16:52 |
<_joe_> |
parsoid migrated to use envoy for TLS termination |
[production] |
| 16:38 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/586394 |
[releng] |
| 16:24 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/586388 |
[releng] |
| 16:24 |
<_joe_> |
switching parsoid-php to envoy for TLS termination |
[production] |
| 16:23 |
<arturo> |
restarting apache2 in cloudcontrol1003/1004 to pick up latest wmfkeystonehooks changes T249494 |
[admin] |
| 16:13 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/586387 |
[releng] |
| 15:45 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: MachineVision: Label blacklist updates (T249285) (duration: 00m 58s) |
[production] |
| 15:36 |
<hnowlan@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . |
[production] |
| 15:04 |
<elukey@cumin1001> |
END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) |
[production] |
| 14:59 |
<addshore> |
deploy slot done |
[production] |
| 14:55 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Test commons: Define entity sources configuration T248664 (cache bust) (duration: 00m 57s) |
[production] |
| 14:54 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Test commons: Define entity sources configuration T248664 (duration: 00m 57s) |
[production] |
| 14:50 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase, entity source, use modern repoDatabase and interwikiPrefix T248664 (cache bust) (duration: 00m 57s) |
[production] |
| 14:49 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase, entity source, use modern repoDatabase and interwikiPrefix T248664 (duration: 00m 58s) |
[production] |
| 14:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10912 and previous config saved to /var/cache/conftool/dbconfig/20200406-144220-marostegui.json |
[production] |
| 14:41 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase client entity source config T248664 (cache bust) (duration: 00m 58s) |
[production] |
| 14:40 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase client entity source config T248664 (duration: 00m 59s) |
[production] |
| 14:37 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10911 and previous config saved to /var/cache/conftool/dbconfig/20200406-143755-marostegui.json |
[production] |
| 14:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10910 and previous config saved to /var/cache/conftool/dbconfig/20200406-143042-marostegui.json |
[production] |
| 14:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1118 after schema change', diff saved to https://phabricator.wikimedia.org/P10909 and previous config saved to /var/cache/conftool/dbconfig/20200406-142607-marostegui.json |
[production] |
| 14:24 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (cachebust) (duration: 00m 58s) |
[production] |
| 14:23 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: TEST: Wikibase entity source config for testwikidatawiki T248664 (duration: 00m 59s) |
[production] |
| 14:09 |
<elukey@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 14:07 |
<elukey@cumin1001> |
END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) |
[production] |
| 14:07 |
<elukey@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 13:47 |
<sukhe> |
upload cescout 0.1.1-1 to apt.wm.o (buster) - T247273 |
[production] |
| 13:26 |
<elukey> |
reboot stat1008 as test to verify ROCm 3.3 upgrades |
[production] |
| 13:23 |
<elukey> |
upgraded stat1008 to AMD ROCm 3.3 (enables tensorflow 2.x) |
[analytics] |
| 13:22 |
<elukey> |
stat1008 upgraded to ROCm 3.3 (enables Tensorflow 2.x) |
[production] |
| 13:05 |
<ema> |
cache: upgrade varnish to 5.1.3-1wm13, begin rolling varnish-fe restarts T249344 |
[production] |
| 13:03 |
<marostegui> |
Deploy schema change on db1118 |
[production] |
| 13:03 |
<jbond42> |
updating gnutls on buster |
[production] |
| 13:03 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1118 for schema change', diff saved to https://phabricator.wikimedia.org/P10906 and previous config saved to /var/cache/conftool/dbconfig/20200406-130320-marostegui.json |
[production] |
| 13:02 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1107 after schema change', diff saved to https://phabricator.wikimedia.org/P10905 and previous config saved to /var/cache/conftool/dbconfig/20200406-130255-marostegui.json |
[production] |
| 12:59 |
<Urbanecm> |
Creation of grwikimedia is done (T245911) |
[production] |
| 12:59 |
<urbanecm@deploy1001> |
Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 22s) |
[production] |
| 12:55 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) |
[production] |
| 12:54 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: 77b9ae9: Create grwikimedia (duration: 00m 58s) |
[production] |
| 12:53 |
<marostegui> |
Deploy schema change on db1107 |
[production] |
| 12:53 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1107 for schema change', diff saved to https://phabricator.wikimedia.org/P10904 and previous config saved to /var/cache/conftool/dbconfig/20200406-125308-marostegui.json |
[production] |
| 12:52 |
<urbanecm@deploy1001> |
Synchronized multiversion/MWMultiVersion.php: 77b9ae9: Create grwikimedia (duration: 00m 58s) |
[production] |
| 12:52 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P10903 and previous config saved to /var/cache/conftool/dbconfig/20200406-125222-marostegui.json |
[production] |
| 12:46 |
<urbanecm@deploy1001> |
rebuilt and synchronized wikiversions files: 77b9ae9: Create grwikimedia |
[production] |
| 12:44 |
<urbanecm@deploy1001> |
Synchronized dblists/: 77b9ae9: Create grwikimedia (duration: 00m 59s) |
[production] |
| 12:37 |
<XioNoX> |
Update eqiad analytics filters with new APT IPs |
[production] |
| 12:33 |
<joal> |
Bump AQS druid backend to 2020-03 |
[analytics] |
| 12:27 |
<hnowlan@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . |
[production] |