2020-01-07
§
|
07:42 |
<elukey> |
restart Hue after applying a new kerberos setting (hue_principal, was not specified before) |
[analytics] |
07:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool es1019', diff saved to https://phabricator.wikimedia.org/P10055 and previous config saved to /var/cache/conftool/dbconfig/20200107-074159-marostegui.json |
[production] |
07:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool es1019 for upgrade', diff saved to https://phabricator.wikimedia.org/P10054 and previous config saved to /var/cache/conftool/dbconfig/20200107-074035-marostegui.json |
[production] |
07:39 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool es1013', diff saved to https://phabricator.wikimedia.org/P10053 and previous config saved to /var/cache/conftool/dbconfig/20200107-073922-marostegui.json |
[production] |
07:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool es1013 for upgrade', diff saved to https://phabricator.wikimedia.org/P10052 and previous config saved to /var/cache/conftool/dbconfig/20200107-073543-marostegui.json |
[production] |
07:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool es1018', diff saved to https://phabricator.wikimedia.org/P10051 and previous config saved to /var/cache/conftool/dbconfig/20200107-073508-marostegui.json |
[production] |
07:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool es1018 for upgrade', diff saved to https://phabricator.wikimedia.org/P10050 and previous config saved to /var/cache/conftool/dbconfig/20200107-072930-marostegui.json |
[production] |
07:15 |
<marostegui> |
Remove partitions from s5: db2084:3315 T239453 |
[production] |
07:12 |
<marostegui> |
Remove partitions from revision table on s6: db1098 T239453 |
[production] |
07:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1098:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10049 and previous config saved to /var/cache/conftool/dbconfig/20200107-070850-marostegui.json |
[production] |
07:05 |
<marostegui> |
Depool labsdb1011 |
[production] |
07:03 |
<marostegui> |
Deploy schema change on s8 codfw (this will generate lag on s8 codfw) - T234052 |
[production] |
06:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db2089:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10048 and previous config saved to /var/cache/conftool/dbconfig/20200107-064846-marostegui.json |
[production] |
05:28 |
<bd808> |
Creating tools-k8s-worker-[6-14] (again) |
[tools] |
05:20 |
<bd808> |
Deleting busted tools-k8s-worker-[6-14] |
[tools] |
05:02 |
<bd808> |
Creating tools-k8s-worker-[6-14] |
[tools] |
01:20 |
<Krenair> |
Restarted webservice https://en.wikipedia.org/wiki/User_talk:Krenair#Citation_bot |
[tools.citations] |
01:17 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
01:15 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (sync again) (duration: 00m 53s) |
[production] |
01:14 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (duration: 00m 54s) |
[production] |
01:12 |
<mutante> |
ganeti - creating urldownloader2002.wikimedia.org in codfw_B with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
01:12 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
01:09 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
01:04 |
<mutante> |
ganeti - creating urldownloader2001.wikimedia.org in codfw_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
01:04 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
01:03 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Revert: "cirrus: Shift more_like to codfw cirrus cluster" (duration: 00m 54s) |
[production] |
01:02 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
00:59 |
<mutante> |
ganeti - creating urldownloader1002.wikimedia.org in eqiad_C with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
00:58 |
<mutante> |
ganeti - creating urldownloader1001.wikimedia.org in eqiad_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
00:57 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
00:57 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/CirrusSearch-common.php: Revert "reduce query load on cirrus elastic clusters" (duration: 00m 54s) |
[production] |
00:57 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
00:56 |
<ebernhardson@deploy1001> |
sync-file aborted: Revery (duration: 00m 00s) |
[production] |
00:52 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
00:46 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 54s) |
[production] |
00:45 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 58s) |
[production] |
00:27 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562359|Enable Partial Blocks on every wiki excluding those that have opted-out (T218626)]] (duration: 00m 55s) |
[production] |
00:26 |
<bstorm_> |
repooled tools-sgewebgrid-lighttpd-0919 |
[tools] |
00:17 |
<bstorm_> |
repooled tools-sgewebgrid-lighttpd-0918 |
[tools] |
00:15 |
<bstorm_> |
moving tools-sgewebgrid-lighttpd-0918 and -0919 to cloudvirt1004 from cloudvirt1029 to rebalance load |
[tools] |
00:02 |
<bstorm_> |
depooled tools-sgewebgrid-lighttpd-0918 and 0919 to move to cloudvirt1004 to improve spread |
[tools] |