|
2020-01-07
§
|
| 05:20 |
<bd808> |
Deleting busted tools-k8s-worker-[6-14] |
[tools] |
| 05:02 |
<bd808> |
Creating tools-k8s-worker-[6-14] |
[tools] |
| 01:20 |
<Krenair> |
Restarted webservice https://en.wikipedia.org/wiki/User_talk:Krenair#Citation_bot |
[tools.citations] |
| 01:17 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 01:15 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (sync again) (duration: 00m 53s) |
[production] |
| 01:14 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: InitialiseSettings - clean up groupOverrides layout / spacing (duration: 00m 54s) |
[production] |
| 01:12 |
<mutante> |
ganeti - creating urldownloader2002.wikimedia.org in codfw_B with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
| 01:12 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 01:09 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 01:04 |
<mutante> |
ganeti - creating urldownloader2001.wikimedia.org in codfw_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
| 01:04 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 01:03 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Revert: "cirrus: Shift more_like to codfw cirrus cluster" (duration: 00m 54s) |
[production] |
| 01:02 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 00:59 |
<mutante> |
ganeti - creating urldownloader1002.wikimedia.org in eqiad_C with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
| 00:58 |
<mutante> |
ganeti - creating urldownloader1001.wikimedia.org in eqiad_A with 1 CPU, 1 GB RAM, 10 GB disk, public IP (T241979) |
[production] |
| 00:57 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 00:57 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/CirrusSearch-common.php: Revert "reduce query load on cirrus elastic clusters" (duration: 00m 54s) |
[production] |
| 00:57 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 00:56 |
<ebernhardson@deploy1001> |
sync-file aborted: Revery (duration: 00m 00s) |
[production] |
| 00:52 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 00:46 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 54s) |
[production] |
| 00:45 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:561927|GrowthExperiments: use local search in production (T235717)]] (duration: 00m 58s) |
[production] |
| 00:27 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562359|Enable Partial Blocks on every wiki excluding those that have opted-out (T218626)]] (duration: 00m 55s) |
[production] |
| 00:26 |
<bstorm_> |
repooled tools-sgewebgrid-lighttpd-0919 |
[tools] |
| 00:17 |
<bstorm_> |
repooled tools-sgewebgrid-lighttpd-0918 |
[tools] |
| 00:15 |
<bstorm_> |
moving tools-sgewebgrid-lighttpd-0918 and -0919 to cloudvirt1004 from cloudvirt1029 to rebalance load |
[tools] |
| 00:02 |
<bstorm_> |
depooled tools-sgewebgrid-lighttpd-0918 and 0919 to move to cloudvirt1004 to improve spread |
[tools] |
|
2020-01-06
§
|
| 23:49 |
<ejegg> |
updated payments-wiki from 827e3235dc to c3ca3ad6a7 |
[production] |
| 23:40 |
<bd808> |
Deleted tools-sgewebgrid-lighttpd-09{0[1-9],10} |
[tools] |
| 23:36 |
<bd808> |
Shutdown tools-sgewebgrid-lighttpd-09{0[1-9],10} |
[tools] |
| 23:34 |
<bd808> |
Decommissioned tools-sgewebgrid-lighttpd-09{0[1-9],10} |
[tools] |
| 23:13 |
<bstorm_> |
Repooled tools-sgeexec-0922 because I don't know why it was depooled |
[tools] |
| 23:12 |
<mutante> |
mailman - running /usr/local/sbin/rename_list wikimediamy wikimedia-my (T241988) |
[production] |
| 23:01 |
<bd808> |
Depooled tools-sgewebgrid-lighttpd-0910.tools.eqiad.wmflabs |
[tools] |
| 22:58 |
<bd808> |
Depooling tools-sgewebgrid-lighttpd-090[2-9] |
[tools] |
| 22:57 |
<bd808> |
Disabling queues on tools-sgewebgrid-lighttpd-090[2-9] |
[tools] |
| 22:34 |
<eileen> |
civicrm revision changed from b7746c31aa to 51b6fca9b2, config revision is b8af24d7c8 |
[production] |
| 22:31 |
<bd808> |
Update to 9298e99; new features: 'firehose' view, show project for each log entry |
[tools.sal] |
| 22:01 |
<bd808> |
Migrating to new Kubernetes cluster |
[tools.sal] |
| 21:42 |
<bstorm_> |
disabled rpcbind on toolsbeta-sgebastion-04 to test some things |
[toolsbeta] |
| 21:28 |
<Amir1> |
starting rebuild of holes in new term store from Q1Mio to Q10Mio using screen in mwmaint1002 (T219123) |
[production] |
| 21:22 |
<bd808> |
Migrating webservice to new Kubernetes grid (bot still runs on grid engine) |
[tools.meetbot] |
| 21:15 |
<bd808> |
kubectl scale --replicas=2 $(kubectl get deployment -o name) |
[tools.admin] |
| 21:12 |
<bd808> |
Brooke fixed routing by deleting a dangling Kubernetes Service for the admin tool on the legacy Kubernetes grid |
[tools.admin] |
| 21:07 |
<bd808> |
Restarted kube2proxy on tools-proxy-05 to try and refresh admin tool's routes |
[tools] |
| 21:01 |
<bd808> |
Getting 503 response for https://tools.wmflabs.org/admin/; dynamicproxy seems to be confused about which cluster to route to |
[tools.admin] |
| 20:53 |
<bd808> |
Preparing to move webservice to new Kubernetes grid |
[tools.admin] |
| 20:43 |
<James_F> |
Deleting https://doc.wikimedia.org/Wikibase/wmf/1.34.0-wmf.4 for T240206 |
[releng] |
| 20:43 |
<James_F> |
Deleting https://doc.wikimedia.org/Wikibase/wmf/1.33.0-wmf.23 for T240206 |
[releng] |
| 20:11 |
<James_F> |
Zuul: [SoftRedirector] Add phan and seccheck |
[releng] |