2023-09-18
§
|
09:34 |
<hashar@deploy1002> |
Finished scap: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] (duration: 09m 06s) |
[production] |
09:31 |
<fabfur> |
disabled puppet on cp4052 for T346602 |
[production] |
09:28 |
<godog> |
set max-repeaters to 20 for cr3-eqsin in librenms - T346606 |
[production] |
09:28 |
<godog> |
set max-repeaters for cr3-eqsin in librenms - T346606 |
[production] |
09:27 |
<hashar@deploy1002> |
hashar and urbanecm: Continuing with sync |
[production] |
09:26 |
<hashar@deploy1002> |
hashar and urbanecm: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] synced to the testservers mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) |
[production] |
09:25 |
<isaranto@deploy1002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . |
[production] |
09:25 |
<hashar@deploy1002> |
Started scap: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] |
[production] |
09:25 |
<stevemunene@deploy1002> |
helmfile [staging] START helmfile.d/services/datahub: apply on main |
[production] |
09:06 |
<jelto@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/miscweb: apply |
[production] |
09:05 |
<jelto@deploy1002> |
helmfile [eqiad] START helmfile.d/services/miscweb: apply |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . |
[production] |
09:03 |
<jelto@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/miscweb: apply |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . |
[production] |
09:03 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . |
[production] |
09:02 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . |
[production] |
09:02 |
<jelto@deploy1002> |
helmfile [codfw] START helmfile.d/services/miscweb: apply |
[production] |
08:56 |
<isaranto@deploy1002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . |
[production] |
08:47 |
<jelto@deploy1002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
08:46 |
<jelto@deploy1002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
07:58 |
<Amir1> |
running db checksum run in s3 eqiad replicas (T207253) |
[production] |
07:26 |
<taavi@deploy1002> |
Finished scap: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] (duration: 22m 24s) |
[production] |
07:17 |
<taavi@deploy1002> |
aleksandar and taavi: Continuing with sync |
[production] |
07:15 |
<moritzm> |
installing clamav security updates |
[production] |
07:13 |
<taavi@deploy1002> |
aleksandar and taavi: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) |
[production] |
07:03 |
<taavi@deploy1002> |
Started scap: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] |
[production] |
2023-09-15
§
|
21:03 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1047.eqiad.wmnet with OS bullseye |
[production] |
21:03 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.reimage for host kubernetes1047.eqiad.wmnet with OS bullseye |
[production] |
20:59 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1036.eqiad.wmnet with OS bullseye |
[production] |
20:59 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.reimage for host kubernetes1036.eqiad.wmnet with OS bullseye |
[production] |
20:59 |
<tzatziki> |
removing 6 files for legal compliance |
[production] |
20:58 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1038.eqiad.wmnet with OS bullseye |
[production] |
20:58 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.reimage for host kubernetes1038.eqiad.wmnet with OS bullseye |
[production] |
20:58 |
<jclark@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1036.eqiad.wmnet with OS bullseye |
[production] |
20:58 |
<jclark@cumin1001> |
START - Cookbook sre.hosts.reimage for host kubernetes1036.eqiad.wmnet with OS bullseye |
[production] |
17:56 |
<urandom> |
stopping Cassandra bootstrap, restbase1030-a — T331713 |
[production] |
17:43 |
<urandom> |
initiate Cassandra bootstrap, restbase1030-a — T331713 |
[production] |
17:11 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2002-dev.codfw.wmnet with OS bookworm |
[production] |
17:08 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2003-dev.codfw.wmnet with OS bookworm |
[production] |