501-550 of 10000 results (73ms)
2023-09-18 §
09:34 <hashar@deploy1002> Finished scap: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] (duration: 09m 06s) [production]
09:31 <fabfur> disabled puppet on cp4052 for T346602 [production]
09:28 <godog> set max-repeaters to 20 for cr3-eqsin in librenms - T346606 [production]
09:28 <godog> set max-repeaters for cr3-eqsin in librenms - T346606 [production]
09:27 <hashar@deploy1002> hashar and urbanecm: Continuing with sync [production]
09:26 <hashar@deploy1002> hashar and urbanecm: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] synced to the testservers mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
09:25 <isaranto@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
09:25 <hashar@deploy1002> Started scap: Backport for [[gerrit:957872|tests: Do not assume UTSysop exists (T346253)]] [production]
09:25 <stevemunene@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
09:06 <jelto@deploy1002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
09:05 <jelto@deploy1002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
09:03 <jelto@deploy1002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
09:03 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . [production]
09:02 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
09:02 <jelto@deploy1002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
08:56 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
08:47 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
08:46 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
07:58 <Amir1> running db checksum run in s3 eqiad replicas (T207253) [production]
07:26 <taavi@deploy1002> Finished scap: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] (duration: 22m 24s) [production]
07:17 <taavi@deploy1002> aleksandar and taavi: Continuing with sync [production]
07:15 <moritzm> installing clamav security updates [production]
07:13 <taavi@deploy1002> aleksandar and taavi: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
07:03 <taavi@deploy1002> Started scap: Backport for [[gerrit:957873|robots.txt: Disable indexing user (talk) pages and draft (talk) pages on shwiki (T346589)]] [production]
2023-09-16 §
13:52 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/changeprop: apply [production]
13:52 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/changeprop: apply [production]
13:52 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
13:52 <akosiaris> re-enable changeprop [production]
13:52 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]
12:57 <akosiaris> stop changeprop in eqiad [production]
01:44 <krinkle@deploy1002> Finished deploy [integration/docroot@9a1fb37]: (no justification provided) (duration: 00m 06s) [production]
01:44 <krinkle@deploy1002> Started deploy [integration/docroot@9a1fb37]: (no justification provided) [production]
2023-09-15 §
21:03 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1047.eqiad.wmnet with OS bullseye [production]
21:03 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1047.eqiad.wmnet with OS bullseye [production]
20:59 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1036.eqiad.wmnet with OS bullseye [production]
20:59 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1036.eqiad.wmnet with OS bullseye [production]
20:59 <tzatziki> removing 6 files for legal compliance [production]
20:58 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1038.eqiad.wmnet with OS bullseye [production]
20:58 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1038.eqiad.wmnet with OS bullseye [production]
20:58 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1036.eqiad.wmnet with OS bullseye [production]
20:58 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1036.eqiad.wmnet with OS bullseye [production]
17:56 <urandom> stopping Cassandra bootstrap, restbase1030-a — T331713 [production]
17:43 <urandom> initiate Cassandra bootstrap, restbase1030-a — T331713 [production]
17:11 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2002-dev.codfw.wmnet with OS bookworm [production]
17:08 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2003-dev.codfw.wmnet with OS bookworm [production]