7701-7750 of 10000 results (217ms)
2024-09-30 ยง
20:16 <ebernhardson@deploy2002> Started scap sync-world: Backport for [[gerrit:1076810|Change votewiki language back to English. (T302443)]] [production]
20:13 <ebernhardson@deploy2002> Finished scap sync-world: Backport for [[gerrit:1070282|cirrus: Remove unused Regex pool counter (T369808)]] (duration: 07m 34s) [production]
20:08 <ebernhardson@deploy2002> ebernhardson: Continuing with sync [production]
20:07 <ebernhardson@deploy2002> ebernhardson: Backport for [[gerrit:1070282|cirrus: Remove unused Regex pool counter (T369808)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:05 <ebernhardson@deploy2002> Started scap sync-world: Backport for [[gerrit:1070282|cirrus: Remove unused Regex pool counter (T369808)]] [production]
19:56 <jhathaway@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
19:56 <jhathaway@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm [production]
19:08 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs[4008-4010].ulsfo.wmnet [production]
19:08 <sukhe@cumin1002> START - Cookbook sre.hosts.remove-downtime for lvs[4008-4010].ulsfo.wmnet [production]
18:41 <jhathaway@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
18:41 <jhathaway@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm [production]
18:04 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs[4008-4010].ulsfo.wmnet with reason: site is depooled, cr3-ulsfo is being replaced [production]
18:04 <sukhe@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on lvs[4008-4010].ulsfo.wmnet with reason: site is depooled, cr3-ulsfo is being replaced [production]
17:47 <ebernhardson@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:47 <ebernhardson@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
17:44 <ebernhardson@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:44 <ebernhardson@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
17:25 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:24 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
17:22 <jhathaway@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
17:22 <jhathaway@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm [production]
17:12 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
17:11 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:53 <swfrench-wmf> built and published new php8.1 images - T376036 [production]
16:51 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:41 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:27 <swfrench-wmf> imported php8.1_8.1.30-1+wmf11u1 into component/php81 - T376036 [production]
16:05 <jhathaway@cumin1002> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
15:56 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd1005.eqiad.wmnet with OS bookworm [production]
15:56 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:55 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:52 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd1004.eqiad.wmnet with OS bookworm [production]
15:52 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:51 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
15:49 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm [production]
15:45 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mc-misc1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:42 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host mc-misc1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mc-misc1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host mc-misc1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:40 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1002 [production]
15:39 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1002 [production]
15:39 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1001 [production]
15:39 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1001 [production]
15:39 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
15:35 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd1005.eqiad.wmnet with reason: host reimage [production]
15:32 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:32 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd1004.eqiad.wmnet with reason: host reimage [production]
15:31 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
15:29 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]