101-150 of 10000 results (56ms)
2026-09-22 ยง
18:49 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1019.eqiad.wmnet [production]
18:49 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:49 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:47 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:44 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:43 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:41 <dancy@deploy1003> install-world aborted: (no justification provided) (duration: 00m 48s) [production]
18:41 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:40 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:36 <jhuneidi@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.21 refs T438217 [production]
18:35 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:35 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:35 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:18 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:16 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:16 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:16 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:09 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:07 <ebernhardson> Rolling restart opensearch-semantic-search in dse-k8s-eqiad to update to opensearch 3.8.0 [production]
17:55 <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344040|fix(WikimediaAntiAbuse): use correct endpoint for LiftWing in eqiad]] (duration: 10m 09s) [production]
17:54 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wdqs1030 [production]
17:54 <bking@cumin2003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wdqs1030 [production]
17:53 <bking@cumin2003> START - Cookbook sre.network.configure-switch-interfaces for host wdqs1030 [production]
17:53 <bking@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wdqs1030.eqiad.wmnet 8.32.64.10.in-addr.arpa 8.0.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
17:53 <bking@cumin2003> START - Cookbook sre.dns.wipe-cache wdqs1030.eqiad.wmnet 8.32.64.10.in-addr.arpa 8.0.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
17:53 <bking@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:53 <bking@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wdqs1030 - bking@cumin2003" [production]
17:53 <bking@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wdqs1030 - bking@cumin2003" [production]
17:51 <marostegui@cumin1004> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2218: Optimizer issues fixed [production]
17:50 <dreamyjazz@deploy1003> dreamyjazz, isaranto: Continuing with deployment [production]
17:50 <dreamyjazz@deploy1003> dreamyjazz, isaranto: Backport for [[gerrit:1344040|fix(WikimediaAntiAbuse): use correct endpoint for LiftWing in eqiad]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:47 <sukhe@cumin1004> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from sretest2013 to cp2059 [production]
17:46 <sukhe@cumin1004> START - Cookbook sre.hosts.rename from sretest2013 to cp2059 [production]
17:45 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1344040|fix(WikimediaAntiAbuse): use correct endpoint for LiftWing in eqiad]] [production]
17:45 <bking@cumin2003> START - Cookbook sre.dns.netbox [production]
17:43 <bking@cumin2003> START - Cookbook sre.hosts.move-vlan for host wdqs1030 [production]
17:39 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1013.eqiad.wmnet [production]
17:39 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1012.eqiad.wmnet [production]
17:39 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1012.eqiad.wmnet [production]
17:37 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wdqs1029 [production]
17:37 <bking@cumin2003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wdqs1029 [production]
17:36 <bking@cumin2003> START - Cookbook sre.network.configure-switch-interfaces for host wdqs1029 [production]
17:36 <bking@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wdqs1029.eqiad.wmnet 8.48.64.10.in-addr.arpa 8.0.0.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
17:36 <bking@cumin2003> START - Cookbook sre.dns.wipe-cache wdqs1029.eqiad.wmnet 8.48.64.10.in-addr.arpa 8.0.0.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
17:36 <bking@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:36 <bking@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wdqs1029 - bking@cumin2003" [production]
17:36 <bking@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wdqs1029 - bking@cumin2003" [production]
17:33 <sukhe@cumin1004> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from sretest2013 to cp2059 [production]
17:32 <sukhe@cumin1004> START - Cookbook sre.hosts.rename from sretest2013 to cp2059 [production]
17:31 <bking@cumin2003> START - Cookbook sre.dns.netbox [production]