201-250 of 10000 results (4ms)
2026-09-23 ยง
09:59 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1003.eqiad.wmnet [production]
09:59 <ayounsi@cumin1004> START - Cookbook sre.deploy.python-code netbox to netbox-dev2003.codfw.wmnet with reason: Add netbox-bgp and update wheelson netbox-next - ayounsi@cumin1004 [production]
09:58 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1003.eqiad.wmnet [production]
09:58 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1002.eqiad.wmnet [production]
09:58 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1002.eqiad.wmnet [production]
09:57 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:55 <brouberol@cumin1004> DONE (PASS) - Cookbook sre.ceph.remove-osd (exit_code=0) [production]
09:54 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:54 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:53 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:53 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [toolsbeta]
09:52 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:51 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:51 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1002.eqiad.wmnet [production]
09:51 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1002.eqiad.wmnet [production]
09:51 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1001.eqiad.wmnet [production]
09:51 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1001.eqiad.wmnet [production]
09:50 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:44 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1001.eqiad.wmnet [production]
09:43 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1001.eqiad.wmnet [production]
09:43 <btullis@cumin1004> START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{dse-k8s-wdqs100[1-3].eqiad.wmnet} and (A:dse-k8s-master-eqiad or A:dse-k8s-worker-eqiad) [production]
09:43 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 20 cores (T438940) [integration]
09:43 <dcaro@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase by 20 cores (T438940) [integration]
09:43 <dcaro@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.quota_increase (exit_code=97) by 20 cores [integration]
09:43 <dcaro@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase by 20 cores [integration]
09:40 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
09:38 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:34 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
09:30 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T437407) [admin]
09:30 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T437407) [admin]
09:11 <tlepage@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [tools]
08:59 <tlepage@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [tools]
08:57 <tlepage@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-api [tools]
08:56 <tlepage@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [tools]
08:56 <tlepage@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [toolsbeta]
08:45 <tlepage@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
08:45 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
08:44 <tlepage@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-api [toolsbeta]
08:44 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
08:44 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
08:41 <brouberol@cumin1004> DONE (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
08:34 <tlepage@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
08:33 <tlepage@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-api [toolsbeta]
08:27 <brouberol@cumin1004> END (FAIL) - Cookbook sre.ceph.remove-osd (exit_code=99) [production]
08:27 <brouberol@cumin1004> START - Cookbook sre.ceph.remove-osd [production]
08:26 <tlepage@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
08:25 <kevinbazira@deploy1003> helmfile [ml-serve-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . [production]
08:24 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] 'sync' command on namespace 'tts-section-generator' for release 'main' . [production]
08:13 <tappof@deploy1003> Finished scap sync-world: T432444 - Provision kafka-logging100[6-8] (duration: 12m 52s) [production]
08:05 <moritzm> installing grub2 bugfix updates on Bookworm hosts [production]