1-50 of 10000 results (21ms)
2026-06-15 ยง
17:53 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cp5026 [production]
17:53 <brett@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp5026 [production]
17:52 <brett@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cp5026 [production]
17:52 <brett@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cp5026.eqsin.wmnet 37.0.132.10.in-addr.arpa 7.3.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors [production]
17:52 <brett@cumin2002> START - Cookbook sre.dns.wipe-cache cp5026.eqsin.wmnet 37.0.132.10.in-addr.arpa 7.3.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors [production]
17:52 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:52 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host cp5026 - brett@cumin2002" [production]
17:52 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host cp5026 - brett@cumin2002" [production]
17:46 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
17:40 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device ssw1-d8-eqiad [production]
17:40 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device ssw1-d8-eqiad [production]
17:36 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-c4-eqiad [production]
17:35 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device lsw1-c4-eqiad [production]
17:34 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-c4-eqiad [production]
17:34 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device lsw1-c4-eqiad [production]
17:26 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component toolforge-weld [tools]
17:20 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 24 cores, 20 gigabytes, 32768 ram (T427731) [wlm-it-visual]
17:19 <volans@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase by 24 cores, 20 gigabytes, 32768 ram (T427731) [wlm-it-visual]
17:13 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component toolforge-weld [tools]
17:11 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/27562889711 (https://github.com/cluebotng/component-configs/commits/b9c48365007a90ed1c240655306615542751ea6f) [tools.cluebotng-review]
17:09 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component toolforge-weld [toolsbeta]
17:09 <brett@cumin2002> START - Cookbook sre.hosts.move-vlan for host cp5026 [production]
17:07 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp5026.eqsin.wmnet with OS trixie [production]
17:07 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.upgrade_osds (exit_code=99) [admin]
17:03 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/27562697218 (https://github.com/cluebotng/component-configs/commits/5c1faa1ebe1b269c9d3e13fc4d7c7a9fddf23bf2) [tools.cluebotng-review]
17:03 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
16:58 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component toolforge-weld [toolsbeta]
16:36 <atsuko@deploy1003> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
16:36 <atsuko@deploy1003> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
16:24 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/27560286658 (https://github.com/cluebotng/component-configs/commits/5c1faa1ebe1b269c9d3e13fc4d7c7a9fddf23bf2) [tools.cluebotng-monitoring]
16:16 <atsuko@deploy1003> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
16:16 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
16:16 <atsuko@deploy1003> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
16:13 <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1302192|SourceEditorOverlayHookPayload: Allow aborting of the save (T428287)]], [[gerrit:1302194|hCaptcha MobileFrontend: Avoid indefinite save loop on known errors (T428287)]], [[gerrit:1302195|OATHUserRepository: Specify caller in query]], [[gerrit:1302186|Bump guzzlehttp/psr to version 2.11.0 (T429208)]], [[gerrit:1302169|NoReferrerLinks: Add re [production]
16:13 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
16:10 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:08 <atsuko@deploy1003> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
16:08 <dreamyjazz@deploy1003> reedy, dreamyjazz, kharlan: Continuing with deployment [production]
16:08 <atsuko@deploy1003> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
16:07 <dreamyjazz@deploy1003> reedy, dreamyjazz, kharlan: Backport for [[gerrit:1302192|SourceEditorOverlayHookPayload: Allow aborting of the save (T428287)]], [[gerrit:1302194|hCaptcha MobileFrontend: Avoid indefinite save loop on known errors (T428287)]], [[gerrit:1302195|OATHUserRepository: Specify caller in query]], [[gerrit:1302186|Bump guzzlehttp/psr to version 2.11.0 (T429208)]], [[gerrit:1302169|NoReferrerLinks: Add [production]
16:05 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1302192|SourceEditorOverlayHookPayload: Allow aborting of the save (T428287)]], [[gerrit:1302194|hCaptcha MobileFrontend: Avoid indefinite save loop on known errors (T428287)]], [[gerrit:1302195|OATHUserRepository: Specify caller in query]], [[gerrit:1302186|Bump guzzlehttp/psr to version 2.11.0 (T429208)]], [[gerrit:1302169|NoReferrerLinks: Add rel [production]
16:04 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:04 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:57 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:51 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:51 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on releases2003.codfw.wmnet with reason: puppet debugging [production]
15:50 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on releases1003.eqiad.wmnet with reason: puppet debugging [production]
15:50 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host conf2008.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:49 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host conf2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]