|
2026-10-09
ยง
|
| 17:35 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:33 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:33 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:32 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:32 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:32 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:32 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:31 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:31 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.3.1 (T414595) |
[tools] |
| 17:30 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.1.3 (T414595) |
[tools] |
| 17:30 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/kube-state-metrics:v8.1.3 (T414595) |
[tools] |
| 16:47 |
<cmooney@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on netbox1003.eqiad.wmnet with reason: Restoring DB from backup on netboxdb1003 |
[production] |
| 16:05 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox |
[production] |
| 16:01 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project baglama2 in eqiad1 (T440700) |
[baglama2] |
| 15:57 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.vps.delete_project for project baglama2 in eqiad1 (T440700) |
[baglama2] |
| 15:50 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:50 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: merge new dns entries for eqiad ab links - cmooney@cumin1004" |
[production] |
| 15:50 |
<cmooney@cumin1004> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: merge new dns entries for eqiad ab links - cmooney@cumin1004" |
[production] |
| 15:46 |
<cmooney@cumin1004> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:44 |
<cmooney@cumin1004> |
START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox |
[production] |
| 15:44 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary |
[production] |
| 15:42 |
<cmooney@cumin1004> |
START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary |
[production] |
| 15:42 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-worker1081.eqiad.wmnet |
[production] |
| 15:42 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.remove-downtime for wikikube-worker1081.eqiad.wmnet |
[production] |
| 15:42 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1081.eqiad.wmnet |
[production] |
| 15:42 |
<oblivian@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1081.eqiad.wmnet |
[production] |
| 15:42 |
<oblivian@cumin1004> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-worker1057.eqiad.wmnet |
[production] |
| 15:42 |
<oblivian@cumin1004> |
START - Cookbook sre.hosts.remove-downtime for wikikube-worker1057.eqiad.wmnet |
[production] |
| 15:33 |
<larssandergreen> |
civicrm upgraded from 9e1b80cc to 02ccc9c7 |
[fundraising] |
| 15:15 |
<godog> |
delete trove db baglama2 - T440700 |
[baglama2] |
| 15:10 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/37949440447 (https://github.com/cluebotng/component-configs/commits/902367266d74fd0d5bf2343e1502e8e1eefc330c) |
[tools.cluebot3] |
| 14:40 |
<fnegri@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/toolhub: apply |
[production] |
| 14:40 |
<fnegri@deploy1003> |
helmfile [eqiad] START helmfile.d/services/toolhub: apply |
[production] |
| 14:40 |
<fnegri@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/toolhub: apply |
[production] |
| 14:40 |
<fnegri@deploy1003> |
helmfile [codfw] START helmfile.d/services/toolhub: apply |
[production] |
| 14:39 |
<fnegri@deploy1003> |
helmfile [staging] DONE helmfile.d/services/toolhub: apply |
[production] |
| 14:39 |
<fnegri@deploy1003> |
helmfile [staging] START helmfile.d/services/toolhub: apply |
[production] |
| 14:33 |
<elukey@cumin1004> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 14:32 |
<elukey@cumin1004> |
START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 14:32 |
<elukey@cumin1004> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 14:30 |
<trueg@deploy1003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply |
[production] |
| 14:27 |
<trueg@deploy1003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply |
[production] |
| 14:25 |
<trueg@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply |
[production] |
| 14:24 |
<trueg@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply |
[production] |
| 14:20 |
<ammarpad@deploy1003> |
mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki mediawikiwiki 'Abstract Wikipedia team' 'Abstract Wikipedia' Ammarpad --reason 'requested at [[:phab:T440606|T440606]]' |
[production] |
| 14:16 |
<elukey@cumin1004> |
START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL |
[production] |
| 13:59 |
<elukey@cumin1004> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['sretest2003.codfw.wmnet'] |
[production] |
| 13:57 |
<fnegri@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/toolhub: apply |
[production] |
| 13:56 |
<fnegri@deploy1003> |
helmfile [eqiad] START helmfile.d/services/toolhub: apply |
[production] |
| 13:56 |
<fnegri@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/toolhub: apply |
[production] |