|
2026-05-29
§
|
| 07:54 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool pool db2212: Pooling |
[production] |
| 07:54 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db2212.codfw.wmnet |
[production] |
| 07:54 |
<fceratto@cumin1003> |
START - Cookbook sre.hosts.remove-downtime for db2212.codfw.wmnet |
[production] |
| 07:22 |
<jynus@cumin2002> |
START - Cookbook sre.hosts.reimage for host backup2014.codfw.wmnet with OS bookworm |
[production] |
| 07:16 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host urldownloader2006.wikimedia.org |
[production] |
| 07:16 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader2006.wikimedia.org with OS trixie |
[production] |
| 06:59 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on urldownloader2006.wikimedia.org with reason: host reimage |
[production] |
| 06:53 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on urldownloader2006.wikimedia.org with reason: host reimage |
[production] |
| 06:34 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reimage for host urldownloader2006.wikimedia.org with OS trixie |
[production] |
| 06:32 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader2006.wikimedia.org - jmm@cumin2002" |
[production] |
| 06:32 |
<jmm@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM urldownloader2006.wikimedia.org - jmm@cumin2002" |
[production] |
| 06:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) urldownloader2006.wikimedia.org on all recursors |
[production] |
| 06:31 |
<jmm@cumin2002> |
START - Cookbook sre.dns.wipe-cache urldownloader2006.wikimedia.org on all recursors |
[production] |
| 06:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 06:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM urldownloader2006.wikimedia.org - jmm@cumin2002" |
[production] |
| 06:31 |
<jmm@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM urldownloader2006.wikimedia.org - jmm@cumin2002" |
[production] |
| 06:27 |
<jmm@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 06:27 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.makevm for new host urldownloader2006.wikimedia.org |
[production] |
| 03:01 |
<vriley@cumin1003> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts db1224.eqiad.wmnet |
[production] |
| 03:00 |
<vriley@cumin1003> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts db1224.eqiad.wmnet |
[production] |
| 03:00 |
<vriley@cumin1003> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts db1224.eqiad.wmnet |
[production] |
| 02:56 |
<vriley@cumin1003> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts db1224.eqiad.wmnet |
[production] |
| 02:31 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26614336971 (https://github.com/cluebotng/component-configs/commits/622f302a735e2a285b7ac4f46e726aaf538f8d93) |
[tools.cluebotng-monitoring] |
| 01:47 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp5032.eqsin.wmnet with OS trixie |
[production] |
| 01:18 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5032.eqsin.wmnet with reason: host reimage |
[production] |
| 01:14 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cp5032.eqsin.wmnet with reason: host reimage |
[production] |
| 00:54 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26611217389 (https://github.com/cluebotng/component-configs/commits/1c99ebab25e9cbf3bd595f45368b3a5e15489941) |
[tools.cluebotng-monitoring] |
| 00:33 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26610547573 (https://github.com/cluebotng/component-configs/commits/d647b7c087dff8de798d78a98082469fa41e7712) |
[tools.cluebotng-trainer] |
| 00:31 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.reimage for host cp5032.eqsin.wmnet with OS trixie |
[production] |
| 00:29 |
<pt1979@cumin2002> |
END (FAIL) - Cookbook sre.hosts.dhcp (exit_code=99) for host cp5032.eqsin.wmnet |
[production] |
| 00:23 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 00:22 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 00:21 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 00:21 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 00:07 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26609639469 (https://github.com/cluebotng/component-configs/commits/8c2fccaaae357774084389157d9a305e72eccb20) |
[tools.cluebotng-review] |
| 00:06 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26609639432 (https://github.com/cluebotng/component-configs/commits/8c2fccaaae357774084389157d9a305e72eccb20) |
[tools.cluebotng] |
|
2026-05-28
§
|
| 23:58 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26609327945 (https://github.com/cluebotng/component-configs/commits/3772f3cb5ead5bf2f5baf68cb048123a3b98c006) |
[tools.cluebotng-monitoring] |
| 23:15 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26607745901 (https://github.com/cluebotng/component-configs/commits/4cb42c1d89330943cefe6c3f647fe33e1760d090) |
[tools.cluebotng-monitoring] |
| 23:07 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 23:07 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ae1.522 interface - pt1979@cumin2002" |
[production] |
| 23:07 |
<pt1979@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for new ae1.522 interface - pt1979@cumin2002" |
[production] |
| 23:02 |
<pt1979@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 22:34 |
<andrewbogott> |
reprepro includedeb trixie-wikimedia /home/andrew/magnum-cluster-api_0.36.6-1~wmf13u2_amd64.deb |
[production] |
| 22:31 |
<logmsgbot> |
dreamyjazz Deployed security patch for T426388 |
[production] |
| 22:09 |
<eileen> |
SmashPig upgraded from 252b6cfa to 166abfbd |
[fundraising] |
| 21:36 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26603560881 (https://github.com/cluebotng/component-configs/commits/c78caa8aac55b55f6da890066aba0130382c840f) |
[tools.cluebotng-monitoring] |
| 21:33 |
<maryum> |
Deployed security fix for T426867 |
[production] |
| 21:21 |
<alexsanford> |
Deployed security fix for T426889 |
[production] |
| 21:07 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.dhcp for host cp5032.eqsin.wmnet |
[production] |
| 21:04 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "setup new eqsin vlan - pt1979@cumin2002 - T427393" |
[production] |