|
2026-03-17
ยง
|
| 07:32 |
<jmm@cumin2002> |
END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2033.codfw.wmnet |
[production] |
| 07:32 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2033.codfw.wmnet |
[production] |
| 07:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2032.codfw.wmnet |
[production] |
| 07:31 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2032.codfw.wmnet |
[production] |
| 07:29 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti3005.esams.wmnet with reason: host reimage |
[production] |
| 07:25 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti3005.esams.wmnet with reason: host reimage |
[production] |
| 07:25 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti2032.codfw.wmnet |
[production] |
| 07:23 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2032.codfw.wmnet |
[production] |
| 07:00 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reimage for host ganeti3005.esams.wmnet with OS bookworm |
[production] |
| 06:20 |
<eileen> |
civicrm upgraded from 7fe14629 to adc36173 |
[fundraising] |
| 06:08 |
<kart_> |
Updated cxserver to 2026-03-16-071247-production (T420004) |
[production] |
| 06:07 |
<kartik@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/cxserver: apply |
[production] |
| 06:06 |
<kartik@deploy2002> |
helmfile [eqiad] START helmfile.d/services/cxserver: apply |
[production] |
| 06:05 |
<kartik@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/cxserver: apply |
[production] |
| 06:04 |
<kartik@deploy2002> |
helmfile [codfw] START helmfile.d/services/cxserver: apply |
[production] |
| 05:58 |
<kartik@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:58 |
<kartik@deploy2002> |
helmfile [staging] START helmfile.d/services/cxserver: apply |
[production] |
| 05:06 |
<eileen> |
civicrm upgraded from e622a222 to 7fe14629 |
[fundraising] |
| 04:41 |
<dwisehaupt@dns1005> |
END - running authdns-update |
[production] |
| 04:39 |
<dwisehaupt@dns1005> |
START - running authdns-update |
[production] |
| 04:01 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.46.0-wmf.17 (duration: 01m 17s) |
[production] |
| 03:48 |
<eileen> |
civicrm upgraded from 5360f9ad to e622a222 |
[fundraising] |
| 03:43 |
<mwpresync@deploy2002> |
Finished scap sync-world: testwikis to 1.46.0-wmf.20 refs T413811 (duration: 39m 34s) |
[production] |
| 03:03 |
<mwpresync@deploy2002> |
Started scap sync-world: testwikis to 1.46.0-wmf.20 refs T413811 |
[production] |
| 02:13 |
<eileen> |
civicrm upgraded from 3283e3ca to e73c6b50 |
[fundraising] |
| 02:09 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 08m 10s) |
[production] |
| 02:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 01:25 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1049.eqiad.wmnet' (T406516) |
[admin] |
| 01:18 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1049.eqiad.wmnet' (T406516) |
[admin] |
| 01:17 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1048.eqiad.wmnet' (T406516) |
[admin] |
| 01:11 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1048.eqiad.wmnet' (T406516) |
[admin] |
| 01:11 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1047.eqiad.wmnet' (T406516) |
[admin] |
| 01:04 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1047.eqiad.wmnet' (T406516) |
[admin] |
| 01:04 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1046.eqiad.wmnet' (T406516) |
[admin] |
| 00:57 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1046.eqiad.wmnet' (T406516) |
[admin] |
| 00:57 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1045.eqiad.wmnet' (T406516) |
[admin] |
| 00:51 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1045.eqiad.wmnet' (T406516) |
[admin] |
| 00:50 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1044.eqiad.wmnet' (T406516) |
[admin] |
| 00:44 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1044.eqiad.wmnet' (T406516) |
[admin] |
| 00:44 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1043.eqiad.wmnet' (T406516) |
[admin] |
| 00:37 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1043.eqiad.wmnet' (T406516) |
[admin] |
| 00:37 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1042.eqiad.wmnet' (T406516) |
[admin] |
| 00:30 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1042.eqiad.wmnet' (T406516) |
[admin] |
| 00:30 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1041.eqiad.wmnet' (T406516) |
[admin] |
| 00:26 |
<brett@puppetserver1001> |
conftool action : set/pooled=yes; selector: name=cp6009.* |
[production] |
| 00:25 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp6009.drmrs.wmnet with OS trixie |
[production] |
| 00:23 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1041.eqiad.wmnet' (T406516) |
[admin] |
| 00:23 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1040.eqiad.wmnet' (T406516) |
[admin] |
| 00:17 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1040.eqiad.wmnet' (T406516) |
[admin] |
| 00:16 |
<wmftkbot> |
Test Kitchen edge-unique experiments (poll 262989) - adds: attribution-research-short-baseline-run; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD |
[analytics] |