|
2025-11-30
§
|
| 07:50 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2146.codfw.wmnet with reason: Maintenance |
[production] |
| 07:49 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86160 and previous config saved to /var/cache/conftool/dbconfig/20251130-074953-marostegui.json |
[production] |
| 07:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P86159 and previous config saved to /var/cache/conftool/dbconfig/20251130-073445-marostegui.json |
[production] |
| 07:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P86158 and previous config saved to /var/cache/conftool/dbconfig/20251130-071938-marostegui.json |
[production] |
| 07:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86157 and previous config saved to /var/cache/conftool/dbconfig/20251130-070430-marostegui.json |
[production] |
| 06:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86156 and previous config saved to /var/cache/conftool/dbconfig/20251130-065805-marostegui.json |
[production] |
| 06:57 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 06:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1159 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86155 and previous config saved to /var/cache/conftool/dbconfig/20251130-065526-marostegui.json |
[production] |
| 06:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1159.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:53 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 03:48 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:47 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T410589)', diff saved to https://phabricator.wikimedia.org/P86154 and previous config saved to /var/cache/conftool/dbconfig/20251130-034752-ladsgroup.json |
[production] |
| 03:32 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P86153 and previous config saved to /var/cache/conftool/dbconfig/20251130-033244-ladsgroup.json |
[production] |
| 03:17 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P86152 and previous config saved to /var/cache/conftool/dbconfig/20251130-031735-ladsgroup.json |
[production] |
| 03:02 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T410589)', diff saved to https://phabricator.wikimedia.org/P86151 and previous config saved to /var/cache/conftool/dbconfig/20251130-030228-ladsgroup.json |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 12m 22s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2025-11-29
§
|
| 22:52 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1032.eqiad.wmnet with OS trixie |
[production] |
| 22:52 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:51 |
<jclark@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:33 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1032.eqiad.wmnet with reason: host reimage |
[production] |
| 22:29 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1028.eqiad.wmnet with OS bookworm |
[production] |
| 22:29 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:27 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1032.eqiad.wmnet with reason: host reimage |
[production] |
| 22:22 |
<jclark@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:10 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host wdqs1032.eqiad.wmnet with OS trixie |
[production] |
| 22:09 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 22:07 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 22:03 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage |
[production] |
| 21:57 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage |
[production] |
| 21:07 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 21:05 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:52 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host wdqs1028.eqiad.wmnet with OS bookworm |
[production] |
| 20:48 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1028.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:47 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1028.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:34 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 16:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2229 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86150 and previous config saved to /var/cache/conftool/dbconfig/20251129-162720-marostegui.json |
[production] |
| 16:12 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2229', diff saved to https://phabricator.wikimedia.org/P86149 and previous config saved to /var/cache/conftool/dbconfig/20251129-161213-marostegui.json |
[production] |
| 15:57 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2229', diff saved to https://phabricator.wikimedia.org/P86148 and previous config saved to /var/cache/conftool/dbconfig/20251129-155706-marostegui.json |
[production] |
| 15:41 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2229 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86147 and previous config saved to /var/cache/conftool/dbconfig/20251129-154158-marostegui.json |
[production] |
| 13:38 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1259 (T410589)', diff saved to https://phabricator.wikimedia.org/P86146 and previous config saved to /var/cache/conftool/dbconfig/20251129-133810-ladsgroup.json |
[production] |
| 13:38 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1259.eqiad.wmnet with reason: Maintenance |
[production] |
| 13:37 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254 (T410589)', diff saved to https://phabricator.wikimedia.org/P86145 and previous config saved to /var/cache/conftool/dbconfig/20251129-133748-ladsgroup.json |
[production] |
| 13:22 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P86144 and previous config saved to /var/cache/conftool/dbconfig/20251129-132240-ladsgroup.json |
[production] |
| 13:07 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P86143 and previous config saved to /var/cache/conftool/dbconfig/20251129-130732-ladsgroup.json |
[production] |
| 12:52 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1254 (T410589)', diff saved to https://phabricator.wikimedia.org/P86142 and previous config saved to /var/cache/conftool/dbconfig/20251129-125225-ladsgroup.json |
[production] |
| 11:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2229 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86141 and previous config saved to /var/cache/conftool/dbconfig/20251129-115552-marostegui.json |
[production] |
| 11:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2229.codfw.wmnet with reason: Maintenance |
[production] |
| 11:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2224 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86140 and previous config saved to /var/cache/conftool/dbconfig/20251129-115528-marostegui.json |
[production] |
| 11:40 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P86139 and previous config saved to /var/cache/conftool/dbconfig/20251129-114020-marostegui.json |
[production] |