|
2025-11-30
§
|
| 09:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2170 (T410531)', diff saved to https://phabricator.wikimedia.org/P86171 and previous config saved to /var/cache/conftool/dbconfig/20251130-093438-marostegui.json |
[production] |
| 09:34 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2170.codfw.wmnet with reason: Maintenance |
[production] |
| 09:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2153 (T410531)', diff saved to https://phabricator.wikimedia.org/P86170 and previous config saved to /var/cache/conftool/dbconfig/20251130-093414-marostegui.json |
[production] |
| 09:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P86169 and previous config saved to /var/cache/conftool/dbconfig/20251130-091906-marostegui.json |
[production] |
| 09:03 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2153', diff saved to https://phabricator.wikimedia.org/P86168 and previous config saved to /var/cache/conftool/dbconfig/20251130-090358-marostegui.json |
[production] |
| 08:48 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2153 (T410531)', diff saved to https://phabricator.wikimedia.org/P86167 and previous config saved to /var/cache/conftool/dbconfig/20251130-084851-marostegui.json |
[production] |
| 08:42 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2153 (T410531)', diff saved to https://phabricator.wikimedia.org/P86166 and previous config saved to /var/cache/conftool/dbconfig/20251130-084229-marostegui.json |
[production] |
| 08:42 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2153.codfw.wmnet with reason: Maintenance |
[production] |
| 08:42 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T410531)', diff saved to https://phabricator.wikimedia.org/P86165 and previous config saved to /var/cache/conftool/dbconfig/20251130-084205-marostegui.json |
[production] |
| 08:26 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P86164 and previous config saved to /var/cache/conftool/dbconfig/20251130-082657-marostegui.json |
[production] |
| 08:11 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P86163 and previous config saved to /var/cache/conftool/dbconfig/20251130-081150-marostegui.json |
[production] |
| 07:56 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T410531)', diff saved to https://phabricator.wikimedia.org/P86162 and previous config saved to /var/cache/conftool/dbconfig/20251130-075642-marostegui.json |
[production] |
| 07:50 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2146 (T410531)', diff saved to https://phabricator.wikimedia.org/P86161 and previous config saved to /var/cache/conftool/dbconfig/20251130-075017-marostegui.json |
[production] |
| 07:50 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2146.codfw.wmnet with reason: Maintenance |
[production] |
| 07:49 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86160 and previous config saved to /var/cache/conftool/dbconfig/20251130-074953-marostegui.json |
[production] |
| 07:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P86159 and previous config saved to /var/cache/conftool/dbconfig/20251130-073445-marostegui.json |
[production] |
| 07:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P86158 and previous config saved to /var/cache/conftool/dbconfig/20251130-071938-marostegui.json |
[production] |
| 07:04 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86157 and previous config saved to /var/cache/conftool/dbconfig/20251130-070430-marostegui.json |
[production] |
| 06:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2145 (T410531)', diff saved to https://phabricator.wikimedia.org/P86156 and previous config saved to /var/cache/conftool/dbconfig/20251130-065805-marostegui.json |
[production] |
| 06:57 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 06:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1159 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86155 and previous config saved to /var/cache/conftool/dbconfig/20251130-065526-marostegui.json |
[production] |
| 06:55 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1159.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:53 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 03:48 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:47 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T410589)', diff saved to https://phabricator.wikimedia.org/P86154 and previous config saved to /var/cache/conftool/dbconfig/20251130-034752-ladsgroup.json |
[production] |
| 03:32 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P86153 and previous config saved to /var/cache/conftool/dbconfig/20251130-033244-ladsgroup.json |
[production] |
| 03:17 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P86152 and previous config saved to /var/cache/conftool/dbconfig/20251130-031735-ladsgroup.json |
[production] |
| 03:02 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T410589)', diff saved to https://phabricator.wikimedia.org/P86151 and previous config saved to /var/cache/conftool/dbconfig/20251130-030228-ladsgroup.json |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 12m 22s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2025-11-29
§
|
| 22:52 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1032.eqiad.wmnet with OS trixie |
[production] |
| 22:52 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:51 |
<jclark@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:33 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1032.eqiad.wmnet with reason: host reimage |
[production] |
| 22:29 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1028.eqiad.wmnet with OS bookworm |
[production] |
| 22:29 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:27 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1032.eqiad.wmnet with reason: host reimage |
[production] |
| 22:22 |
<jclark@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" |
[production] |
| 22:10 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host wdqs1032.eqiad.wmnet with OS trixie |
[production] |
| 22:09 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 22:07 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 22:03 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage |
[production] |
| 21:57 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1028.eqiad.wmnet with reason: host reimage |
[production] |
| 21:07 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 21:05 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:52 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.reimage for host wdqs1028.eqiad.wmnet with OS bookworm |
[production] |
| 20:48 |
<jclark@cumin1003> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1028.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:47 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1028.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:34 |
<jclark@cumin1003> |
START - Cookbook sre.hosts.provision for host wdqs1032.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 16:27 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2229 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86150 and previous config saved to /var/cache/conftool/dbconfig/20251129-162720-marostegui.json |
[production] |