|
2026-01-12
ยง
|
| 09:09 |
<dzahn@dns1004> |
START - running authdns-update |
[production] |
| 09:04 |
<bwojtowicz@deploy2002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
| 09:01 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2164 (T413525)', diff saved to https://phabricator.wikimedia.org/P87288 and previous config saved to /var/cache/conftool/dbconfig/20260112-090158-marostegui.json |
[production] |
| 09:01 |
<bwojtowicz@deploy2002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
| 08:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P87287 and previous config saved to /var/cache/conftool/dbconfig/20260112-085934-marostegui.json |
[production] |
| 08:59 |
<XioNoX> |
eqiad pfw - remove old LVS BGP config (replaced by bird) - T414015 |
[production] |
| 08:55 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2164 (T413525)', diff saved to https://phabricator.wikimedia.org/P87286 and previous config saved to /var/cache/conftool/dbconfig/20260112-085459-marostegui.json |
[production] |
| 08:54 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2164.codfw.wmnet with reason: Maintenance |
[production] |
| 08:54 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2163 (T413525)', diff saved to https://phabricator.wikimedia.org/P87285 and previous config saved to /var/cache/conftool/dbconfig/20260112-085434-marostegui.json |
[production] |
| 08:49 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1192 (T413525)', diff saved to https://phabricator.wikimedia.org/P87284 and previous config saved to /var/cache/conftool/dbconfig/20260112-084926-marostegui.json |
[production] |
| 08:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P87283 and previous config saved to /var/cache/conftool/dbconfig/20260112-084426-marostegui.json |
[production] |
| 08:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1192 (T413525)', diff saved to https://phabricator.wikimedia.org/P87282 and previous config saved to /var/cache/conftool/dbconfig/20260112-084425-marostegui.json |
[production] |
| 08:44 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1192.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1178 (T413525)', diff saved to https://phabricator.wikimedia.org/P87281 and previous config saved to /var/cache/conftool/dbconfig/20260112-084401-marostegui.json |
[production] |
| 08:34 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P87280 and previous config saved to /var/cache/conftool/dbconfig/20260112-083418-marostegui.json |
[production] |
| 08:33 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P87279 and previous config saved to /var/cache/conftool/dbconfig/20260112-083353-marostegui.json |
[production] |
| 08:24 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2163 (T413525)', diff saved to https://phabricator.wikimedia.org/P87278 and previous config saved to /var/cache/conftool/dbconfig/20260112-082409-marostegui.json |
[production] |
| 08:23 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P87277 and previous config saved to /var/cache/conftool/dbconfig/20260112-082344-marostegui.json |
[production] |
| 08:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2163 (T413525)', diff saved to https://phabricator.wikimedia.org/P87276 and previous config saved to /var/cache/conftool/dbconfig/20260112-081912-marostegui.json |
[production] |
| 08:19 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2163.codfw.wmnet with reason: Maintenance |
[production] |
| 08:18 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2154 (T413525)', diff saved to https://phabricator.wikimedia.org/P87275 and previous config saved to /var/cache/conftool/dbconfig/20260112-081847-marostegui.json |
[production] |
| 08:13 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1178 (T413525)', diff saved to https://phabricator.wikimedia.org/P87274 and previous config saved to /var/cache/conftool/dbconfig/20260112-081336-marostegui.json |
[production] |
| 08:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P87273 and previous config saved to /var/cache/conftool/dbconfig/20260112-080839-marostegui.json |
[production] |
| 08:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1178 (T413525)', diff saved to https://phabricator.wikimedia.org/P87272 and previous config saved to /var/cache/conftool/dbconfig/20260112-080827-marostegui.json |
[production] |
| 08:08 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1178.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:08 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1177 (T413525)', diff saved to https://phabricator.wikimedia.org/P87271 and previous config saved to /var/cache/conftool/dbconfig/20260112-080813-marostegui.json |
[production] |
| 07:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P87270 and previous config saved to /var/cache/conftool/dbconfig/20260112-075830-marostegui.json |
[production] |
| 07:58 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P87269 and previous config saved to /var/cache/conftool/dbconfig/20260112-075805-marostegui.json |
[production] |
| 07:48 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2154 (T413525)', diff saved to https://phabricator.wikimedia.org/P87268 and previous config saved to /var/cache/conftool/dbconfig/20260112-074822-marostegui.json |
[production] |
| 07:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P87267 and previous config saved to /var/cache/conftool/dbconfig/20260112-074756-marostegui.json |
[production] |
| 07:43 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2154 (T413525)', diff saved to https://phabricator.wikimedia.org/P87266 and previous config saved to /var/cache/conftool/dbconfig/20260112-074325-marostegui.json |
[production] |
| 07:43 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2154.codfw.wmnet with reason: Maintenance |
[production] |
| 07:43 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2152 (T413525)', diff saved to https://phabricator.wikimedia.org/P87265 and previous config saved to /var/cache/conftool/dbconfig/20260112-074300-marostegui.json |
[production] |
| 07:37 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1177 (T413525)', diff saved to https://phabricator.wikimedia.org/P87264 and previous config saved to /var/cache/conftool/dbconfig/20260112-073748-marostegui.json |
[production] |
| 07:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P87263 and previous config saved to /var/cache/conftool/dbconfig/20260112-073251-marostegui.json |
[production] |
| 07:32 |
<moritzm> |
updated trixie installer image to 13.3 T414179 |
[production] |
| 07:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1177 (T413525)', diff saved to https://phabricator.wikimedia.org/P87262 and previous config saved to /var/cache/conftool/dbconfig/20260112-073242-marostegui.json |
[production] |
| 07:32 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1177.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:32 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1172 (T413525)', diff saved to https://phabricator.wikimedia.org/P87261 and previous config saved to /var/cache/conftool/dbconfig/20260112-073218-marostegui.json |
[production] |
| 07:22 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P87260 and previous config saved to /var/cache/conftool/dbconfig/20260112-072243-marostegui.json |
[production] |
| 07:22 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P87259 and previous config saved to /var/cache/conftool/dbconfig/20260112-072209-marostegui.json |
[production] |
| 07:12 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2152 (T413525)', diff saved to https://phabricator.wikimedia.org/P87258 and previous config saved to /var/cache/conftool/dbconfig/20260112-071235-marostegui.json |
[production] |
| 07:12 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P87257 and previous config saved to /var/cache/conftool/dbconfig/20260112-071201-marostegui.json |
[production] |
| 07:07 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2152 (T413525)', diff saved to https://phabricator.wikimedia.org/P87256 and previous config saved to /var/cache/conftool/dbconfig/20260112-070724-marostegui.json |
[production] |
| 07:07 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2152.codfw.wmnet with reason: Maintenance |
[production] |
| 07:01 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1172 (T413525)', diff saved to https://phabricator.wikimedia.org/P87255 and previous config saved to /var/cache/conftool/dbconfig/20260112-070153-marostegui.json |
[production] |
| 06:58 |
<XioNoX> |
push pfw policy - T414116 |
[production] |
| 06:56 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1172 (T413525)', diff saved to https://phabricator.wikimedia.org/P87254 and previous config saved to /var/cache/conftool/dbconfig/20260112-065646-marostegui.json |
[production] |
| 06:56 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1172.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:53 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1171.eqiad.wmnet with reason: Maintenance |
[production] |