2024-02-19
ยง
|
15:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1213 (re)pooling @ 10%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57103 and previous config saved to /var/cache/conftool/dbconfig/20240219-155443-root.json |
[production] |
15:51 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1027:1030] |
[production] |
15:49 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2194:3317 (re)pooling @ 1%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57102 and previous config saved to /var/cache/conftool/dbconfig/20240219-154904-arnaudb.json |
[production] |
15:47 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 75%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57101 and previous config saved to /var/cache/conftool/dbconfig/20240219-154716-arnaudb.json |
[production] |
15:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1224', diff saved to https://phabricator.wikimedia.org/P57100 and previous config saved to /var/cache/conftool/dbconfig/20240219-154154-arnaudb.json |
[production] |
15:41 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'T343674 - db2194 missing config', diff saved to https://phabricator.wikimedia.org/P57099 and previous config saved to /var/cache/conftool/dbconfig/20240219-154148-arnaudb.json |
[production] |
15:41 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1213.eqiad.wmnet with OS bookworm |
[production] |
15:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1213 (re)pooling @ 5%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57098 and previous config saved to /var/cache/conftool/dbconfig/20240219-153938-root.json |
[production] |
15:37 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2025:2028] (duration: 01m 28s) |
[production] |
15:36 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2025:2028] |
[production] |
15:35 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase1026 (duration: 01m 55s) |
[production] |
15:33 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase1026 |
[production] |
15:33 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1023:1025] (duration: 01m 57s) |
[production] |
15:32 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 50%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57097 and previous config saved to /var/cache/conftool/dbconfig/20240219-153211-arnaudb.json |
[production] |
15:31 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1023:1025] |
[production] |
15:26 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1224', diff saved to https://phabricator.wikimedia.org/P57096 and previous config saved to /var/cache/conftool/dbconfig/20240219-152634-arnaudb.json |
[production] |
15:24 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase2024 (duration: 01m 24s) |
[production] |
15:23 |
<Lucas_WMDE> |
UTC afternoon backport+config window done |
[production] |
15:22 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase2024 |
[production] |
15:22 |
<logmsgbot> |
lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:1000292|Increase move rate limit for extendedmovers in arwiki to 16/60 (T357229)]] (duration: 24m 34s) |
[production] |
15:22 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1213.eqiad.wmnet with reason: host reimage |
[production] |
15:22 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 30s) |
[production] |
15:20 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
15:19 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db1213.eqiad.wmnet with reason: host reimage |
[production] |
15:19 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 54s) |
[production] |
15:17 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
15:17 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 40%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57095 and previous config saved to /var/cache/conftool/dbconfig/20240219-151706-arnaudb.json |
[production] |
15:15 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 55s) |
[production] |
15:15 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
15:14 |
<logmsgbot> |
lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and gergesshamon: Continuing with sync |
[production] |
15:14 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
15:13 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
15:13 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 28s) |
[production] |
15:12 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'es1020 (re)pooling @ 100%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57094 and previous config saved to /var/cache/conftool/dbconfig/20240219-151246-root.json |
[production] |
15:11 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
15:11 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 55s) |
[production] |
15:11 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1224 (T357189)', diff saved to https://phabricator.wikimedia.org/P57093 and previous config saved to /var/cache/conftool/dbconfig/20240219-151127-arnaudb.json |
[production] |
15:10 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
15:09 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
15:09 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
14:53 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 24s) |
[production] |
14:52 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P57087 and previous config saved to /var/cache/conftool/dbconfig/20240219-145251-arnaudb.json |
[production] |
14:51 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
14:51 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2136 (T352010)', diff saved to https://phabricator.wikimedia.org/P57086 and previous config saved to /var/cache/conftool/dbconfig/20240219-145119-ladsgroup.json |
[production] |
14:51 |
<ladsgroup@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2136.codfw.wmnet with reason: Maintenance |
[production] |
14:51 |
<ladsgroup@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2136.codfw.wmnet with reason: Maintenance |
[production] |
14:50 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2119 (T352010)', diff saved to https://phabricator.wikimedia.org/P57085 and previous config saved to /var/cache/conftool/dbconfig/20240219-145057-ladsgroup.json |
[production] |
14:49 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 51s) |
[production] |
14:48 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) |
[production] |
14:46 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 20%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57084 and previous config saved to /var/cache/conftool/dbconfig/20240219-144655-arnaudb.json |
[production] |