6301-6350 of 10000 results (101ms)
2024-02-19 ยง
16:21 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
16:19 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194:3317 (re)pooling @ 4%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57111 and previous config saved to /var/cache/conftool/dbconfig/20240219-161914-arnaudb.json [production]
16:19 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 00m 07s) [production]
16:18 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
16:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1231', diff saved to https://phabricator.wikimedia.org/P57110 and previous config saved to /var/cache/conftool/dbconfig/20240219-161756-arnaudb.json [production]
16:17 <jgiannelos@deploy2002> deploy aborted: Deploy latest restbase config in all nodes (duration: 00m 04s) [production]
16:16 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Deploy latest restbase config in all nodes [production]
16:14 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 00m 08s) [production]
16:14 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
16:09 <marostegui@cumin1002> dbctl commit (dc=all): 'db1213 (re)pooling @ 25%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57109 and previous config saved to /var/cache/conftool/dbconfig/20240219-160948-root.json [production]
16:04 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 00m 23s) [production]
16:04 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
16:04 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194:3317 (re)pooling @ 2%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57108 and previous config saved to /var/cache/conftool/dbconfig/20240219-160409-arnaudb.json [production]
16:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1231 (T357189)', diff saved to https://phabricator.wikimedia.org/P57107 and previous config saved to /var/cache/conftool/dbconfig/20240219-160249-arnaudb.json [production]
16:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 100%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57106 and previous config saved to /var/cache/conftool/dbconfig/20240219-160221-arnaudb.json [production]
15:59 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db1231 (T357189)', diff saved to https://phabricator.wikimedia.org/P57105 and previous config saved to /var/cache/conftool/dbconfig/20240219-155936-arnaudb.json [production]
15:59 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1231.eqiad.wmnet with reason: Maintenance [production]
15:59 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1231.eqiad.wmnet with reason: Maintenance [production]
15:59 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2029:2032] (duration: 02m 56s) [production]
15:57 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
15:57 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
15:57 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224 (T357189)', diff saved to https://phabricator.wikimedia.org/P57104 and previous config saved to /var/cache/conftool/dbconfig/20240219-155702-arnaudb.json [production]
15:56 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2029:2032] [production]
15:55 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1027:1030] (duration: 04m 11s) [production]
15:54 <marostegui@cumin1002> dbctl commit (dc=all): 'db1213 (re)pooling @ 10%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57103 and previous config saved to /var/cache/conftool/dbconfig/20240219-155443-root.json [production]
15:51 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1027:1030] [production]
15:49 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194:3317 (re)pooling @ 1%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57102 and previous config saved to /var/cache/conftool/dbconfig/20240219-154904-arnaudb.json [production]
15:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 75%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57101 and previous config saved to /var/cache/conftool/dbconfig/20240219-154716-arnaudb.json [production]
15:41 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224', diff saved to https://phabricator.wikimedia.org/P57100 and previous config saved to /var/cache/conftool/dbconfig/20240219-154154-arnaudb.json [production]
15:41 <arnaudb@cumin1002> dbctl commit (dc=all): 'T343674 - db2194 missing config', diff saved to https://phabricator.wikimedia.org/P57099 and previous config saved to /var/cache/conftool/dbconfig/20240219-154148-arnaudb.json [production]
15:41 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1213.eqiad.wmnet with OS bookworm [production]
15:39 <marostegui@cumin1002> dbctl commit (dc=all): 'db1213 (re)pooling @ 5%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57098 and previous config saved to /var/cache/conftool/dbconfig/20240219-153938-root.json [production]
15:37 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2025:2028] (duration: 01m 28s) [production]
15:36 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[2025:2028] [production]
15:35 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase1026 (duration: 01m 55s) [production]
15:33 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase1026 [production]
15:33 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1023:1025] (duration: 01m 57s) [production]
15:32 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 50%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57097 and previous config saved to /var/cache/conftool/dbconfig/20240219-153211-arnaudb.json [production]
15:31 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase[1023:1025] [production]
15:26 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224', diff saved to https://phabricator.wikimedia.org/P57096 and previous config saved to /var/cache/conftool/dbconfig/20240219-152634-arnaudb.json [production]
15:24 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase2024 (duration: 01m 24s) [production]
15:23 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:22 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: Disable parsoid storage on restbase2024 [production]
15:22 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:1000292|Increase move rate limit for extendedmovers in arwiki to 16/60 (T357229)]] (duration: 24m 34s) [production]
15:22 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1213.eqiad.wmnet with reason: host reimage [production]
15:22 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 30s) [production]
15:20 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
15:19 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1213.eqiad.wmnet with reason: host reimage [production]
15:19 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 54s) [production]
15:17 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]