6401-6450 of 10000 results (90ms)
2024-02-19 ยง
15:13 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 28s) [production]
15:12 <marostegui@cumin1002> dbctl commit (dc=all): 'es1020 (re)pooling @ 100%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57094 and previous config saved to /var/cache/conftool/dbconfig/20240219-151246-root.json [production]
15:11 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
15:11 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 55s) [production]
15:11 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1224 (T357189)', diff saved to https://phabricator.wikimedia.org/P57093 and previous config saved to /var/cache/conftool/dbconfig/20240219-151127-arnaudb.json [production]
15:10 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply [production]
15:09 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply [production]
15:09 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
14:53 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 24s) [production]
14:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P57087 and previous config saved to /var/cache/conftool/dbconfig/20240219-145251-arnaudb.json [production]
14:51 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
14:51 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2136 (T352010)', diff saved to https://phabricator.wikimedia.org/P57086 and previous config saved to /var/cache/conftool/dbconfig/20240219-145119-ladsgroup.json [production]
14:51 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2136.codfw.wmnet with reason: Maintenance [production]
14:51 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2136.codfw.wmnet with reason: Maintenance [production]
14:50 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2119 (T352010)', diff saved to https://phabricator.wikimedia.org/P57085 and previous config saved to /var/cache/conftool/dbconfig/20240219-145057-ladsgroup.json [production]
14:49 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@e5ed8d0]: (no justification provided) (duration: 01m 51s) [production]
14:48 <jgiannelos@deploy2002> Started deploy [restbase/deploy@e5ed8d0]: (no justification provided) [production]
14:46 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 20%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57084 and previous config saved to /var/cache/conftool/dbconfig/20240219-144655-arnaudb.json [production]
14:44 <marostegui@cumin1002> dbctl commit (dc=all): 'db2170 (re)pooling @ 100%: After rearraging sections T354826', diff saved to https://phabricator.wikimedia.org/P57083 and previous config saved to /var/cache/conftool/dbconfig/20240219-144422-root.json [production]
14:42 <marostegui@cumin1002> dbctl commit (dc=all): 'es1020 (re)pooling @ 50%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57082 and previous config saved to /var/cache/conftool/dbconfig/20240219-144237-root.json [production]
14:37 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P57081 and previous config saved to /var/cache/conftool/dbconfig/20240219-143744-arnaudb.json [production]
14:37 <reedy@deploy2002> Finished scap: Fix casing of MediaWiki (duration: 09m 11s) [production]
14:35 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2119', diff saved to https://phabricator.wikimedia.org/P57080 and previous config saved to /var/cache/conftool/dbconfig/20240219-143550-ladsgroup.json [production]
14:31 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3316 (re)pooling @ 10%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57079 and previous config saved to /var/cache/conftool/dbconfig/20240219-143150-arnaudb.json [production]
14:31 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3317 (re)pooling @ 100%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57078 and previous config saved to /var/cache/conftool/dbconfig/20240219-143145-arnaudb.json [production]
14:29 <marostegui@cumin1002> dbctl commit (dc=all): 'db2170 (re)pooling @ 75%: After rearraging sections T354826', diff saved to https://phabricator.wikimedia.org/P57077 and previous config saved to /var/cache/conftool/dbconfig/20240219-142917-root.json [production]
14:28 <reedy@deploy2002> Started scap: Fix casing of MediaWiki [production]
14:27 <marostegui@cumin1002> dbctl commit (dc=all): 'es1020 (re)pooling @ 25%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57076 and previous config saved to /var/cache/conftool/dbconfig/20240219-142732-root.json [production]
14:22 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T357189)', diff saved to https://phabricator.wikimedia.org/P57075 and previous config saved to /var/cache/conftool/dbconfig/20240219-142238-arnaudb.json [production]
14:20 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:20 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2119', diff saved to https://phabricator.wikimedia.org/P57074 and previous config saved to /var/cache/conftool/dbconfig/20240219-142044-ladsgroup.json [production]
14:19 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:19 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:19 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db1201 (T357189)', diff saved to https://phabricator.wikimedia.org/P57073 and previous config saved to /var/cache/conftool/dbconfig/20240219-141919-arnaudb.json [production]
14:19 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:19 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:18 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T357189)', diff saved to https://phabricator.wikimedia.org/P57072 and previous config saved to /var/cache/conftool/dbconfig/20240219-141858-arnaudb.json [production]
14:18 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:18 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:18 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:16 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3317 (re)pooling @ 75%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57071 and previous config saved to /var/cache/conftool/dbconfig/20240219-141640-arnaudb.json [production]
14:14 <marostegui@cumin1002> dbctl commit (dc=all): 'db2170 (re)pooling @ 50%: After rearraging sections T354826', diff saved to https://phabricator.wikimedia.org/P57070 and previous config saved to /var/cache/conftool/dbconfig/20240219-141412-root.json [production]
14:12 <marostegui@cumin1002> dbctl commit (dc=all): 'es1020 (re)pooling @ 10%: After migration to 10.6', diff saved to https://phabricator.wikimedia.org/P57069 and previous config saved to /var/cache/conftool/dbconfig/20240219-141227-root.json [production]
14:05 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2119 (T352010)', diff saved to https://phabricator.wikimedia.org/P57068 and previous config saved to /var/cache/conftool/dbconfig/20240219-140538-ladsgroup.json [production]
14:03 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P57067 and previous config saved to /var/cache/conftool/dbconfig/20240219-140351-arnaudb.json [production]
14:01 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2169:3317 (re)pooling @ 50%: Cloning to db2194 done', diff saved to https://phabricator.wikimedia.org/P57066 and previous config saved to /var/cache/conftool/dbconfig/20240219-140135-arnaudb.json [production]
13:59 <marostegui@cumin1002> dbctl commit (dc=all): 'db2170 (re)pooling @ 25%: After rearraging sections T354826', diff saved to https://phabricator.wikimedia.org/P57065 and previous config saved to /var/cache/conftool/dbconfig/20240219-135907-root.json [production]
13:58 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on dbproxy1027.eqiad.wmnet with reason: Silence for reboot T356240 [production]
13:58 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on dbproxy1027.eqiad.wmnet with reason: Silence for reboot T356240 [production]
13:58 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on dbproxy1026.eqiad.wmnet with reason: Silence for reboot T356240 [production]