2023-02-06
ยง
|
12:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43646 and previous config saved to /var/cache/conftool/dbconfig/20230206-124629-root.json |
[production] |
12:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43645 and previous config saved to /var/cache/conftool/dbconfig/20230206-124617-root.json |
[production] |
12:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43644 and previous config saved to /var/cache/conftool/dbconfig/20230206-124513-root.json |
[production] |
12:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43643 and previous config saved to /var/cache/conftool/dbconfig/20230206-124506-root.json |
[production] |
12:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43642 and previous config saved to /var/cache/conftool/dbconfig/20230206-123124-root.json |
[production] |
12:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43641 and previous config saved to /var/cache/conftool/dbconfig/20230206-123112-root.json |
[production] |
12:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43640 and previous config saved to /var/cache/conftool/dbconfig/20230206-123007-root.json |
[production] |
12:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43639 and previous config saved to /var/cache/conftool/dbconfig/20230206-123001-root.json |
[production] |
12:16 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P43638 and previous config saved to /var/cache/conftool/dbconfig/20230206-121619-root.json |
[production] |
12:16 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P43637 and previous config saved to /var/cache/conftool/dbconfig/20230206-121608-root.json |
[production] |
12:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P43636 and previous config saved to /var/cache/conftool/dbconfig/20230206-121503-root.json |
[production] |
12:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P43635 and previous config saved to /var/cache/conftool/dbconfig/20230206-121456-root.json |
[production] |
12:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P43634 and previous config saved to /var/cache/conftool/dbconfig/20230206-120114-root.json |
[production] |
12:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P43633 and previous config saved to /var/cache/conftool/dbconfig/20230206-120103-root.json |
[production] |
11:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P43631 and previous config saved to /var/cache/conftool/dbconfig/20230206-115958-root.json |
[production] |
11:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P43630 and previous config saved to /var/cache/conftool/dbconfig/20230206-115951-root.json |
[production] |
11:58 |
<btullis@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host db1108.eqiad.wmnet |
[production] |
11:47 |
<jbond> |
puppetmaster[12]002 reintroduced to services |
[production] |
11:46 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host db1108.eqiad.wmnet |
[production] |
11:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P43629 and previous config saved to /var/cache/conftool/dbconfig/20230206-114609-root.json |
[production] |
11:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P43628 and previous config saved to /var/cache/conftool/dbconfig/20230206-114558-root.json |
[production] |
11:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P43627 and previous config saved to /var/cache/conftool/dbconfig/20230206-114453-root.json |
[production] |
11:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P43626 and previous config saved to /var/cache/conftool/dbconfig/20230206-114446-root.json |
[production] |
11:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2156 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P43625 and previous config saved to /var/cache/conftool/dbconfig/20230206-113104-root.json |
[production] |
11:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2105 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P43624 and previous config saved to /var/cache/conftool/dbconfig/20230206-113053-root.json |
[production] |
11:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2126 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P43623 and previous config saved to /var/cache/conftool/dbconfig/20230206-112948-root.json |
[production] |
11:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db2130 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P43622 and previous config saved to /var/cache/conftool/dbconfig/20230206-112942-root.json |
[production] |
11:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2028 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43621 and previous config saved to /var/cache/conftool/dbconfig/20230206-112900-root.json |
[production] |
11:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2027 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43620 and previous config saved to /var/cache/conftool/dbconfig/20230206-112856-root.json |
[production] |
11:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2026 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43619 and previous config saved to /var/cache/conftool/dbconfig/20230206-112839-root.json |
[production] |
11:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2024 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43618 and previous config saved to /var/cache/conftool/dbconfig/20230206-112832-root.json |
[production] |
11:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2020 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P43617 and previous config saved to /var/cache/conftool/dbconfig/20230206-112825-root.json |
[production] |
11:28 |
<cgoubert@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on puppetmaster2002.codfw.wmnet,puppetmaster1002.eqiad.wmnet with reason: Decom |
[production] |
11:27 |
<cgoubert@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on puppetmaster2002.codfw.wmnet,puppetmaster1002.eqiad.wmnet with reason: Decom |
[production] |
11:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2028 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43616 and previous config saved to /var/cache/conftool/dbconfig/20230206-111356-root.json |
[production] |
11:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2027 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43615 and previous config saved to /var/cache/conftool/dbconfig/20230206-111351-root.json |
[production] |
11:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2026 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43614 and previous config saved to /var/cache/conftool/dbconfig/20230206-111334-root.json |
[production] |
11:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2024 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43613 and previous config saved to /var/cache/conftool/dbconfig/20230206-111327-root.json |
[production] |
11:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2020 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P43612 and previous config saved to /var/cache/conftool/dbconfig/20230206-111320-root.json |
[production] |
11:03 |
<akosiaris@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: apply |
[production] |
11:03 |
<akosiaris@deploy1002> |
helmfile [eqiad] START helmfile.d/services/changeprop: apply |
[production] |
11:03 |
<akosiaris> |
deploy changeprop 0.10.19, adding wikivoyage to list of domains the mobile-sections get rerendered for. T226931 |
[production] |
11:03 |
<akosiaris@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/changeprop: apply |
[production] |
11:02 |
<akosiaris@deploy1002> |
helmfile [codfw] START helmfile.d/services/changeprop: apply |
[production] |
11:01 |
<akosiaris@deploy1002> |
helmfile [staging] DONE helmfile.d/services/changeprop: apply |
[production] |
11:01 |
<akosiaris@deploy1002> |
helmfile [staging] START helmfile.d/services/changeprop: apply |
[production] |
10:59 |
<akosiaris@deploy1002> |
helmfile [staging] START helmfile.d/services/changeprop: apply |
[production] |
10:58 |
<akosiaris@deploy1002> |
helmfile [staging] START helmfile.d/services/changeprop: apply |
[production] |
10:58 |
<akosiaris@deploy1002> |
helmfile [staging] DONE helmfile.d/services/changeprop: apply |
[production] |
10:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es2028 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P43610 and previous config saved to /var/cache/conftool/dbconfig/20230206-105851-root.json |
[production] |