2021-02-05
ยง
|
13:23 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow3001.esams.wmnet |
[production] |
13:20 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host netflow3001.esams.wmnet |
[production] |
13:02 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow4001.ulsfo.wmnet |
[production] |
12:58 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host netflow4001.ulsfo.wmnet |
[production] |
12:58 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow5001.eqsin.wmnet |
[production] |
12:57 |
<moritzm> |
reset ifup on netflow5001 T273026 |
[production] |
12:49 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host netflow5001.eqsin.wmnet |
[production] |
12:47 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-corp1001.wikimedia.org |
[production] |
12:45 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host testreduce1001.eqiad.wmnet |
[production] |
12:42 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host testreduce1001.eqiad.wmnet |
[production] |
12:42 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-corp1001.wikimedia.org |
[production] |
12:40 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host releases1002.eqiad.wmnet |
[production] |
12:36 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host releases1002.eqiad.wmnet |
[production] |
12:35 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host releases2002.codfw.wmnet |
[production] |
12:29 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host releases2002.codfw.wmnet |
[production] |
12:18 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-corp2001.wikimedia.org |
[production] |
12:13 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-corp2001.wikimedia.org |
[production] |
12:11 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host parse2001.codfw.wmnet |
[production] |
12:10 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host people1002.eqiad.wmnet |
[production] |
12:10 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief1001.eqiad.wmnet |
[production] |
12:06 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host people1002.eqiad.wmnet |
[production] |
12:06 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief1001.eqiad.wmnet |
[production] |
12:05 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host parse2001.codfw.wmnet |
[production] |
12:04 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief2001.codfw.wmnet |
[production] |
12:00 |
<oblivian@deploy1001> |
Finished deploy [docker-pkg/deploy@7257244]: (no justification provided) (duration: 01m 00s) |
[production] |
11:59 |
<oblivian@deploy1001> |
Started deploy [docker-pkg/deploy@7257244]: (no justification provided) |
[production] |
11:59 |
<oblivian@deploy1001> |
Finished deploy [docker-pkg/deploy@7257244]: (no justification provided) (duration: 04m 04s) |
[production] |
11:55 |
<oblivian@deploy1001> |
Started deploy [docker-pkg/deploy@7257244]: (no justification provided) |
[production] |
11:55 |
<oblivian@deploy1001> |
Finished deploy [docker-pkg/deploy@7257244]: (no justification provided) (duration: 03m 25s) |
[production] |
11:51 |
<oblivian@deploy1001> |
Started deploy [docker-pkg/deploy@7257244]: (no justification provided) |
[production] |
11:50 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief2001.codfw.wmnet |
[production] |
11:44 |
<jayme@deploy1001> |
Finished deploy [docker-pkg/deploy@7257244]: (no justification provided) (duration: 05m 50s) |
[production] |
11:44 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test1001.eqiad.wmnet |
[production] |
11:39 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
11:39 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
11:39 |
<jayme@deploy1001> |
Started deploy [docker-pkg/deploy@7257244]: (no justification provided) |
[production] |
11:38 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief-test1001.eqiad.wmnet |
[production] |
11:34 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test2001.codfw.wmnet |
[production] |
11:30 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief-test2001.codfw.wmnet |
[production] |
11:29 |
<vgutierrez> |
restart acme-chief instances to catch up on kernel upgrades |
[production] |
11:27 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir3001.esams.wmnet |
[production] |
11:23 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host ncredir3001.esams.wmnet |
[production] |
11:22 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir3002.esams.wmnet |
[production] |
11:16 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host ncredir3002.esams.wmnet |
[production] |
11:14 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir1001.eqiad.wmnet |
[production] |
11:08 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host ncredir1001.eqiad.wmnet |
[production] |
11:06 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir1002.eqiad.wmnet |
[production] |
10:56 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host ncredir1002.eqiad.wmnet |
[production] |
10:53 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1075 (re)pooling @ 100%: Slowly pooling db1075 after cloning db1157', diff saved to https://phabricator.wikimedia.org/P14222 and previous config saved to /var/cache/conftool/dbconfig/20210205-105345-root.json |
[production] |
10:38 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1075 (re)pooling @ 75%: Slowly pooling db1075 after cloning db1157', diff saved to https://phabricator.wikimedia.org/P14221 and previous config saved to /var/cache/conftool/dbconfig/20210205-103841-root.json |
[production] |