|
2023-10-09
ยง
|
| 22:54 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2125.codfw.wmnet with reason: Maintenance |
[production] |
| 22:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52872 and previous config saved to /var/cache/conftool/dbconfig/20231009-225407-arnaudb.json |
[production] |
| 22:39 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P52871 and previous config saved to /var/cache/conftool/dbconfig/20231009-223900-arnaudb.json |
[production] |
| 22:23 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P52870 and previous config saved to /var/cache/conftool/dbconfig/20231009-222354-arnaudb.json |
[production] |
| 22:08 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52869 and previous config saved to /var/cache/conftool/dbconfig/20231009-220848-arnaudb.json |
[production] |
| 20:42 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1156.eqiad.wmnet |
[production] |
| 20:34 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1156.eqiad.wmnet |
[production] |
| 20:34 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1155.eqiad.wmnet |
[production] |
| 20:26 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1155.eqiad.wmnet |
[production] |
| 20:26 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1154.eqiad.wmnet |
[production] |
| 20:17 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1154.eqiad.wmnet |
[production] |
| 20:17 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1153.eqiad.wmnet |
[production] |
| 20:09 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1153.eqiad.wmnet |
[production] |
| 20:09 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1152.eqiad.wmnet |
[production] |
| 20:02 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1152.eqiad.wmnet |
[production] |
| 20:02 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1151.eqiad.wmnet |
[production] |
| 19:54 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1151.eqiad.wmnet |
[production] |
| 19:54 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1150.eqiad.wmnet |
[production] |
| 19:47 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1150.eqiad.wmnet |
[production] |
| 19:47 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1149.eqiad.wmnet |
[production] |
| 19:40 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1149.eqiad.wmnet |
[production] |
| 19:40 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1148.eqiad.wmnet |
[production] |
| 19:32 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1148.eqiad.wmnet |
[production] |
| 19:32 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1147.eqiad.wmnet |
[production] |
| 19:32 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52868 and previous config saved to /var/cache/conftool/dbconfig/20231009-193219-arnaudb.json |
[production] |
| 19:32 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2104.codfw.wmnet with reason: Maintenance |
[production] |
| 19:31 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2104.codfw.wmnet with reason: Maintenance |
[production] |
| 19:24 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1147.eqiad.wmnet |
[production] |
| 19:23 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1146.eqiad.wmnet |
[production] |
| 19:16 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1146.eqiad.wmnet |
[production] |
| 19:16 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1145.eqiad.wmnet |
[production] |
| 19:08 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1145.eqiad.wmnet |
[production] |
| 19:08 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1144.eqiad.wmnet |
[production] |
| 19:01 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1144.eqiad.wmnet |
[production] |
| 19:01 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1143.eqiad.wmnet |
[production] |
| 18:55 |
<ladsgroup@deploy2002> |
Finished scap: Backport for [[gerrit:964570|Update interwiki cache]] (duration: 100m 07s) |
[production] |
| 18:54 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1143.eqiad.wmnet |
[production] |
| 18:54 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1142.eqiad.wmnet |
[production] |
| 18:49 |
<ladsgroup@deploy2002> |
ladsgroup: Continuing with sync |
[production] |
| 18:46 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1142.eqiad.wmnet |
[production] |
| 18:46 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1141.eqiad.wmnet |
[production] |
| 18:39 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1141.eqiad.wmnet |
[production] |
| 18:39 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1140.eqiad.wmnet |
[production] |
| 18:36 |
<mforns@deploy2002> |
Finished deploy [airflow-dags/analytics@c334eaf]: (no justification provided) (duration: 01m 12s) |
[production] |
| 18:35 |
<mforns@deploy2002> |
Started deploy [airflow-dags/analytics@c334eaf]: (no justification provided) |
[production] |
| 18:33 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1140.eqiad.wmnet |
[production] |
| 18:32 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1139.eqiad.wmnet |
[production] |
| 18:25 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1139.eqiad.wmnet |
[production] |
| 18:24 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1138.eqiad.wmnet |
[production] |
| 18:15 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1138.eqiad.wmnet |
[production] |