|
2023-10-10
§
|
| 08:09 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db2187.codfw.wmnet with reason: Maintenance |
[production] |
| 08:09 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2126.codfw.wmnet with reason: Maintenance |
[production] |
| 08:08 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2126.codfw.wmnet with reason: Maintenance |
[production] |
| 08:08 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2125 (T343198)', diff saved to https://phabricator.wikimedia.org/P52878 and previous config saved to /var/cache/conftool/dbconfig/20231010-080847-arnaudb.json |
[production] |
| 08:00 |
<kevinbazira@deploy2002> |
helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . |
[production] |
| 07:53 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2125', diff saved to https://phabricator.wikimedia.org/P52877 and previous config saved to /var/cache/conftool/dbconfig/20231010-075340-arnaudb.json |
[production] |
| 07:38 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2125', diff saved to https://phabricator.wikimedia.org/P52876 and previous config saved to /var/cache/conftool/dbconfig/20231010-073834-arnaudb.json |
[production] |
| 07:23 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2125 (T343198)', diff saved to https://phabricator.wikimedia.org/P52875 and previous config saved to /var/cache/conftool/dbconfig/20231010-072327-arnaudb.json |
[production] |
| 07:19 |
<kostajh> |
UTC morning deploys done |
[production] |
| 07:18 |
<kharlan@deploy2002> |
Finished scap: Backport for [[gerrit:964575|ReportIncident: Set developer mode to false]] (duration: 10m 17s) |
[production] |
| 07:12 |
<kharlan@deploy2002> |
kharlan: Continuing with sync |
[production] |
| 07:09 |
<kharlan@deploy2002> |
kharlan: Backport for [[gerrit:964575|ReportIncident: Set developer mode to false]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 07:08 |
<kharlan@deploy2002> |
Started scap: Backport for [[gerrit:964575|ReportIncident: Set developer mode to false]] |
[production] |
| 06:42 |
<moritzm> |
installing qemu security updates on bookworm |
[production] |
| 03:54 |
<mwpresync@deploy2002> |
Pruned MediaWiki: 1.41.0-wmf.28 (duration: 02m 08s) |
[production] |
| 03:52 |
<mwpresync@deploy2002> |
Finished scap: testwikis wikis to 1.41.0-wmf.30 refs T347081 (duration: 49m 56s) |
[production] |
| 03:02 |
<mwpresync@deploy2002> |
Started scap: testwikis wikis to 1.41.0-wmf.30 refs T347081 |
[production] |
|
2023-10-09
§
|
| 22:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2125 (T343198)', diff saved to https://phabricator.wikimedia.org/P52873 and previous config saved to /var/cache/conftool/dbconfig/20231009-225429-arnaudb.json |
[production] |
| 22:54 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2125.codfw.wmnet with reason: Maintenance |
[production] |
| 22:54 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2125.codfw.wmnet with reason: Maintenance |
[production] |
| 22:54 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52872 and previous config saved to /var/cache/conftool/dbconfig/20231009-225407-arnaudb.json |
[production] |
| 22:39 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P52871 and previous config saved to /var/cache/conftool/dbconfig/20231009-223900-arnaudb.json |
[production] |
| 22:23 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104', diff saved to https://phabricator.wikimedia.org/P52870 and previous config saved to /var/cache/conftool/dbconfig/20231009-222354-arnaudb.json |
[production] |
| 22:08 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52869 and previous config saved to /var/cache/conftool/dbconfig/20231009-220848-arnaudb.json |
[production] |
| 20:42 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1156.eqiad.wmnet |
[production] |
| 20:34 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1156.eqiad.wmnet |
[production] |
| 20:34 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1155.eqiad.wmnet |
[production] |
| 20:26 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1155.eqiad.wmnet |
[production] |
| 20:26 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1154.eqiad.wmnet |
[production] |
| 20:17 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1154.eqiad.wmnet |
[production] |
| 20:17 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1153.eqiad.wmnet |
[production] |
| 20:09 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1153.eqiad.wmnet |
[production] |
| 20:09 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1152.eqiad.wmnet |
[production] |
| 20:02 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1152.eqiad.wmnet |
[production] |
| 20:02 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1151.eqiad.wmnet |
[production] |
| 19:54 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1151.eqiad.wmnet |
[production] |
| 19:54 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1150.eqiad.wmnet |
[production] |
| 19:47 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1150.eqiad.wmnet |
[production] |
| 19:47 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1149.eqiad.wmnet |
[production] |
| 19:40 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1149.eqiad.wmnet |
[production] |
| 19:40 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1148.eqiad.wmnet |
[production] |
| 19:32 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1148.eqiad.wmnet |
[production] |
| 19:32 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1147.eqiad.wmnet |
[production] |
| 19:32 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2104 (T343198)', diff saved to https://phabricator.wikimedia.org/P52868 and previous config saved to /var/cache/conftool/dbconfig/20231009-193219-arnaudb.json |
[production] |
| 19:32 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2104.codfw.wmnet with reason: Maintenance |
[production] |
| 19:31 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2104.codfw.wmnet with reason: Maintenance |
[production] |
| 19:24 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1147.eqiad.wmnet |
[production] |
| 19:23 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1146.eqiad.wmnet |
[production] |
| 19:16 |
<btullis@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-worker1146.eqiad.wmnet |
[production] |
| 19:16 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1145.eqiad.wmnet |
[production] |