|
2024-11-04
ยง
|
| 14:41 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db1177 (T376905)', diff saved to https://phabricator.wikimedia.org/P70871 and previous config saved to /var/cache/conftool/dbconfig/20241104-144101-ladsgroup.json |
[production] |
| 14:40 |
<ladsgroup@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1177.eqiad.wmnet with reason: Maintenance |
[production] |
| 14:40 |
<ladsgroup@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1177.eqiad.wmnet with reason: Maintenance |
[production] |
| 14:40 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1172 (T376905)', diff saved to https://phabricator.wikimedia.org/P70870 and previous config saved to /var/cache/conftool/dbconfig/20241104-144037-ladsgroup.json |
[production] |
| 14:40 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-8 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:40 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-76 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:39 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-76 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:38 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-75 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:38 |
<Lucas_WMDE> |
UTC afternoon backport+config window done |
[production] |
| 14:37 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-75 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:37 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-74 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:36 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-74 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:36 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-73 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:36 |
<lucaswerkmeister-wmde@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1084765|Exclude affiliates from P&E dashboard integration for CampaignEvents Extension (T377252)]] (duration: 23m 39s) |
[production] |
| 14:35 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-73 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:35 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-72 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:34 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-72 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:34 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-71 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:33 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-71 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:33 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-70 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:32 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-70 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:32 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-7 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:29 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-69 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:29 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-68 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:28 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-68 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:28 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-67 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:28 |
<lucaswerkmeister-wmde@deploy2002> |
mhorsey, lucaswerkmeister-wmde: Continuing with sync |
[production] |
| 14:27 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-67 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:27 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-66 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:26 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-66 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:26 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-65 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:25 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P70869 and previous config saved to /var/cache/conftool/dbconfig/20241104-142530-ladsgroup.json |
[production] |
| 14:25 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-65 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:25 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-61 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:24 |
<moritzm> |
uploaded php7.4 7.4.33-1+0~20221108.73+debian10~1.gbpa00350a+wmf10u2+icu67u3 to component/icu67 (backports of latest security fixes to our PHP 7.4 build) |
[production] |
| 14:24 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-61 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:23 |
<lucaswerkmeister-wmde@deploy2002> |
mhorsey, lucaswerkmeister-wmde: Backport for [[gerrit:1084765|Exclude affiliates from P&E dashboard integration for CampaignEvents Extension (T377252)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 14:20 |
<raymond-ndibe@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=99) for node tools-k8s-worker-nfs-61 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:14 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-61 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:14 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-worker-nfs-58 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:13 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-worker-nfs-58 from 1.27.16 to 1.28.14 (T362867) |
[tools] |
| 14:12 |
<lucaswerkmeister-wmde@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1084765|Exclude affiliates from P&E dashboard integration for CampaignEvents Extension (T377252)]] |
[production] |
| 14:11 |
<aborrero@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) |
[admin] |
| 14:10 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack |
[admin] |
| 14:10 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1172', diff saved to https://phabricator.wikimedia.org/P70868 and previous config saved to /var/cache/conftool/dbconfig/20241104-141023-ladsgroup.json |
[production] |
| 14:09 |
<aborrero@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) |
[admin] |
| 14:09 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack |
[admin] |
| 14:08 |
<aborrero@cloudcumin2001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) |
[admin] |
| 14:08 |
<aborrero@cloudcumin2001> |
START - Cookbook wmcs.openstack.restart_openstack |
[admin] |
| 14:08 |
<raymond-ndibe@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=99) for node tools-k8s-worker-nfs-58 from 1.27.16 to 1.28.14 (T362867) |
[tools] |