|
2025-12-05
ยง
|
| 13:46 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply |
[production] |
| 13:43 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-growthbook: apply |
[production] |
| 13:43 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-growthbook: apply |
[production] |
| 13:41 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook: apply |
[production] |
| 13:39 |
<James_F> |
Docker: [helm-linter] Bump for Envoy 1.35.7, for T410975 |
[releng] |
| 13:33 |
<btullis@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply |
[production] |
| 13:31 |
<James_F> |
Zuul: [operations/puppet] Stop running PCC with Puppet 5, for T367399 |
[releng] |
| 13:30 |
<btullis@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply |
[production] |
| 13:10 |
<moritzm> |
upload python3-sshpubkeys to 3.3.1-1~wmf12u1 to apt.wikimedia.org T411816 |
[production] |
| 12:42 |
<moritzm> |
upgrade python3-sshpubkeys on idm-test1001 to 3.3.1-1~wmf12u1 T411816 |
[production] |
| 12:30 |
<jayme> |
removed helm release mw-script/utk6lsuw in k8s@codfw which was in stuck in pending-install state since 9+ days |
[production] |
| 11:53 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 11:52 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 11:42 |
<lucaswerkmeister-wmde@deploy2002> |
kubectl delete job wikidata-resubmit-changes-for-dispatch-29415459 # T411862 |
[production] |
| 11:42 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1233.eqiad.wmnet onto db1229.eqiad.wmnet |
[production] |
| 11:26 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1233 gradually with 4 steps - Pool db1233.eqiad.wmnet in after cloning |
[production] |
| 10:41 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool db1233 gradually with 4 steps - Pool db1233.eqiad.wmnet in after cloning |
[production] |
| 10:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 10:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 09:59 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 09:58 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 09:16 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1233 - Depool db1233.eqiad.wmnet to then clone it to db1229.eqiad.wmnet - fceratto@cumin1003 |
[production] |
| 09:16 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.depool db1233 - Depool db1233.eqiad.wmnet to then clone it to db1229.eqiad.wmnet - fceratto@cumin1003 |
[production] |
| 09:16 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.clone of db1233.eqiad.wmnet onto db1229.eqiad.wmnet |
[production] |
| 08:04 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply |
[production] |
| 08:03 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply |
[production] |
| 08:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply |
[production] |
| 08:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply |
[production] |
| 08:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply |
[production] |
| 08:02 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply |
[production] |
| 07:28 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply |
[production] |
| 07:27 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply |
[production] |
| 03:24 |
<larssandergreen> |
Updating civicrm from 7a979750 to 9cc43ebd |
[production] |
| 03:08 |
<larssandergreen> |
Updating civicrm from 36b09796 to 7a979750 |
[production] |
| 02:57 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1175 (T410589)', diff saved to https://phabricator.wikimedia.org/P86417 and previous config saved to /var/cache/conftool/dbconfig/20251205-025711-ladsgroup.json |
[production] |
| 02:57 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1175.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:56 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T410589)', diff saved to https://phabricator.wikimedia.org/P86416 and previous config saved to /var/cache/conftool/dbconfig/20251205-025647-ladsgroup.json |
[production] |
| 02:41 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P86415 and previous config saved to /var/cache/conftool/dbconfig/20251205-024139-ladsgroup.json |
[production] |
| 02:40 |
<ejegg> |
payments-wiki upgraded from 9ab44e85 to 5c381b45 |
[production] |
| 02:26 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P86414 and previous config saved to /var/cache/conftool/dbconfig/20251205-022631-ladsgroup.json |
[production] |
| 02:11 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T410589)', diff saved to https://phabricator.wikimedia.org/P86413 and previous config saved to /var/cache/conftool/dbconfig/20251205-021123-ladsgroup.json |
[production] |
| 02:09 |
<wfan> |
donorwiki upgraded from 053b3f88 to 9ab44e85 |
[production] |
| 02:07 |
<wfan> |
payments-wiki upgraded from d2799b95 to 9ab44e85 |
[production] |
| 02:01 |
<rzl> |
rzl@apt1002:~$ sudo -i reprepro -C component/envoy-future include bullseye-wikimedia /home/rzl/envoyproxy_1.35.7-1_amd64.changes |
[production] |
| 01:44 |
<wfan> |
SmashPig upgraded from a25fbb28 to 1442d0a0 |
[production] |
| 01:41 |
<eileen> |
civicrm upgraded from d4bd9b1b to 36b09796 |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 13m 06s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:27 |
<Amir1> |
ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki huwikiquote --mark "Corrupted UTF-8 (T351953)" --revisions 3804,3808,3811,3813,3814,3818,3825 |
[production] |
| 00:26 |
<Amir1> |
ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki guwiktionary --mark "Corrupted UTF-8 (T351953)" --revisions 20576 |
[production] |