2025-03-31
§
|
08:03 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.makevm for new host cumin1003.eqiad.wmnet |
[production] |
08:02 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
08:02 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. |
[production] |
07:59 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7015.magru.wmnet |
[production] |
07:59 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7007.magru.wmnet |
[production] |
07:54 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7006.magru.wmnet |
[production] |
07:54 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7014.magru.wmnet |
[production] |
07:50 |
<dcausse@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] |
[production] |
07:49 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet |
[production] |
07:48 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7014.magru.wmnet |
[production] |
07:48 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7006.magru.wmnet |
[production] |
07:48 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4006.ulsfo.wmnet |
[production] |
07:46 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7005.magru.wmnet |
[production] |
07:46 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet |
[production] |
07:45 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7013.magru.wmnet |
[production] |
07:41 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7013.magru.wmnet |
[production] |
07:41 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7005.magru.wmnet |
[production] |
07:40 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7004.magru.wmnet |
[production] |
07:38 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7012.magru.wmnet |
[production] |
07:36 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply |
[production] |
07:36 |
<isaranto@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
07:35 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply |
[production] |
07:34 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7012.magru.wmnet |
[production] |
07:34 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7004.magru.wmnet |
[production] |
07:33 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7003.magru.wmnet |
[production] |
07:33 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7011.magru.wmnet |
[production] |
07:32 |
<dcausse@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] |
[production] |
07:32 |
<brouberol@deploy1003> |
Finished scap build-images: T390059 - Prevent stub provider from going in an infinite loop (duration: 10m 57s) |
[production] |
07:28 |
<kevinbazira@deploy1003> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . |
[production] |
07:27 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7011.magru.wmnet |
[production] |
07:27 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7003.magru.wmnet |
[production] |
07:24 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7010.magru.wmnet |
[production] |
07:24 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp7002.magru.wmnet |
[production] |
07:21 |
<brouberol@deploy1003> |
Started scap build-images: T390059 - Prevent stub provider from going in an infinite loop |
[production] |
07:19 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7010.magru.wmnet |
[production] |
07:19 |
<volans> |
upgrade python3-wmflib to v1.3.1 fleetwide |
[production] |
07:18 |
<kevinbazira@deploy1003> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'article-models' for release 'main' . |
[production] |
07:17 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp7002.magru.wmnet |
[production] |
07:12 |
<volans> |
upgraded python3-wmflib to v1.3.1 on cumin[12]002 |
[production] |
07:08 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . |
[production] |
07:06 |
<fabfur> |
deploying https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131705 on A:cp-magru (T384227) |
[production] |
2025-03-29
§
|
21:15 |
<wmbot~lucaswerkmeister@tools-bastion-13> |
deployed 98e408e5a6 (Russian perfective verbs) |
[tools.lexeme-forms] |
17:00 |
<isaranto@deploy1003> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revision-models' for release 'main' . |
[production] |
15:51 |
<oblivian@cumin1002> |
END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) pool swift in eqiad: maintenance |
[production] |
15:47 |
<mvernon@cumin1002> |
END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad |
[production] |
15:46 |
<oblivian@cumin1002> |
START - Cookbook sre.discovery.service-route pool swift in eqiad: maintenance |
[production] |
15:44 |
<mvernon@cumin1002> |
START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad |
[production] |
15:42 |
<oblivian@cumin1002> |
END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) depool swift in eqiad: maintenance |
[production] |
15:37 |
<oblivian@cumin1002> |
START - Cookbook sre.discovery.service-route depool swift in eqiad: maintenance |
[production] |