301-350 of 10000 results (117ms)
2025-03-31 §
08:04 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7015.magru.wmnet [production]
08:03 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
08:03 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host cumin1003.eqiad.wmnet [production]
08:02 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:02 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
07:59 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7015.magru.wmnet [production]
07:59 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7007.magru.wmnet [production]
07:54 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7006.magru.wmnet [production]
07:54 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7014.magru.wmnet [production]
07:50 <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] [production]
07:49 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
07:48 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7014.magru.wmnet [production]
07:48 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7006.magru.wmnet [production]
07:48 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4006.ulsfo.wmnet [production]
07:46 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7005.magru.wmnet [production]
07:46 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
07:45 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7013.magru.wmnet [production]
07:41 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7013.magru.wmnet [production]
07:41 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7005.magru.wmnet [production]
07:40 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7004.magru.wmnet [production]
07:38 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7012.magru.wmnet [production]
07:36 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply [production]
07:36 <isaranto@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
07:35 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply [production]
07:34 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7012.magru.wmnet [production]
07:34 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7004.magru.wmnet [production]
07:33 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7003.magru.wmnet [production]
07:33 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7011.magru.wmnet [production]
07:32 <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] [production]
07:32 <brouberol@deploy1003> Finished scap build-images: T390059 - Prevent stub provider from going in an infinite loop (duration: 10m 57s) [production]
07:28 <kevinbazira@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:27 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7011.magru.wmnet [production]
07:27 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7003.magru.wmnet [production]
07:24 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7010.magru.wmnet [production]
07:24 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7002.magru.wmnet [production]
07:21 <brouberol@deploy1003> Started scap build-images: T390059 - Prevent stub provider from going in an infinite loop [production]
07:19 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7010.magru.wmnet [production]
07:19 <volans> upgrade python3-wmflib to v1.3.1 fleetwide [production]
07:18 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:17 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7002.magru.wmnet [production]
07:12 <volans> upgraded python3-wmflib to v1.3.1 on cumin[12]002 [production]
07:08 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:06 <fabfur> deploying https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131705 on A:cp-magru (T384227) [production]
2025-03-29 §
17:00 <isaranto@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revision-models' for release 'main' . [production]
15:51 <oblivian@cumin1002> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) pool swift in eqiad: maintenance [production]
15:47 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad [production]
15:46 <oblivian@cumin1002> START - Cookbook sre.discovery.service-route pool swift in eqiad: maintenance [production]
15:44 <mvernon@cumin1002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad [production]
15:42 <oblivian@cumin1002> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) depool swift in eqiad: maintenance [production]
15:37 <oblivian@cumin1002> START - Cookbook sre.discovery.service-route depool swift in eqiad: maintenance [production]