1-50 of 10000 results (1ms)
2026-10-01 ยง
19:52 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1347711|Add missing select of fr_timestamp]] (duration: 09m 40s) [production]
19:51 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
19:51 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
19:48 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
19:46 <zabe@deploy1003> zabe: Continuing with deployment [production]
19:46 <zabe@deploy1003> zabe: Backport for [[gerrit:1347711|Add missing select of fr_timestamp]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:42 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1347711|Add missing select of fr_timestamp]] [production]
19:42 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1347672|Move reads/writes of wbc_entity_usage to x1 for s5 wikis (T439753)]] (duration: 10m 01s) [production]
19:36 <zabe@deploy1003> zabe: Continuing with deployment [production]
19:36 <zabe@deploy1003> zabe: Backport for [[gerrit:1347672|Move reads/writes of wbc_entity_usage to x1 for s5 wikis (T439753)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:32 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1347672|Move reads/writes of wbc_entity_usage to x1 for s5 wikis (T439753)]] [production]
19:27 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) [admin]
19:19 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
19:19 <jhathaway> puppet re-enabled [production]
19:08 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) [admin]
19:08 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
19:02 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
19:02 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
18:51 <damilare> civicrm upgraded from cb812976 to 40a4588a [fundraising]
18:42 <brett@cumin1004> END (FAIL) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=1) rolling upgrade of Varnish on A:cp-text_eqiad - 7.1.1-2~bpo13+wmf3 () [production]
18:40 <brennen@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.22 refs T438218 [production]
18:36 <jhathaway> disabling puppet fleet wide to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/1347689 [production]
18:25 <brennen> 1.47.0-wmf.22 train status (T438218): logs kind of a mess, but no current blockers, rolling to all wikis [production]
18:22 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) [admin]
18:17 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) [admin]
18:16 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
18:16 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply [production]
18:12 <brett@cumin1004> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload_eqiad - 7.1.1-2~bpo13+wmf3 () [production]
17:55 <swfrench@deploy1003> Finished scap deploy-service shellbox: Test deploy-service configuration for Shellbox (duration: 03m 28s) [production]
17:55 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
17:55 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:55 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
17:54 <spiderpig@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:53 <spiderpig@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-video: apply [production]