1-50 of 10000 results (56ms)
2026-08-31 §
08:58 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on 22 hosts with reason: Cloning [production]
08:58 <marostegui> Stop mariadb on sanitarium s2,s4,s6,s7 there will be lag on wikireplicas for those sections T407942 [production]
08:57 <hashar> Upgrading CI Jenkins 2.555.3 to 2.568.2 [production]
08:56 <mvernon@cumin2003> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe [production]
08:49 <moritzm> installing emacs security updates [production]
08:43 <mvernon@cumin2003> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies (exit_code=0) rolling restart_daemons on A:thanos-fe [production]
08:42 <elukey@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts pki1002.eqiad.wmnet [production]
08:39 <mvernon@cumin2003> START - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies rolling restart_daemons on A:thanos-fe [production]
08:39 <mvernon@cumin2003> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe [production]
08:01 <moritzm> installing Linux 6.12.107 on Trixie hosts [production]
07:41 <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] (duration: 07m 41s) [production]
07:38 <kartik@deploy1003> hamishz, kartik: Rolling back deployment [production]
07:37 <kartik@deploy1003> hamishz, kartik: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:33 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] [production]
07:31 <moritzm> installing openssl security updates [production]
07:30 <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] (duration: 15m 00s) [production]
07:22 <kartik@deploy1003> kartik, revi: Continuing with deployment [production]
07:21 <jelto@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
07:20 <jelto@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
07:19 <kartik@deploy1003> kartik, revi: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:15 <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] [production]
07:05 <brouberol@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
07:04 <brouberol@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
03:44 <tstarling@deploy1003> Finished scap sync-world: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] (duration: 33m 20s) [production]
03:31 <tstarling@deploy1003> tstarling: Continuing with deployment [production]
03:29 <tstarling@deploy1003> tstarling: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
03:11 <tstarling@deploy1003> Started scap sync-world: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] [production]
02:08 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 08m 15s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-08-30 §
02:07 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 07m 34s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-08-29 §
02:08 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 07m 35s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-08-28 §
21:16 <ryankemper> T415073 admin_ng namespace-certificates applied on `staging-codfw`, `staging-eqiad`, `codfw`, `eqiad`; `wikidata-query-gui` cert reissued without `query-legacy-full.wikidata.org` SAN, verified on the wire in both DCs [production]
21:08 <ryankemper@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:07 <ryankemper@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:07 <ryankemper@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
21:07 <ryankemper@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
21:07 <ryankemper@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
21:07 <ryankemper@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
21:06 <ryankemper@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
21:06 <ryankemper@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
21:05 <ryankemper> T415073 beginning admin_ng namespace-certificates rollout (gerrit 1278562, drop query-legacy-full.wikidata.org SAN from wikidata-query-gui cert), starting with staging [production]
20:05 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]
20:04 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply [production]
19:47 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]
19:45 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply [production]
19:45 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]
19:44 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply [production]
19:43 <lerickson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]