1301-1350 of 10000 results (29ms)
2026-05-18 ยง
21:38 <krinkle@deploy1003> seddon, krinkle: Continuing with deployment [production]
21:32 <krinkle@deploy1003> seddon, krinkle: Backport for [[gerrit:1288925|Revert "Enable wgTrackMediaRequestProvenance on Commons" (T414338 T425580)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:31 <krinkle@deploy1003> Started scap sync-world: Backport for [[gerrit:1288925|Revert "Enable wgTrackMediaRequestProvenance on Commons" (T414338 T425580)]] [production]
21:28 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2190.codfw.wmnet [production]
21:28 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2190.codfw.wmnet [production]
21:16 <mutante> gerrit-replica.wikimedia.org back online [production]
21:14 <dzahn@cumin2002> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:15:00 on gerrit-replica.wikimedia.org with reason: T426563 [production]
21:12 <James_F> Zuul: [operations/software/gerrit] Add Node26 as experimental [releng]
21:10 <mutante> gerrit-replica.wikimedia.org, gerrit-spare.wikimedia.org - rebooting backends [releng]
21:10 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit2002.wikimedia.org with reason: T426563 [production]
21:10 <mutante> gerrit-replica.wikimedia.org, gerrit-spare.wikimedia.org - rebooting backends [production]
21:09 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit1003.wikimedia.org with reason: T426563 [production]
20:57 <James_F> Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [releng]
20:56 <James_F> Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8. [releng]
20:45 <eileen> civicrm upgraded from 150d484e to bfa13f7f [fundraising]
20:35 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:34 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) (T426563) [admin]
20:34 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:33 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) (T426563) [admin]
20:33 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:30 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on P{wikikube-worker[2203-2331].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
20:30 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:30 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:22 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:18 <James_F> Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [releng]
20:18 <James_F> Zuul: Migrate various labs things to Node 24 [releng]
20:14 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:13 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:13 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:05 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:02 <James_F> Docker: [ajv, sonar-scanner] Migrate to Node 24 [releng]
19:58 <James_F> Zuul: Migrate various production/CI things to Node 24 [releng]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
19:56 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:48 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:40 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:39 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:39 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:29 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:21 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:20 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:20 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:12 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:03 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:02 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
19:02 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:54 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:48 <jhathaway@dns1004> END - running authdns-update [production]
18:46 <jhathaway@dns1004> START - running authdns-update [production]