1-50 of 10000 results (43ms)
2026-09-22 ยง
21:25 <aqu@deploy1003> Finished deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] (duration: 01m 09s) [production]
21:24 <aqu@deploy1003> Started deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] [production]
21:24 <aqu@deploy1003> Finished deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] (duration: 24m 20s) [production]
21:19 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1025.eqiad.wmnet [production]
21:18 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1024.eqiad.wmnet [production]
21:18 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1024.eqiad.wmnet [production]
21:10 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1024.eqiad.wmnet [production]
21:05 <sukhe@cumin1004> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2013.codfw.wmnet with OS trixie [production]
20:59 <aqu@deploy1003> Started deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] [production]
20:59 <aqu@deploy1003> Finished deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] (duration: 00m 30s) [production]
20:59 <aqu@deploy1003> Started deploy [analytics/refinery@58c9356] (thin): Regular analytics weekly train THIN [analytics/refinery@58c93566] [production]
20:55 <aqu@deploy1003> Finished deploy [analytics/refinery@58c9356]: Regular analytics weekly train [analytics/refinery@58c93566] (duration: 06m 59s) [production]
20:48 <aqu@deploy1003> Started deploy [analytics/refinery@58c9356]: Regular analytics weekly train [analytics/refinery@58c93566] [production]
20:46 <aqu@deploy1003> Finished deploy [analytics/refinery@58c9356] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@58c93566] (duration: 00m 40s) [production]
20:45 <bking@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
20:45 <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1342285|Keep Article Guidance on where it is on today (T433293)]] (duration: 09m 53s) [production]
20:45 <aqu@deploy1003> Started deploy [analytics/refinery@58c9356] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@58c93566] [production]
20:44 <bking@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
20:44 <bking@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
20:43 <bking@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
20:40 <sbisson@deploy1003> sbisson: Continuing with deployment [production]
20:40 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1024.eqiad.wmnet [production]
20:40 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1023.eqiad.wmnet [production]
20:40 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1023.eqiad.wmnet [production]
20:40 <sbisson@deploy1003> sbisson: Backport for [[gerrit:1342285|Keep Article Guidance on where it is on today (T433293)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:35 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1342285|Keep Article Guidance on where it is on today (T433293)]] [production]
20:33 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1342825|eswiki: Add abusefilter-access-protected-vars to abusefilter user group (T436652)]] (duration: 13m 35s) [production]
20:33 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1023.eqiad.wmnet [production]
20:28 <ebernhardson@deploy1003> ebernhardson, codenamenoreste: Continuing with deployment [production]
20:24 <ebernhardson@deploy1003> ebernhardson, codenamenoreste: Backport for [[gerrit:1342825|eswiki: Add abusefilter-access-protected-vars to abusefilter user group (T436652)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:19 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1342825|eswiki: Add abusefilter-access-protected-vars to abusefilter user group (T436652)]] [production]
20:17 <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344014|cirrus: Send more_like traffic to eqiad]] (duration: 10m 29s) [production]
20:15 <bking@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
20:13 <cdobbins@cumin1004> conftool action : set/pooled=yes; selector: name=ncredir2002.* [production]
20:12 <bking@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
20:12 <ebernhardson@deploy1003> ebernhardson: Continuing with deployment [production]
20:11 <ebernhardson@deploy1003> ebernhardson: Backport for [[gerrit:1344014|cirrus: Send more_like traffic to eqiad]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:06 <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1344014|cirrus: Send more_like traffic to eqiad]] [production]
20:03 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1023.eqiad.wmnet [production]
20:02 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1022.eqiad.wmnet [production]
20:02 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1022.eqiad.wmnet [production]
20:02 <sukhe@cumin1004> START - Cookbook sre.hosts.reimage for host sretest2013.codfw.wmnet with OS trixie [production]
19:59 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ncredir2002.codfw.wmnet with OS trixie [production]
19:44 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1022.eqiad.wmnet [production]
19:42 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir2002.codfw.wmnet with reason: host reimage [production]
19:42 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet [production]
19:42 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:42 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:38 <cdobbins@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir2002.codfw.wmnet with reason: host reimage [production]
19:34 <jclark@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve1016.eqiad.wmnet with OS trixie [production]