51-100 of 10000 results (90ms)
2026-02-12 ยง
16:18 <blake@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-misc: apply [production]
16:18 <blake@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-misc: apply [production]
16:18 <blake@deploy2002> helmfile [codfw] START helmfile.d/services/mw-misc: apply [production]
16:17 <blake@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
16:16 <blake@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
16:16 <blake@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
16:16 <blake@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
16:14 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on durum3005.esams.wmnet with reason: host reimage [production]
16:08 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on durum3005.esams.wmnet with reason: host reimage [production]
15:57 <vgutierrez> downgrade to HAProxy 2.8 in cp4052 - T417291 [production]
15:53 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host durum7004.magru.wmnet with OS trixie [production]
15:47 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:43 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host durum3005.esams.wmnet with OS trixie [production]
15:42 <vgutierrez> testing HAProxy 3.0.15 in cp4052 - T417291 [production]
15:38 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase1035.eqiad.wmnet [production]
15:38 <eevans@cumin1003> START - Cookbook sre.hosts.remove-downtime for restbase1035.eqiad.wmnet [production]
15:37 <blake@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
15:37 <blake@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
15:37 <blake@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-cron: apply [production]
15:36 <blake@deploy2002> helmfile [codfw] START helmfile.d/services/mw-cron: apply [production]
15:31 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:30 <eevans@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on restbase1035.eqiad.wmnet with reason: Checking mountpoint ownership & permissions [production]
15:23 <vgutierrez> fetch haproxy 3.0.15 on thirdparty/haproxy30 (bullseye-wikimedia) - T401832 [production]
15:18 <jgreen@dns1004> END - running authdns-update [production]
15:18 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:16 <jgreen@dns1004> START - running authdns-update [production]
15:07 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:07 <Lucas_WMDE> printf 'https://en.wikipedia.org/static/images/mobile/copyright/wikipedia-tagline-kaj.svg\n' | mwscript-k8s --comment=T415038 --attach -- purgeList enwiki [production]
15:06 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] (duration: 08m 02s) [production]
15:02 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Continuing with sync [production]
15:01 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:58 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1019.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1018.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1017.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1016.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1015.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1013.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1012.eqiad.wmnet [production]
14:57 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1011.eqiad.wmnet [production]
14:57 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1010.eqiad.wmnet [production]
14:56 <blake@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
14:56 <blake@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
14:55 <btullis@puppetserver1001> conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1014.eqiad.wmnet [production]
14:55 <blake@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
14:55 <btullis@puppetserver1001> conftool action : set/weight=1; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1014.eqiad.wmnet [production]
14:55 <blake@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
14:52 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 21 days, 0:00:00 on 9 hosts with reason: shut off 1Gbps hosts [production]
14:49 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239104|pplwiki: add logos (T415046)]] (duration: 10m 00s) [production]
14:49 <moritzm> uploaded bird2 2.18-1~wmf12u2 to the main component of bookworm-wikimedia T413740 [production]