151-200 of 10000 results (15ms)
2026-02-12 ยง
15:31 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:30 <eevans@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on restbase1035.eqiad.wmnet with reason: Checking mountpoint ownership & permissions [production]
15:23 <vgutierrez> fetch haproxy 3.0.15 on thirdparty/haproxy30 (bullseye-wikimedia) - T401832 [production]
15:18 <jgreen@dns1004> END - running authdns-update [production]
15:18 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:16 <jgreen@dns1004> START - running authdns-update [production]
15:07 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:07 <Lucas_WMDE> printf 'https://en.wikipedia.org/static/images/mobile/copyright/wikipedia-tagline-kaj.svg\n' | mwscript-k8s --comment=T415038 --attach -- purgeList enwiki [production]
15:06 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] (duration: 08m 02s) [production]
15:02 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Continuing with sync [production]
15:01 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:58 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1239114|kajwiki: fix tagline (T415038)]] [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1019.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1018.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1017.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1016.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1015.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1013.eqiad.wmnet [production]
14:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1012.eqiad.wmnet [production]
14:57 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1011.eqiad.wmnet [production]
14:57 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1010.eqiad.wmnet [production]
14:56 <blake@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
14:56 <blake@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
14:55 <btullis@puppetserver1001> conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1014.eqiad.wmnet [production]
14:55 <blake@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
14:55 <btullis@puppetserver1001> conftool action : set/weight=1; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-worker1014.eqiad.wmnet [production]
14:55 <blake@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
14:52 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 21 days, 0:00:00 on 9 hosts with reason: shut off 1Gbps hosts [production]
14:49 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239104|pplwiki: add logos (T415046)]] (duration: 10m 00s) [production]
14:49 <moritzm> uploaded bird2 2.18-1~wmf12u2 to the main component of bookworm-wikimedia T413740 [production]
14:49 <moritzm> upgrading cloudnet* to dnsmasq 2.92 T396864 [production]
14:45 <lucaswerkmeister-wmde@deploy2002> anzx, lucaswerkmeister-wmde: Continuing with sync [production]
14:43 <Amir1> ladsgroup@deploy2002:~$ mwscript-k8s --dblist=all -- purgeUserOptions.php --login-age 5 echo-subscriptions-web-reverted [production]
14:41 <lucaswerkmeister-wmde@deploy2002> anzx, lucaswerkmeister-wmde: Backport for [[gerrit:1239104|pplwiki: add logos (T415046)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:39 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1239104|pplwiki: add logos (T415046)]] [production]
14:37 <moritzm> upgrading cloudvirt* to dnsmasq 2.92 T396864 [production]
14:35 <Lucas_WMDE> printf 'https://en.wikipedia.org/static/images/project-logos/kajwiki%s.png\n' '' '-1.5x' '-2x' | mwscript-k8s --comment=T415038 --attach -- purgeList enwiki [production]
14:35 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239097|kajwiki: add tagline (T415038)]] (duration: 07m 56s) [production]
14:34 <andrewbogott> moritz is upgrading dnsmasq on eqiad1 cloudnets and cloudvirts [admin]
14:31 <lucaswerkmeister-wmde@deploy2002> anzx, lucaswerkmeister-wmde: Continuing with sync [production]
14:29 <lucaswerkmeister-wmde@deploy2002> anzx, lucaswerkmeister-wmde: Backport for [[gerrit:1239097|kajwiki: add tagline (T415038)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:27 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1239097|kajwiki: add tagline (T415038)]] [production]
14:25 <lucaswerkmeister-wmde@deploy2002> mwscript-k8s job started: namespaceDupes pplwiki --fix # T415046 [production]
14:25 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239092|pplwiki: set sitename, projectnamespace and timezone (T415046)]] (duration: 08m 27s) [production]
14:20 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Continuing with sync [production]
14:18 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, anzx: Backport for [[gerrit:1239092|pplwiki: set sitename, projectnamespace and timezone (T415046)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:16 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1239092|pplwiki: set sitename, projectnamespace and timezone (T415046)]] [production]
14:11 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1239089|Revert^3 "IPReputation: Switch to OpenSearch backend" (T416164)]] (duration: 09m 13s) [production]
14:07 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, stran: Continuing with sync [production]
14:04 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, stran: Backport for [[gerrit:1239089|Revert^3 "IPReputation: Switch to OpenSearch backend" (T416164)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]