1-50 of 10000 results (45ms)
2026-08-26 ยง
21:55 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:55 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:52 <jasmine@cumin1003> START - Cookbook sre.dns.netbox [production]
21:52 <jasmine@cumin1003> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1260 [production]
21:51 <jasmine@cumin1003> START - Cookbook sre.hosts.reimage for host wikikube-worker1260.eqiad.wmnet with OS trixie [production]
21:51 <jasmine@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1260.eqiad.wmnet [production]
21:50 <jasmine@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1260.eqiad.wmnet [production]
21:50 <jasmine@cumin1003> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1260.eqiad.wmnet [production]
21:48 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:47 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:35 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bookworm [production]
21:34 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cassandra-dev2002.codfw.wmnet with OS bookworm [production]
21:31 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:30 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:20 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
21:20 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
21:20 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:19 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:19 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:18 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:15 <aaron@deploy1003> Finished scap sync-world: Backport for [[gerrit:1329616|Rest: Rename "mode" key to "availability" in RestModuleOverrides (T433522)]] (duration: 12m 43s) [production]
21:14 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:14 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:14 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
21:12 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
21:12 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:10 <aaron@deploy1003> aaron: Continuing with deployment [production]
21:10 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:10 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
21:09 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
21:07 <aaron@deploy1003> aaron: Backport for [[gerrit:1329616|Rest: Rename "mode" key to "availability" in RestModuleOverrides (T433522)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:02 <aaron@deploy1003> Started scap sync-world: Backport for [[gerrit:1329616|Rest: Rename "mode" key to "availability" in RestModuleOverrides (T433522)]] [production]
20:57 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bookworm [production]
20:48 <cdobbins@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp5022.eqsin.wmnet with reason: needs repair [production]
20:29 <cmooney@cumin1003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - remove eqsin workaround from wmf-plugin for eqsin L3 switches - cmooney@cumin1003 [production]
20:28 <cmooney@cumin1003> START - Cookbook sre.deploy.python-code homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - remove eqsin workaround from wmf-plugin for eqsin L3 switches - cmooney@cumin1003 [production]
20:27 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cassandra-dev2002.codfw.wmnet with OS bookworm [production]
20:24 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bookworm [production]
20:10 <brett@cumin2003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool eqsin [reason: no reason specified, T435406] [production]
20:10 <brett@cumin2003> START - Cookbook sre.dns.admin DNS admin: pool eqsin [reason: no reason specified, T435406] [production]
20:08 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns (exit_code=0) rolling restart_daemons on A:wikidough-eqsin [production]
20:06 <sukhe@cumin1003> START - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns rolling restart_daemons on A:wikidough-eqsin [production]
19:58 <sukhe@puppetserver1001> conftool action : set/pooled=no; selector: name=cp5022.eqsin.wmnet [production]
19:55 <sukhe@dns1004> END - running authdns-update [production]
19:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) restart A:liberica-eqsin and A:liberica [production]
19:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) pooling P{lvs5006.eqsin.wmnet} and A:liberica [production]
19:54 <sukhe@cumin1003> START - Cookbook sre.loadbalancer.admin pooling P{lvs5006.eqsin.wmnet} and A:liberica [production]
19:54 <sukhe@cumin1003> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs5006.eqsin.wmnet} and A:liberica [production]
19:53 <sukhe@cumin1003> START - Cookbook sre.loadbalancer.admin depooling P{lvs5006.eqsin.wmnet} and A:liberica [production]
19:53 <sukhe@cumin1003> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) pooling P{lvs5005.eqsin.wmnet} and A:liberica [production]