201-250 of 10000 results (3ms)
2026-09-29 ยง
10:14 <jmm@cumin2003> START - Cookbook sre.dns.wipe-cache testvm2001.codfw.wmnet on all recursors [production]
10:14 <jmm@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:14 <jmm@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM testvm2001.codfw.wmnet - jmm@cumin2003" [production]
10:14 <jmm@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM testvm2001.codfw.wmnet - jmm@cumin2003" [production]
10:10 <ihurbain@deploy1003> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
10:10 <jmm@cumin2003> START - Cookbook sre.dns.netbox [production]
10:10 <jmm@cumin2003> START - Cookbook sre.ganeti.makevm for new host testvm2001.codfw.wmnet [production]
10:09 <ihurbain@deploy1003> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
09:36 <urbanecm@deploy1003> mwscript-k8s job started: GrowthExperiments:reassignMentees --wiki=enwiki --mentor=Ikan --performer=Ikan --as-job # T418194 [production]
09:12 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [tools]
08:59 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [tools]
08:59 <urbanecm@deploy1003> Finished scap sync-world: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] (duration: 11m 07s) [production]
08:59 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [toolsbeta]
08:54 <urbanecm@deploy1003> urbanecm: Continuing with deployment [production]
08:52 <urbanecm@deploy1003> urbanecm: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
08:50 <dpogorzelski@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync [production]
08:49 <dpogorzelski@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync [production]
08:48 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] [production]
08:46 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
08:42 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e5-eqiad [production]
08:41 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-e5-eqiad [production]
08:41 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f5-eqiad [production]
08:41 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-f5-eqiad [production]
08:41 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f6-eqiad [production]
08:41 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-f6-eqiad [production]
08:40 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e7-eqiad [production]
08:40 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-e7-eqiad [production]
08:40 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e6-eqiad [production]
08:40 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-e6-eqiad [production]
08:39 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f7-eqiad [production]
08:39 <ayounsi@cumin1004> START - Cookbook sre.network.tls for network device lsw1-f7-eqiad [production]
08:18 <isaranto@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
08:10 <moritzm> installing PHP 8.4 security updates [production]
07:49 <matthiasmullie> UTC morning backport window done [production]
07:49 <mlitn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] (duration: 09m 57s) [production]
07:44 <mlitn@deploy1003> mlitn: Continuing with deployment [production]
07:43 <mlitn@deploy1003> mlitn: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:39 <mlitn@deploy1003> Started scap sync-world: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] [production]
07:35 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] (duration: 12m 41s) [production]
07:33 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest2004.codfw.wmnet [production]
07:30 <kharlan@deploy1003> kharlan: Continuing with deployment [production]
07:27 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host sretest2004.codfw.wmnet [production]
07:27 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:26 <kart_> Updated cxserver to 2026-09-25-114231-production [production]
07:24 <kartik@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
07:24 <kartik@deploy1003> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
07:23 <kartik@deploy1003> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
07:22 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] [production]
07:22 <kartik@deploy1003> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
07:18 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2005.wikimedia.org [production]