351-400 of 10000 results (21ms)
2026-05-11 ยง
16:01 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:00 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/sessionstore: apply [production]
16:00 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/sessionstore: apply [production]
15:58 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] (duration: 07m 48s) [production]
15:54 <zabe@deploy1003> zabe: Continuing with deployment [production]
15:52 <zabe@deploy1003> zabe: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:50 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] [production]
15:50 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:46 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] (duration: 06m 32s) [production]
15:42 <zabe@deploy1003> zabe: Continuing with deployment [production]
15:41 <zabe@deploy1003> zabe: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:40 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:39 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] [production]
15:30 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:30 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:29 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:23 <fnegri@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api (T423417) [toolsbeta]
15:21 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
15:21 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
15:20 <fnegri@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api (T423417) [toolsbeta]
15:17 <vriley@cumin1003> START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bookworm [production]
15:11 <wmftkbot> Test Kitchen mw-user experiment (poll 225789) - adds: none; removes: none; fields: ab-test-email-confirmation-banner - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
14:55 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lvs2012.codfw.wmnet with reason: DIMM replacement [production]
14:54 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
14:54 <wmbot~lucaswerkmeister-wmde@tools-bastion-15> deployed 8378c0e9bd (drop wikinews from output; cc T425261) [tools.wdmm]
14:54 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
14:47 <vriley@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:46 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:43 <vriley@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs1017 [production]
14:42 <vriley@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host lvs1017 [production]
14:42 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
14:41 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
14:41 <vriley@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:39 <Lucas_WMDE> UTC afternoon backport+config window done [production]
14:39 <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1285448|Grant 'createpreviouslyrenamedaccount' to account creators and sysop-likes (T196386)]], [[gerrit:1278704|WikiLambdaApi: update stream configuration (T415254)]], [[gerrit:1285352|WikiLambdaApi instrument: Sets the custom schemaID (T415254)]], [[gerrit:1285406|editSaves: getExperiment returns a promise now (T425785)]] (duration: 18 [production]
14:38 <vriley@cumin1003> START - Cookbook sre.dns.netbox [production]
14:33 <lucaswerkmeister-wmde@deploy1003> lucaswerkmeister-wmde, jforrester, matmarex, sfaci: Continuing with deployment [production]
14:26 <lucaswerkmeister-wmde@deploy1003> lucaswerkmeister-wmde, jforrester, matmarex, sfaci: Backport for [[gerrit:1285448|Grant 'createpreviouslyrenamedaccount' to account creators and sysop-likes (T196386)]], [[gerrit:1278704|WikiLambdaApi: update stream configuration (T415254)]], [[gerrit:1285352|WikiLambdaApi instrument: Sets the custom schemaID (T415254)]], [[gerrit:1285406|editSaves: getExperiment returns a promise now [production]
14:20 <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1285448|Grant 'createpreviouslyrenamedaccount' to account creators and sysop-likes (T196386)]], [[gerrit:1278704|WikiLambdaApi: update stream configuration (T415254)]], [[gerrit:1285352|WikiLambdaApi instrument: Sets the custom schemaID (T415254)]], [[gerrit:1285406|editSaves: getExperiment returns a promise now (T425785)]] [production]
14:18 <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1285460|Prevent username registration if the username previously existed (T196386)]], [[gerrit:1285461|Prevent username registration if the username previously existed (v2) (T196386)]], [[gerrit:1285462|API: Introduce list=globalusers (T261752)]], [[gerrit:1285761|list=globalusers: Avoid querying group permissions with empty group list ( [production]
14:15 <vriley@cumin1003> START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bookworm [production]
14:12 <vriley@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:09 <vriley@cumin1003> START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:05 <lucaswerkmeister-wmde@deploy1003> matmarex, lucaswerkmeister-wmde: Continuing with deployment [production]
14:04 <lucaswerkmeister-wmde@deploy1003> matmarex, lucaswerkmeister-wmde: Backport for [[gerrit:1285460|Prevent username registration if the username previously existed (T196386)]], [[gerrit:1285461|Prevent username registration if the username previously existed (v2) (T196386)]], [[gerrit:1285462|API: Introduce list=globalusers (T261752)]], [[gerrit:1285761|list=globalusers: Avoid querying group permissions with empty group [production]
13:58 <wmbot~soda@tools-bastion-15> ./matchandsplit/scripts/toolforge-deploy-new-version.sh [tools.matchandsplit]
13:57 <btullis@cumin1003> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs [production]
13:57 <btullis@cumin1003> END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: dse-k8s-worker-eqiad@eqiad [production]
13:56 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1055.eqiad.wmnet with OS bookworm [production]
13:56 <btullis@cumin1003> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs [production]