1651-1700 of 10000 results (28ms)
2026-05-11 ยง
16:41 <sfaci@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply [production]
16:40 <eevans@deploy1003> helmfile [codfw] START helmfile.d/services/echostore: apply [production]
16:39 <jayme@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
16:39 <jayme@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
16:39 <jayme@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
16:38 <jayme@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
16:37 <jayme@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:37 <jayme@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
16:36 <jayme@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:36 <jayme@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
16:27 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1281506|Disable FlaggedRevs on wikinews (T423577)]] (duration: 06m 54s) [production]
16:25 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/echostore: apply [production]
16:25 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/echostore: apply [production]
16:24 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/echostore: apply [production]
16:23 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/echostore: apply [production]
16:23 <zabe@deploy1003> zabe: Continuing with deployment [production]
16:22 <zabe@deploy1003> zabe: Backport for [[gerrit:1281506|Disable FlaggedRevs on wikinews (T423577)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:20 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1281506|Disable FlaggedRevs on wikinews (T423577)]] [production]
16:14 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:06 <Lucas_WMDE> ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/quibble-vendor-mysql-php83-selenium/Cypress/ # broken Cypress cache? hopefully fix failure seen in quibble-vendor-mysql-php83-selenium 51439 and 51452 [releng]
16:03 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:02 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:01 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:01 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
16:00 <eevans@deploy1003> helmfile [staging] DONE helmfile.d/services/sessionstore: apply [production]
16:00 <eevans@deploy1003> helmfile [staging] START helmfile.d/services/sessionstore: apply [production]
15:58 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] (duration: 07m 48s) [production]
15:54 <zabe@deploy1003> zabe: Continuing with deployment [production]
15:52 <zabe@deploy1003> zabe: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:50 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1281491|Remove custom user groups from Wikinews (T423578)]] [production]
15:50 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:46 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] (duration: 06m 32s) [production]
15:42 <zabe@deploy1003> zabe: Continuing with deployment [production]
15:41 <zabe@deploy1003> zabe: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:40 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:39 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1280418|Start reading from new file tables on testwiki (2nd try) (T416548)]] [production]
15:30 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:30 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:29 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
15:23 <fnegri@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api (T423417) [toolsbeta]
15:21 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
15:21 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
15:20 <fnegri@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api (T423417) [toolsbeta]
15:17 <vriley@cumin1003> START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bookworm [production]
15:11 <wmftkbot> Test Kitchen mw-user experiment (poll 225789) - adds: none; removes: none; fields: ab-test-email-confirmation-banner - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
14:55 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lvs2012.codfw.wmnet with reason: DIMM replacement [production]
14:54 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
14:54 <wmbot~lucaswerkmeister-wmde@tools-bastion-15> deployed 8378c0e9bd (drop wikinews from output; cc T425261) [tools.wdmm]
14:54 <cdanis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
14:47 <vriley@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]