501-550 of 10000 results (28ms)
2025-10-16 ยง
14:09 <sukhe@cumin1003> END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp7008*} and A:cp [production]
14:09 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7008.magru.wmnet [production]
14:04 <jmm@cumin2002> END (PASS) - Cookbook sre.pki.restart-reboot (exit_code=0) rolling reboot on A:pki [production]
13:59 <sukhe> sudo ipmitool -I lanplus -H "cp7008.mgmt.magru.wmnet" -U root -E chassis power cycle [production]
13:57 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1260.eqiad.wmnet onto db1263.eqiad.wmnet [production]
13:57 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1260 gradually with 4 steps - Pool db1260.eqiad.wmnet in after cloning [production]
13:56 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) pki.discovery.wmnet. on all recursors [production]
13:56 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache pki.discovery.wmnet. on all recursors [production]
13:53 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: sync [production]
13:53 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: sync [production]
13:50 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) pki.discovery.wmnet. on all recursors [production]
13:49 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache pki.discovery.wmnet. on all recursors [production]
13:49 <jmm@cumin2002> START - Cookbook sre.pki.restart-reboot rolling reboot on A:pki [production]
13:34 <hashar> Zuul: ConfirmEdit extension: Add VisualEditor and MobileFrontend deps [releng]
13:28 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196109|BETA: Try using Hadoop QueryPage computations (T309738)]] (duration: 08m 09s) [production]
13:27 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp7008*} and A:cp [production]
13:24 <zabe@deploy2002> zabe: Continuing with sync [production]
13:22 <zabe@deploy2002> zabe: Backport for [[gerrit:1196109|BETA: Try using Hadoop QueryPage computations (T309738)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:20 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1196109|BETA: Try using Hadoop QueryPage computations (T309738)]] [production]
13:13 <esanders@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196645|LQT convert: Ignore duplicate key insert errors when command line flag set (T407357)]] (duration: 10m 14s) [production]
13:12 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1260 gradually with 4 steps - Pool db1260.eqiad.wmnet in after cloning [production]
13:09 <esanders@deploy2002> esanders: Continuing with sync [production]
13:06 <esanders@deploy2002> esanders: Backport for [[gerrit:1196645|LQT convert: Ignore duplicate key insert errors when command line flag set (T407357)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:03 <esanders@deploy2002> Started scap sync-world: Backport for [[gerrit:1196645|LQT convert: Ignore duplicate key insert errors when command line flag set (T407357)]] [production]
12:51 <moritzm> installing git security updates [production]
12:36 <moritzm> installing gst-plugins-base1.0 security updates [production]
12:13 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es2054 slowly with 10 steps - Pooling in new host [production]
12:05 <jmm@dns1004> END - running authdns-update [production]
12:03 <jmm@dns1004> START - running authdns-update [production]
12:01 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission [tools]
11:54 <ozge@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
11:52 <volans@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component ingress-admission [tools]
11:26 <claime> sudo cumin 'A:cp' "enable-puppet 'Deploying gateway-check.lua changes - T406599 - cgoubert' [production]
11:22 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
11:21 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
11:21 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
11:21 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
11:21 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
11:21 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
11:20 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission [toolsbeta]
11:19 <hnowlan@deploy2002> Finished deploy [restbase/deploy@0be0059]: deploy 9 new wikis from r/1177553 (duration: 27m 01s) [production]
11:12 <volans@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component ingress-admission [toolsbeta]
11:12 <moritzm> installing Squid security updates [production]
11:08 <claime> sudo cumin 'A:cp' "disable-puppet 'Deploying gateway-check.lua changes - T406599 - cgoubert'" [production]
11:05 <brouberol@deploy2002> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
11:04 <brouberol@deploy2002> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
11:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
11:01 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:01 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]