801-850 of 10000 results (19ms)
2025-06-25 ยง
18:07 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [tools]
18:01 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.9a [production]
18:01 <mvernon@cumin1002> END (FAIL) - Cookbook sre.swift.check-dbs (exit_code=1) Checking container DBs of wikipedia-commons-local-thumb.99 [production]
17:58 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
17:53 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
17:45 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.99 [production]
17:45 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.98 [production]
17:36 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [tools]
17:32 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [tools]
17:31 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.98 [production]
17:31 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.97 [production]
17:30 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
17:29 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
17:27 <cdobbins@cumin2002> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-eqiad and A:cp - 9.2.11 upgrade (T397456) [production]
17:27 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
17:23 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
17:18 <cdobbins@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-esams and A:cp - 9.2.11 upgrade (T397456) [production]
17:16 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.97 [production]
17:16 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.96 [production]
17:16 <swfrench@dns1004> END - running authdns-update [production]
17:15 <swfrench@dns1004> START - running authdns-update [production]
17:13 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-codfw and A:cp - 9.2.11 upgrade (T390912) [production]
17:05 <thcipriani> Upgrading scap to 4.182.0 in beta cluster [releng]
17:02 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.96 [production]
17:01 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.95 [production]
16:56 <cgoubert@cumin1003> END (FAIL) - Cookbook sre.k8s.reboot-nodes (exit_code=1) rolling reboot on P{wikikube-worker[1252-1289,1291-1327].eqiad.wmnet,wikikube-worker-exp1001.eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) [production]
16:48 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.95 [production]
16:48 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.94 [production]
16:33 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.94 [production]
16:33 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.93 [production]
16:33 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1167 gradually with 4 steps - Pooling in [production]
16:20 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.93 [production]
16:20 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.92 [production]
16:18 <cmooney@dns3003> END - running authdns-update [production]
16:17 <cmooney@dns3003> START - running authdns-update [production]
16:15 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
16:15 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
16:06 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.92 [production]
16:06 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.91 [production]
16:02 <fceratto@cumin1002> START - Cookbook sre.mysql.pool db1167 gradually with 4 steps - Pooling in [production]
16:02 <stevemunene@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1179.eqiad.wmnet with OS bullseye [production]
15:53 <akosiaris@deploy1003> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
15:53 <akosiaris@deploy1003> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
15:52 <akosiaris@deploy1003> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:52 <akosiaris@deploy1003> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
15:52 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2051.codfw.wmnet [production]
15:51 <akosiaris@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:51 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.91 [production]
15:51 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.90 [production]
15:51 <akosiaris@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]