151-200 of 10000 results (26ms)
2025-12-22 §
13:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1198 gradually with 4 steps - repooling [production]
13:15 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) es2051 gradually with 4 steps - test T383674 [production]
12:47 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1198 gradually with 4 steps - repooling [production]
12:30 <fceratto@cumin1003> START - Cookbook sre.mysql.newpool es2051 gradually with 4 steps - test T383674 [production]
12:21 <kevinbazira@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
11:57 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:56 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1029.eqiad.wmnet with OS trixie [production]
11:43 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:38 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
11:32 <elukey@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1029.eqiad.wmnet with reason: host reimage [production]
11:14 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:12 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.newdepool (exit_code=0) es2051 - test T383674 [production]
11:10 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:09 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1029.eqiad.wmnet with OS trixie [production]
11:04 <fceratto@cumin1003> START - Cookbook sre.mysql.newdepool es2051 - test T383674 [production]
10:37 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
10:35 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
10:28 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
10:28 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
10:28 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:27 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:23 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:23 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:18 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
10:07 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
10:05 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:04 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
09:31 <kevinbazira@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:02 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:57 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:47 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:47 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:40 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:40 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:32 <elukey@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:28 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host db2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
08:14 <elukey@deploy2002> Finished deploy [docker-pkg/deploy@1664255]: (no justification provided) (duration: 00m 08s) [production]
08:14 <elukey@deploy2002> Started deploy [docker-pkg/deploy@1664255]: (no justification provided) [production]
08:04 <elukey@deploy2002> Finished deploy [docker-pkg/deploy@1664255]: (no justification provided) (duration: 00m 07s) [production]
08:04 <elukey@deploy2002> Started deploy [docker-pkg/deploy@1664255]: (no justification provided) [production]
08:03 <elukey@deploy2002> Finished deploy [docker-pkg/deploy@1664255]: (no justification provided) (duration: 00m 11s) [production]
08:03 <elukey@deploy2002> Started deploy [docker-pkg/deploy@1664255]: (no justification provided) [production]
07:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2028.codfw.wmnet with OS trixie [production]
07:09 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2028.codfw.wmnet with reason: host reimage [production]
07:05 <marostegui@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on es2028.codfw.wmnet with reason: host reimage [production]
06:49 <marostegui@cumin1003> START - Cookbook sre.hosts.reimage for host es2028.codfw.wmnet with OS trixie [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-12-21 §
23:48 <eileen> config revision changed from e478c565 to 8e95f98e [production]
21:27 <wmbot~anticomposite@tools-bastion-15> Deploy 1d2a4fb, a39759c [tools.stewardbots]
14:30 <wmftkbot> Test Kitchen edge-unique experiments (poll 50623) - adds: none; removes: logged-out-retention-round2; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]