151-200 of 10000 results (33ms)
2026-05-21 ยง
18:27 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_mons [admin]
18:17 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_mons (exit_code=0) [admin]
18:06 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_mons [admin]
17:54 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
17:53 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]
17:53 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:52 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
17:52 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
17:52 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
17:52 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:51 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:51 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
17:51 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
17:50 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:49 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
17:49 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
17:48 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
17:46 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
17:46 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
17:43 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply [production]
17:43 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:43 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
17:42 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-video: apply [production]
17:42 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:41 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply [production]
17:41 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:41 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:41 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
17:41 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:41 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
17:41 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:41 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_mons (exit_code=0) [admin]
17:40 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
17:40 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-media: apply [production]
17:40 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:39 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wdqs2028 [production]
17:39 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
17:38 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on cp6015.drmrs.wmnet with reason: hardware down [production]
17:37 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host wdqs2028 [production]
17:36 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wdqs2028.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:35 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:30 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wdqs2028.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
17:30 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_mons [admin]
17:29 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm util-abogott (cluster codfw1dev, project testlabs) [testlabs]
17:28 <andrew@cloudcumin1001> START - Cookbook wmcs.vps.instance.force_reboot vm util-abogott (cluster codfw1dev, project testlabs) [testlabs]
17:25 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
17:25 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
17:24 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
17:23 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:22 <fnegri@cumin1003> END (PASS) - Cookbook sre.mysql.upgrade (exit_code=0) for clouddb1016.eqiad.wmnet [production]