101-150 of 10000 results (42ms)
2026-07-09 ยง
12:45 <cgoubert@deploy2003> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
12:44 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
12:44 <cgoubert@deploy2003> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
12:43 <cgoubert@deploy2003> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
12:43 <cgoubert@deploy2003> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
12:42 <kevinbazira@deploy2003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
12:31 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
12:29 <godog> wmcs-openstack aggregate delete maintenance [admin]
12:24 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast4006.wikimedia.org [production]
12:20 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt2002.wikimedia.org [production]
12:20 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast7002.wikimedia.org [production]
12:18 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast4006.wikimedia.org [production]
12:18 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
12:18 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.host-bgp (exit_code=0) for host ml-serve1004 [production]
12:18 <cmooney@cumin1003> START - Cookbook sre.network.host-bgp for host ml-serve1004 [production]
12:14 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host apt2002.wikimedia.org [production]
12:14 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast7002.wikimedia.org [production]
12:14 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
12:11 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
12:10 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[2003,2014].codfw.wmnet with reason: reboot & upgrade [production]
12:10 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt-staging2001.codfw.wmnet [production]
12:09 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid1003.eqiad.wmnet [production]
12:06 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host apt-staging2001.codfw.wmnet [production]
12:05 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host failoid1003.eqiad.wmnet [production]
12:03 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[1003,1014].eqiad.wmnet with reason: reboot & upgrade [production]
12:02 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid2003.codfw.wmnet [production]
12:02 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org [production]
11:59 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
11:58 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host failoid2003.codfw.wmnet [production]
11:58 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org [production]
11:55 <jmm@dns1004> END - running authdns-update [production]
11:55 <hashar> retriggering postmerge change for T431582: zuul enqueue --trigger gerrit --pipeline postmerge --project machinelearning/liftwing/inference-services --change 1308631,3 [releng]
11:53 <jmm@dns1004> START - running authdns-update [production]
11:52 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all nodes [toolsbeta]
11:50 <jmm@dns1004> END - running authdns-update [production]
11:48 <jmm@dns1004> START - running authdns-update [production]
11:27 <taavi> rebooting bastions for kernel upgrades [tools]
11:27 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2003.wikimedia.org [production]
11:24 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for all nodes [tools]
11:24 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for all nodes [toolsbeta]
11:23 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host irc2003.wikimedia.org [production]
11:16 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-maint2001.codfw.wmnet [production]
11:16 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-maint1001.eqiad.wmnet [production]
11:12 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-maint2001.codfw.wmnet [production]
11:12 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-maint1001.eqiad.wmnet [production]
11:08 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw2001.wikimedia.org [production]
11:08 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw1001.wikimedia.org [production]
11:04 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-rw2001.wikimedia.org [production]
11:04 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-rw1001.wikimedia.org [production]
11:03 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon1003.wikimedia.org [production]