9151-9200 of 10000 results (50ms)
2024-06-24 ยง
12:07 <claime> Setting all legacy api_appservers to inactive - T368058 [production]
12:07 <cgoubert@cumin1002> conftool action : set/pooled=inactive; selector: cluster=appserver [production]
12:06 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-static-15 [tools]
12:06 <claime> Setting all legacy appservers to inactive - T368058 [production]
12:05 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . [production]
12:05 <James_F> Zuul: Fix composer-test-package-php74-or-later to include PHP 8.3 [releng]
12:05 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-static-15 [tools]
12:04 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
12:03 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-acme-chief-4 [tools]
12:02 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-acme-chief-4 [tools]
12:01 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . [production]
12:00 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-worker-nfs-10 [tools]
11:59 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
11:58 <taavi@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.k8s.worker.drain (exit_code=97) for node tools-k8s-worker-nfs-10 [tools]
11:58 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-worker-nfs-10 [tools]
11:57 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.drain for node tools-k8s-worker-nfs-10 [tools]
11:57 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
11:56 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
11:56 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.drain (exit_code=99) for node tools-k8s-worker-nfs-10 [tools]
11:55 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
11:52 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw2360.codfw.wmnet [production]
11:52 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw2360.codfw.wmnet [production]
11:52 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw2358.codfw.wmnet [production]
11:52 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw2358.codfw.wmnet [production]
11:52 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'readability' for release 'main' . [production]
11:52 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw2339.codfw.wmnet [production]
11:52 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw2339.codfw.wmnet [production]
11:51 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw1406.eqiad.wmnet [production]
11:51 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw1406.eqiad.wmnet [production]
11:51 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/push-notifications: apply [production]
11:51 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw1403.eqiad.wmnet [production]
11:51 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw1403.eqiad.wmnet [production]
11:51 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/push-notifications: apply [production]
11:50 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.worker.drain for node tools-k8s-worker-nfs-10 [tools]
11:50 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/push-notifications: apply [production]
11:49 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/push-notifications: apply [production]
11:49 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
11:49 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [tools]
11:48 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [tools]
11:46 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
11:45 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [toolsbeta]
11:45 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [toolsbeta]
11:45 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/push-notifications: apply [production]
11:44 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno [toolsbeta]
11:44 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/push-notifications: apply [production]
11:44 <moritzm> installing php8.2 security updates [production]
11:44 <aborrero@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno [toolsbeta]
11:44 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-worker-nfs-9 [tools]
11:42 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-worker-nfs-9 [tools]
11:42 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . [production]