101-150 of 10000 results (22ms)
2025-02-03 §
16:58 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
16:57 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-30 §
14:55 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
14:54 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
13:45 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
13:44 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
11:52 <elukey@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
10:57 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
10:56 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:39 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
09:38 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:28 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
09:28 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
09:26 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
09:26 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
09:08 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
09:08 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-29 §
16:56 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
16:56 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-28 §
16:52 <elukey> restart kartotherian on maps1009 as test [production]
12:31 <elukey@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
12:30 <elukey@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
2025-01-27 §
16:45 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
16:44 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-23 §
17:00 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
16:59 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-20 §
18:00 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/kartotherian: sync [production]
17:59 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/kartotherian: sync [production]
2025-01-15 §
13:09 <elukey> restart wdqs-blazegraph.service on wdqs1013 - failed http probes [production]
13:06 <elukey> `elukey@puppetmaster1001:~$ sudo puppet cert destroy graphite.discovery.wmnet` [production]
2025-01-10 §
10:06 <elukey> restart dump_cloud_ip_ranges on puppetserver1001 - unit failed due to errors while fetching new data from upstream, trying to see if it was a temporary issue [production]
10:02 <elukey> elukey@cumin1002:~$ sudo cumin -b 20 'an-worker*' 'apt-get clean' (safety to free space and avoid issues on hadoop) - T383320 [production]
09:57 <elukey> kill hanging jupyterhub process on stat1009 to allow puppet to run an delete a user [production]
09:49 <elukey> elukey@cumin1002:~$ sudo cumin 'an-worker11[39,15,54,90,75,57,89,18,06,24]*' 'apt-get clean' [production]
09:45 <elukey> elukey@cumin1002:~$ sudo cumin 'an-worker11[16,43,19,47,56,72,69]*' 'apt-get clean' [production]
09:40 <elukey> `apt-get clean` on an-worker1147 to free space on the root partition [production]
09:39 <elukey> `apt-get clean` on an-worker1117 to free space on the root partition [production]
2025-01-09 §
17:41 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2022.codfw.wmnet with OS bookworm [production]
17:20 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2022.codfw.wmnet with reason: host reimage [production]
17:16 <elukey@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2022.codfw.wmnet with reason: host reimage [production]
16:55 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2022 [production]
16:55 <elukey@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2022 [production]
16:55 <elukey@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2022.codfw.wmnet with OS bookworm [production]
16:54 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2022 [production]
16:54 <elukey@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2022 [production]
16:54 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2022 [production]
16:54 <elukey@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2022 [production]
16:54 <elukey@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2022 [production]
16:54 <elukey@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2022.codfw.wmnet 212.32.192.10.in-addr.arpa 2.1.2.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
16:54 <elukey@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker2022.codfw.wmnet 212.32.192.10.in-addr.arpa 2.1.2.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]