3151-3200 of 10000 results (146ms)
2024-06-24 ยง
11:51 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/push-notifications: apply [production]
11:51 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: mw1403.eqiad.wmnet [production]
11:51 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: mw1403.eqiad.wmnet [production]
11:51 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/push-notifications: apply [production]
11:50 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/push-notifications: apply [production]
11:49 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/push-notifications: apply [production]
11:49 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
11:46 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
11:45 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/push-notifications: apply [production]
11:44 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/push-notifications: apply [production]
11:44 <moritzm> installing php8.2 security updates [production]
11:42 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . [production]
11:26 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
11:13 <btullis@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:13 <btullis@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove AAAA records from an-redacteddb1001 - btullis@cumin1002" [production]
11:01 <btullis@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove AAAA records from an-redacteddb1001 - btullis@cumin1002" [production]
10:58 <btullis@cumin1002> START - Cookbook sre.dns.netbox [production]
10:51 <cgoubert@cumin1002> conftool action : set/pooled=yes:weight=10; selector: name=(mw1420.eqiad.wmnet|mw1407.eqiad.wmnet),dc=eqiad,cluster=jobrunner [production]
10:50 <cgoubert@cumin1002> conftool action : set/pooled=no:weight=10; selector: name=(mw1420.eqiad.wmnet|mw1407.eqiad.wmnet),dc=eqiad,cluster=jobrunner [production]
10:41 <cgoubert@cumin1002> conftool action : set/pooled=no:weight=10; selector: name=(mw1420.eqiad.wmnet|mw1407.eqiad.wmnet),dc=eqiad,cluster=videoscaler [production]
10:41 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/push-notifications: apply [production]
10:40 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw1420.eqiad.wmnet [production]
10:40 <cgoubert@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw1420.eqiad.wmnet [production]
10:40 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw1407.eqiad.wmnet [production]
10:40 <cgoubert@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw1407.eqiad.wmnet [production]
10:39 <claime> pooling mw1420.eqiad.wmnet,mw1407.eqiad.wmnet as videoscalers - T368058 [production]
10:36 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1407.eqiad.wmnet with OS buster [production]
10:32 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1420.eqiad.wmnet with OS buster [production]
10:14 <jayme@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
10:10 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
10:04 <jelto@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
10:03 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage [production]
09:59 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage [production]
09:57 <jelto@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Replica to new version [production]
09:56 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage [production]
09:56 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage [production]
09:46 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
09:45 <mvolz@deploy1002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
09:44 <mvolz@deploy1002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
09:43 <mvolz@deploy1002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
09:42 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1420.eqiad.wmnet with OS buster [production]
09:42 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
09:42 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
09:41 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1407.eqiad.wmnet with OS buster [production]
09:39 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
09:34 <claime> Reimaging scap::proxies, mediawiki deployments may be unavailable - T368058 [production]
09:33 <mvolz@deploy1002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]