3151-3200 of 10000 results (119ms)
2024-08-30 ยง
08:35 <akosiaris@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2296 to wikikube-worker2053 - akosiaris@cumin1002" [production]
08:26 <akosiaris@cumin1002> START - Cookbook sre.dns.netbox [production]
08:26 <akosiaris@cumin1002> START - Cookbook sre.hosts.rename from mw2296 to wikikube-worker2053 [production]
08:24 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2295 to wikikube-worker2052 [production]
08:24 <akosiaris@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2052 [production]
08:23 <akosiaris@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2052 [production]
08:23 <akosiaris@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
08:23 <akosiaris@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2295 to wikikube-worker2052 - akosiaris@cumin1002" [production]
08:23 <akosiaris@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2295 to wikikube-worker2052 - akosiaris@cumin1002" [production]
07:36 <akosiaris@cumin1002> START - Cookbook sre.dns.netbox [production]
07:36 <akosiaris@cumin1002> START - Cookbook sre.hosts.rename from mw2295 to wikikube-worker2052 [production]
07:22 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 52965 [production]
07:22 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 52965 [production]
07:11 <jayme@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:11 <jayme@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
07:11 <jayme@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:11 <jayme@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
07:11 <jayme@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
07:10 <jayme@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
07:09 <jayme@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
07:08 <jayme@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
05:35 <kcvelaga@deploy1003> Finished deploy [airflow-dags/analytics_product@0321fda]: (no justification provided) (duration: 00m 32s) [production]
05:34 <kcvelaga@deploy1003> Started deploy [airflow-dags/analytics_product@0321fda]: (no justification provided) [production]
04:55 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T370903)', diff saved to https://phabricator.wikimedia.org/P68289 and previous config saved to /var/cache/conftool/dbconfig/20240830-045519-ladsgroup.json [production]
04:40 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P68288 and previous config saved to /var/cache/conftool/dbconfig/20240830-044012-ladsgroup.json [production]
04:25 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P68287 and previous config saved to /var/cache/conftool/dbconfig/20240830-042505-ladsgroup.json [production]
04:09 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T370903)', diff saved to https://phabricator.wikimedia.org/P68286 and previous config saved to /var/cache/conftool/dbconfig/20240830-040957-ladsgroup.json [production]
04:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2207 (T370903)', diff saved to https://phabricator.wikimedia.org/P68285 and previous config saved to /var/cache/conftool/dbconfig/20240830-040055-ladsgroup.json [production]
04:00 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2207.codfw.wmnet with reason: Maintenance [production]
04:00 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2207.codfw.wmnet with reason: Maintenance [production]
03:51 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
03:51 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
03:51 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189 (T370903)', diff saved to https://phabricator.wikimedia.org/P68284 and previous config saved to /var/cache/conftool/dbconfig/20240830-035123-ladsgroup.json [production]
03:36 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P68283 and previous config saved to /var/cache/conftool/dbconfig/20240830-033616-ladsgroup.json [production]
03:21 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P68282 and previous config saved to /var/cache/conftool/dbconfig/20240830-032109-ladsgroup.json [production]
03:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189 (T370903)', diff saved to https://phabricator.wikimedia.org/P68281 and previous config saved to /var/cache/conftool/dbconfig/20240830-030602-ladsgroup.json [production]
02:58 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2189 (T370903)', diff saved to https://phabricator.wikimedia.org/P68280 and previous config saved to /var/cache/conftool/dbconfig/20240830-025809-ladsgroup.json [production]
02:58 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2189.codfw.wmnet with reason: Maintenance [production]
02:57 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2189.codfw.wmnet with reason: Maintenance [production]
02:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T370903)', diff saved to https://phabricator.wikimedia.org/P68279 and previous config saved to /var/cache/conftool/dbconfig/20240830-025747-ladsgroup.json [production]