5201-5250 of 10000 results (108ms)
2024-05-30 ยง
16:32 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for lsw1-d3-codfw - pt1979@cumin2002" [production]
16:32 <kamila@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
16:31 <kamila@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
16:31 <kamila@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:31 <kamila@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
16:31 <kamila@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
16:31 <kamila@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
16:25 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
16:25 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply [production]
16:25 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:24 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:24 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
16:23 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-media: apply [production]
16:23 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:23 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
16:23 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
16:23 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:23 <pt1979@cumin2002> START - Cookbook sre.network.provision for device lsw1-d3-codfw.mgmt.codfw.wmnet [production]
16:22 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
16:22 <pt1979@cumin2002> END (PASS) - Cookbook sre.network.provision (exit_code=0) for device lsw1-d2-codfw.mgmt.codfw.wmnet [production]
16:22 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]
16:21 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-timeline: apply [production]
16:21 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P63714 and previous config saved to /var/cache/conftool/dbconfig/20240530-162040-marostegui.json [production]
16:20 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:20 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
16:20 <sukhe> [correction] sudo homer cr*magru* commit "add 198.35.27.0/24 for magru to announce ns2.wikimedia.org": T346722 [production]
16:20 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
16:20 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:20 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:20 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
16:19 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
16:19 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
16:18 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:17 <sukhe> sudo homer asw*magru* commit "add 198.35.27.0/24 for magru to announce ns2.wikimedia.org": T346722 [production]
16:15 <kamila@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:14 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main1009.eqiad.wmnet with OS bullseye [production]
16:14 <kamila@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
16:13 <pt1979@cumin2002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
16:12 <dancy@deploy1002> Finished scap: Backport for [[gerrit:1029664|Migrate `wmfstatic` metrics to Prometheus store (T359255)]] (duration: 17m 19s) [production]
16:09 <kamila@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:08 <kamila@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
16:08 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:07 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
16:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T364299)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20240530-160528-marostegui.json [production]
16:04 <logmsgbot> @deploy1002 helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:04 <logmsgbot> @deploy1002 helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:03 <dancy@deploy1002> denisse and dancy: Continuing with sync [production]
15:59 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=dns700[1-2].wikimedia.org,service=authdns-ns2 [production]
15:58 <akosiaris@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1009.eqiad.wmnet with reason: host reimage [production]