5401-5450 of 10000 results (108ms)
2024-04-17 ยง
16:29 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
16:27 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
16:25 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:24 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
16:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P60800 and previous config saved to /var/cache/conftool/dbconfig/20240417-162008-marostegui.json [production]
16:19 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2127', diff saved to https://phabricator.wikimedia.org/P60799 and previous config saved to /var/cache/conftool/dbconfig/20240417-161958-arnaudb.json [production]
16:18 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:18 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
16:17 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
16:14 <claime> restarted rsyslog on mw2412 - T357616 [production]
16:13 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
16:10 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2119.codfw.wmnet [production]
16:10 <arnaudb@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:09 <cdanis> above conftool actions had no impact on production, no dbctl config commit was performed. [production]
16:09 <arnaudb@cumin1002> START - Cookbook sre.dns.netbox [production]
16:08 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:08 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
16:07 <cdanis@cumin1002> conftool action : set/host_ip=10.64.16.8; selector: name=db1211 [production]
16:07 <cdanis@cumin1002> conftool action : set/host_ip=1.1.1.1; selector: name=db1211 [production]
16:06 <cdanis@cumin1002> conftool action : set/host_ip=10.64.16.8; selector: name=db1211 [production]
16:06 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
16:05 <cdanis@cumin1002> conftool action : set/host_ip=69.69.69.69; selector: name=db1211 [production]
16:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P60798 and previous config saved to /var/cache/conftool/dbconfig/20240417-160501-marostegui.json [production]
16:04 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2127', diff saved to https://phabricator.wikimedia.org/P60797 and previous config saved to /var/cache/conftool/dbconfig/20240417-160451-arnaudb.json [production]
16:04 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2119 depool T358741', diff saved to https://phabricator.wikimedia.org/P60796 and previous config saved to /var/cache/conftool/dbconfig/20240417-160443-arnaudb.json [production]
16:04 <btullis@deploy1002> helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply [production]
16:04 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp1114.eqiad.wmnet,service=(cdn|ats-be) [production]
16:04 <btullis@deploy1002> helmfile [eqiad] START helmfile.d/services/geo-analytics: apply [production]
16:04 <btullis@deploy1002> helmfile [codfw] DONE helmfile.d/services/geo-analytics: apply [production]
16:03 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
16:03 <btullis@deploy1002> helmfile [codfw] START helmfile.d/services/geo-analytics: apply [production]
16:03 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/geo-analytics: apply [production]
16:03 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/geo-analytics: apply [production]
16:02 <arnaudb@cumin1002> START - Cookbook sre.hosts.decommission for hosts db2119.codfw.wmnet [production]
16:00 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:00 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
15:59 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
15:57 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
15:53 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:53 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
15:52 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding first entries for magru IPs - cmooney@cumin1002" [production]
15:51 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1114.eqiad.wmnet with OS bullseye [production]
15:50 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
15:45 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2120.codfw.wmnet [production]
15:45 <arnaudb@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:45 <arnaudb@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2120.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" [production]
15:44 <arnaudb@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2120.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" [production]
15:42 <arnaudb@cumin1002> START - Cookbook sre.dns.netbox [production]
15:40 <topranks> merging patch and updating dns servers with new magru ranges T362421 [production]
15:35 <arnaudb@cumin1002> START - Cookbook sre.hosts.decommission for hosts db2120.codfw.wmnet [production]