951-1000 of 10000 results (75ms)
2023-05-15 ยง
19:55 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2003.codfw.wmnet [production]
19:54 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp1003.eqiad.wmnet [production]
19:50 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic[2050-2054,2060,2067-2068,2072,2084-2086]* for row D switch upgrade - bking@cumin1001 - T335042 [production]
19:50 <bking@cumin1001> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic[2050-2054,2060,2067-2068,2072,2084-2086]* for row D switch upgrade - bking@cumin1001 - T335042 [production]
19:50 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2003.codfw.wmnet [production]
19:49 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.ban (exit_code=99) Banning hosts: elastic[2050-2054,2060,2067-2068,2072,2084-2086] for row D switch upgrade - bking@cumin1001 - T335042 [production]
19:49 <bking@cumin1001> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic[2050-2054,2060,2067-2068,2072,2084-2086] for row D switch upgrade - bking@cumin1001 - T335042 [production]
19:47 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp1003.eqiad.wmnet [production]
19:47 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 2:00:00 on 20 hosts with reason: T335042 maintenance [production]
19:47 <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 2:00:00 on 20 hosts with reason: T335042 maintenance [production]
19:40 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2002.codfw.wmnet [production]
19:37 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp1002.eqiad.wmnet [production]
19:33 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp1002.eqiad.wmnet [production]
19:32 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2002.codfw.wmnet [production]
19:28 <bking@deploy1002> Finished deploy [wdqs/wdqs@41174d5] (wcqs): deploy 0.3.124 to WCQS (duration: 02m 03s) [production]
19:26 <bking@deploy1002> Started deploy [wdqs/wdqs@41174d5] (wcqs): deploy 0.3.124 to WCQS [production]
19:23 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp1001.eqiad.wmnet [production]
19:22 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-gp2001.codfw.wmnet [production]
19:19 <bking@deploy1002> Finished deploy [wdqs/wdqs@41174d5]: (no justification provided) (duration: 00m 05s) [production]
19:19 <bking@deploy1002> Started deploy [wdqs/wdqs@41174d5]: (no justification provided) [production]
19:18 <bking@deploy1002> Finished deploy [wdqs/wdqs@41174d5]: (no justification provided) (duration: 00m 05s) [production]
19:18 <bking@deploy1002> Started deploy [wdqs/wdqs@41174d5]: (no justification provided) [production]
19:18 <bking@deploy1002> Finished deploy [wdqs/wdqs@41174d5]: (no justification provided) (duration: 05m 46s) [production]
19:15 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp1001.eqiad.wmnet [production]
19:15 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2001.codfw.wmnet [production]
19:12 <bking@deploy1002> Started deploy [wdqs/wdqs@41174d5]: (no justification provided) [production]
19:12 <bking@deploy1002> Finished deploy [wdqs/wdqs@41174d5]: 0.3.124 (duration: 10m 05s) [production]
19:03 <inflatador> [WDQS Deploy] Tests passing following deploy of `0.3.124` on canary `wdqs1003`; proceeding to rest of fleet [production]
19:02 <bking@deploy1002> Started deploy [wdqs/wdqs@41174d5]: 0.3.124 [production]
18:54 <mutante> LDAP - added uid 'adee' to groups wmde and nda - T336434 [production]
18:54 <sukhe> set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.48 208.80.153.10 ]: codfw row D maint 2023/05/16 [dns2002] T335042 [production]
18:33 <brett> Rolling out maglev LVS scheduler in eqsin - T263797 [production]
18:11 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dns2005.wikimedia.org with OS bullseye [production]
18:11 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host dns2005.wikimedia.org with OS bullseye [production]
18:06 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dns2005.wikimedia.org with OS bullseye [production]
18:06 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host dns2005.wikimedia.org with OS bullseye [production]
17:47 <volans@cumin2002> END (FAIL) - Cookbook sre.network.provision (exit_code=99) for device ssw1-a1-codfw.mgmt.codfw.wmnet [production]
17:47 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:47 <volans@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin2002" [production]
17:46 <volans@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin2002" [production]
17:42 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
17:42 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:42 <volans@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a1-codfw - volans@cumin2002" [production]
17:41 <volans@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add management record for ssw1-a1-codfw - volans@cumin2002" [production]
17:39 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
17:39 <volans@cumin2002> START - Cookbook sre.network.provision for device ssw1-a1-codfw.mgmt.codfw.wmnet [production]
17:30 <volans@cumin2002> END (FAIL) - Cookbook sre.network.provision (exit_code=99) for device ssw1-a1-codfw.mgmt.codfw.wmnet [production]
17:30 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:30 <volans@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin2002" [production]
17:29 <volans@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove management record for ssw1-a1-codfw - volans@cumin2002" [production]