1-50 of 10000 results (94ms)
2024-12-02 ยง
23:58 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1091.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
23:50 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1091.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
23:50 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:50 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for ms-be - jclark@cumin1002" [production]
23:50 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for ms-be - jclark@cumin1002" [production]
23:46 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
22:27 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:27 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:27 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:26 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:25 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:24 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:21 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:20 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:20 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:18 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:18 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:16 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:16 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:05 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
22:05 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:45 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:40 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:36 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] (duration: 13m 22s) [production]
21:35 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:29 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:29 <urbanecm@deploy2002> migr, urbanecm: Continuing with sync [production]
21:27 <urbanecm@deploy2002> migr, urbanecm: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:22 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] [production]
21:21 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] (duration: 13m 40s) [production]
21:15 <urbanecm@deploy2002> kemayo, urbanecm, nmw03, sd: Continuing with sync [production]
21:14 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:12 <urbanecm@deploy2002> kemayo, urbanecm, nmw03, sd: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:12 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:09 <vriley@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:09 <vriley@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt ms-be1083 - vriley@cumin1002" [production]
21:09 <vriley@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt ms-be1083 - vriley@cumin1002" [production]
21:08 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] [production]
21:04 <vriley@cumin1002> START - Cookbook sre.dns.netbox [production]
20:10 <sukhe@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp3069.esams.wmnet [reason: done: checking icinga alerts] [production]
19:55 <sukhe@puppetserver1001> conftool action : set/pooled=no; selector: name=cp3069.esams.wmnet [reason: checking icinga alerts] [production]
19:22 <volans@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:22 <volans@cumin1002> START - Cookbook sre.hosts.provision for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:21 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs3010.esams.wmnet [production]
19:20 <volans@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:15 <dancy@deploy2002> Installation of scap version "4.131.0" completed for 207 hosts [production]
19:14 <sukhe@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs3010.esams.wmnet [production]
19:13 <sukhe> rebooting lvs3010 to test CR 1093958 [production]
19:11 <dancy@deploy2002> Installing scap version "4.131.0" for 207 hosts [production]