1351-1400 of 10000 results (33ms)
2021-02-02 ยง
12:46 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on cescout1001.eqiad.wmnet with reason: rebooting for kernel update [production]
12:46 <sukhe@cumin1001> START - Cookbook sre.hosts.downtime for 0:10:00 on cescout1001.eqiad.wmnet with reason: rebooting for kernel update [production]
12:46 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki2001.codfw.wmnet [production]
12:46 <klausman@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host ml-etcd1002.eqiad.wmnet [production]
12:46 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetboard1002.eqiad.wmnet [production]
12:44 <klausman@cumin2001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host ml-etcd2001.codfw.wmnet [production]
12:43 <klausman@cumin1001> START - Cookbook sre.ganeti.makevm for new host ml-etcd1002.eqiad.wmnet [production]
12:43 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki1001.eqiad.wmnet [production]
12:43 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetboard2002.codfw.wmnet [production]
12:42 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host puppetboard1002.eqiad.wmnet [production]
12:42 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install4001.wikimedia.org [production]
12:42 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install5001.wikimedia.org [production]
12:41 <klausman@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host ml-etcd1001.eqiad.wmnet [production]
12:41 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host puppetboard2002.codfw.wmnet [production]
12:40 <klausman@cumin2001> START - Cookbook sre.ganeti.makevm for new host ml-etcd2001.codfw.wmnet [production]
12:40 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install2003.wikimedia.org [production]
12:40 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host pki2001.codfw.wmnet [production]
12:39 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install3001.wikimedia.org [production]
12:38 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host pki1001.eqiad.wmnet [production]
12:38 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install1003.wikimedia.org [production]
12:37 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host install5001.wikimedia.org [production]
12:37 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host install4001.wikimedia.org [production]
12:36 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host install3001.wikimedia.org [production]
12:35 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host install2003.wikimedia.org [production]
12:35 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host install1003.wikimedia.org [production]
12:34 <klausman@cumin2001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host ml-etcd2001.codfw.wmnet [production]
12:34 <urbanecm@deploy1001> Synchronized docroot/noc/conf/index.php: 995649efafc2f5a44824af1e96128baaf15ef928: noc: yaml files may be published w/o .txt extension (duration: 00m 57s) [production]
12:34 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp1001.wikimedia.org [production]
12:33 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt1001.wikimedia.org [production]
12:30 <klausman@cumin2001> START - Cookbook sre.ganeti.makevm for new host ml-etcd2001.codfw.wmnet [production]
12:30 <klausman@cumin2001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host ml-etcd2001.codfw.wmnet [production]
12:29 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host idp1001.wikimedia.org [production]
12:29 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host apt1001.wikimedia.org [production]
12:26 <urbanecm@deploy1001> Synchronized docroot/noc/createTxtFileSymlinks.sh: 210647e915c91a4bddf0407d05436a9e231d3f29: noc: Publicly expose logos/config.yaml (2/2; T273330) (duration: 00m 55s) [production]
12:23 <urbanecm@deploy1001> Synchronized docroot/noc/conf/logos-config.yaml: 210647e915c91a4bddf0407d05436a9e231d3f29: noc: Publicly expose logos/config.yaml (1/2; T273330) (duration: 00m 57s) [production]
12:22 <klausman@cumin2001> START - Cookbook sre.ganeti.makevm for new host ml-etcd2001.codfw.wmnet [production]
12:20 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.27/extensions/GrowthExperiments/includes/HomepageModules/Banner.php: da8f328640ca5c46385a57e706cd76614bbfdc7a: Banner module: Switch to using activated/unactivated for state (T273084) (duration: 00m 58s) [production]
12:18 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.27/extensions/GrowthExperiments/includes/Specials/SpecialHomepage.php: 18c59d018b6ef72c750e25588518d2df6f492db3: SpecialHomepage: Do not load start-startediting if SE arent enabled (T273243) (duration: 01m 01s) [production]
12:18 <klausman@cumin1001> START - Cookbook sre.ganeti.makevm for new host ml-etcd1001.eqiad.wmnet [production]
12:16 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt2001.wikimedia.org [production]
12:15 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2001.wikimedia.org [production]
12:15 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp2001.wikimedia.org [production]
12:14 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host apt2001.wikimedia.org [production]
12:14 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1001.wikimedia.org [production]
12:13 <jbond42> upload cas_6.3 package [production]
12:12 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host idp2001.wikimedia.org [production]
12:12 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host idp-test2001.wikimedia.org [production]
12:11 <jbond@cumin1001> START - Cookbook sre.hosts.reboot-single for host idp-test1001.wikimedia.org [production]
11:06 <jynus@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1171.eqiad.wmnet with reason: REIMAGE [production]
11:04 <jynus@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1171.eqiad.wmnet with reason: REIMAGE [production]