8551-8600 of 10000 results (32ms)
2020-07-20 ยง
14:52 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:52 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:51 <mholloway-shell@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
14:51 <mholloway-shell@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
14:49 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
14:49 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
14:49 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:47 <mholloway-shell@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
14:47 <moritzm> draining restbase2021 for eventual reboot for kernel security update [production]
14:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:43 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:37 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:36 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@ff49fdf]: Update mobileapps to 0bf7bafa (duration: 03m 50s) [production]
14:34 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:34 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:34 <hnowlan> starting drain and restart of sessionstore hosts for new kernel [production]
14:33 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:32 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@ff49fdf]: Update mobileapps to 0bf7bafa [production]
14:26 <moritzm> draining restbase2020 for eventual reboot for kernel security update [production]
14:23 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:23 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:20 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:17 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:14 <moritzm> draining restbase2019 for eventual reboot for kernel security update [production]
14:08 <ema> lvs101[34] (primaries) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
14:07 <ema> lvs1016 (secondary) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
14:06 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:02 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:59 <ema> lvs300[56] (primaries) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:57 <ema> lvs3007 (secondary) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:50 <ema> lvs500[12] (primaries) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:48 <moritzm> draining restbase2018 for eventual reboot for kernel security update [production]
13:47 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:47 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:47 <ema> lvs5003 (secondary) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:44 <ema> lvs200[78] (primaries) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:42 <ema> lvs2010 (secondary) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:34 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:31 <ema> lvs400[56] (primaries) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:31 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:27 <moritzm> draining restbase2017 for eventual reboot for kernel security update [production]
13:24 <ema> lvs4007 (secondary) - restart pybal to apply varnish healthcheck changes https://gerrit.wikimedia.org/r/c/operations/puppet/+/610047 T255015 [production]
13:22 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:16 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:09 <moritzm> draining restbase2016 for eventual reboot for kernel security update [production]
13:08 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:08 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:07 <moritzm> reset broken ifup systemd states on puppetdb* hosts [production]
13:05 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:01 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]