601-650 of 10000 results (33ms)
2021-02-12 ยง
17:43 <joal> Rerun wikidata-json_entity-weekly-wf-2021-02-01 [analytics]
17:33 <elukey@cumin1001> END (PASS) - Cookbook sre.presto.reboot-workers (exit_code=0) for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
17:23 <bblack> cp*: re-enabling puppet after successful agent run on one host as a test! [production]
17:19 <brennen> Publishing from dev-images docker-pkg files on primary contint for fr-tech images [releng]
17:13 <bblack> cp*: disable puppet ahead of https://gerrit.wikimedia.org/r/c/operations/puppet/+/663845 [production]
17:12 <bstorm> started quarry-dev-01 T264254 [quarry]
17:08 <elukey> reboot presto workers for kernel upgrade [analytics]
17:08 <elukey@cumin1001> START - Cookbook sre.presto.reboot-workers for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
17:01 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1005.eqiad.wmnet [production]
16:48 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-tool1005.eqiad.wmnet [production]
16:45 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-ui1001.eqiad.wmnet [production]
16:43 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-ui1001.eqiad.wmnet [production]
16:43 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1001.eqiad.wmnet [production]
16:38 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-client1001.eqiad.wmnet [production]
16:32 <mforns> finished deployment of analytics-refinery [analytics]
16:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-druid1001.eqiad.wmnet [production]
16:26 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-druid1001.eqiad.wmnet [production]
16:12 <mforns@deploy1001> Finished deploy [analytics/refinery@9cd1297] (hadoop-test): Fix for data quality alarms after BigTop migration TEST [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] (duration: 04m 05s) [production]
16:11 <hnowlan> joining maps2007 to cassandra cluster [production]
16:08 <mforns@deploy1001> Started deploy [analytics/refinery@9cd1297] (hadoop-test): Fix for data quality alarms after BigTop migration TEST [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] [production]
16:08 <mforns@deploy1001> Finished deploy [analytics/refinery@9cd1297] (thin): Fix for data quality alarms after BigTop migration THIN [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] (duration: 00m 06s) [production]
16:07 <mforns@deploy1001> Started deploy [analytics/refinery@9cd1297] (thin): Fix for data quality alarms after BigTop migration THIN [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] [production]
16:07 <mforns@deploy1001> Finished deploy [analytics/refinery@9cd1297]: Fix for data quality alarms after BigTop migration [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] (duration: 38m 56s) [production]
15:28 <mforns@deploy1001> Started deploy [analytics/refinery@9cd1297]: Fix for data quality alarms after BigTop migration [analytics/refinery@9cd129764edbac04b192c922ec0a975bc47455a5] [production]
15:26 <mforns> started deployment of analytics-refinery [analytics]
15:22 <herron> rolling reboot of alert[12]001 hosts for updates [production]
15:16 <elukey> roll restart druid broker on druid-public to pick up new settings [analytics]
15:16 <elukey> roll restart druid broker on druid-public to pick up new settings [production]
14:39 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1022.eqiad.wmnet [production]
14:32 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc1022.eqiad.wmnet [production]
14:04 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1090.eqiad.wmnet [production]
14:04 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1089.eqiad.wmnet [production]
14:03 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3065.esams.wmnet [production]
14:03 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3064.esams.wmnet [production]
13:52 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp3065.esams.wmnet [production]
13:52 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp3064.esams.wmnet [production]
13:52 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp1090.eqiad.wmnet [production]
13:51 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp1089.eqiad.wmnet [production]
13:10 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: name=maps1005.eqiad.wmnet [production]
12:12 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on maps2007.codfw.wmnet with reason: Resyncing database [production]
12:11 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on maps2007.codfw.wmnet with reason: Resyncing database [production]
12:05 <Lucas_WMDE> canceled one beta-scap-eqiad job per https://w.wiki/J5$ [releng]
11:44 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2042.codfw.wmnet [production]
11:44 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2041.codfw.wmnet [production]
11:32 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp2042.codfw.wmnet [production]
11:32 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp2041.codfw.wmnet [production]
11:27 <moritzm> installing emacs updates from buster point release [production]
11:25 <moritzm> installing device-tree-compiler updates from buster point release [production]
11:22 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1088.eqiad.wmnet [production]
11:22 <moritzm> installing node-ini security updates [production]