1-50 of 10000 results (54ms)
2022-12-20 ยง
23:22 <ryankemper> [WDQS] Powercycling `wdqs1005` [production]
23:20 <eileen> evision changed from 6d8c98a7 to 52a513cb [production]
20:39 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
20:16 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
20:10 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
20:09 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
20:01 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
20:01 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
20:00 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
19:58 <bking@cumin1001> START - Cookbook sre.wdqs.reboot [production]
18:07 <mutante> otrs1001 - upgraded clamav daemon package, manually removed run dir and pid file, stopped, started clamav daemon [production]
16:50 <dancy@deploy1002> scap failed: NameError name 'SyslogFormatter' is not defined (duration: 00m 00s) [production]
16:49 <dancy@deploy1002> scap failed: NameError name 'SyslogFormatter' is not defined (duration: 00m 00s) [production]
16:45 <dancy@deploy1002> scap failed: NameError name 'logging' is not defined (duration: 00m 00s) [production]
16:19 <dancy@deploy1002> backport aborted: (duration: 00m 01s) [production]
16:17 <dancy@deploy1002> backport aborted: (duration: 00m 04s) [production]
16:00 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-jumbo1012.eqiad.wmnet with OS bullseye [production]
16:00 <btullis@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
15:59 <btullis@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
15:47 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-jumbo1012.eqiad.wmnet with reason: host reimage [production]
15:42 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-jumbo1012.eqiad.wmnet with reason: host reimage [production]
15:25 <moritzm> installing jupyter-core security updates [production]
14:38 <btullis@cumin1001> START - Cookbook sre.hosts.reimage for host kafka-jumbo1012.eqiad.wmnet with OS bullseye [production]
14:31 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-jumbo1011.eqiad.wmnet with OS bullseye [production]
14:31 <btullis@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
14:29 <btullis@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
14:19 <moritzm> installing libpgjava security updates [production]
14:17 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-jumbo1011.eqiad.wmnet with reason: host reimage [production]
14:16 <moritzm> installing jackson-databind security updates [production]
14:14 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-jumbo1011.eqiad.wmnet with reason: host reimage [production]
14:10 <moritzm> installing ruby-rails-html-sanitizer security updates [production]
13:04 <aikochou@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:58 <aikochou@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
12:13 <btullis@cumin1001> START - Cookbook sre.hosts.reimage for host kafka-jumbo1011.eqiad.wmnet with OS bullseye [production]
11:31 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lists1001.wikimedia.org [production]
11:26 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host lists1001.wikimedia.org [production]
11:16 <moritzm> installing apache2 security updates on Buster [production]
11:03 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host archiva1002.wikimedia.org [production]
10:59 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host archiva1002.wikimedia.org [production]
10:55 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host matomo1002.eqiad.wmnet [production]
10:51 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host matomo1002.eqiad.wmnet [production]
10:42 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-web1001.eqiad.wmnet [production]
10:35 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host an-web1001.eqiad.wmnet [production]
10:34 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1009.eqiad.wmnet [production]
10:29 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host an-tool1009.eqiad.wmnet [production]
10:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1008.eqiad.wmnet [production]
10:25 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host an-tool1008.eqiad.wmnet [production]
10:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1010.eqiad.wmnet [production]
10:19 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host an-tool1010.eqiad.wmnet [production]
10:16 <moritzm> rebalance ganeti cluster in ulsfo after adding new node and decom of the old hardware T317247 [production]