7751-7800 of 10000 results (31ms)
2023-07-05 ยง
12:53 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1019.eqiad.wmnet [production]
12:53 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1019.eqiad.wmnet [production]
12:46 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1019.eqiad.wmnet [production]
12:34 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1019.eqiad.wmnet [production]
12:34 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cloudsw-b1.private.codfw.wikimedia.cloud on all recursors [production]
12:34 <aborrero@cumin2002> START - Cookbook sre.dns.wipe-cache cloudsw-b1.private.codfw.wikimedia.cloud on all recursors [production]
12:31 <aborrero@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:31 <aborrero@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudsw-b1 codfw - aborrero@cumin2002" [production]
12:30 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudsw-b1 codfw - aborrero@cumin2002" [production]
12:30 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1018.eqiad.wmnet [production]
12:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1018.eqiad.wmnet [production]
12:28 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow4002.ulsfo.wmnet [production]
12:28 <aborrero@cumin2002> START - Cookbook sre.dns.netbox [production]
12:23 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netflow4002.ulsfo.wmnet [production]
12:22 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1018.eqiad.wmnet [production]
12:11 <hashar> Building dev-images for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/36 | "Install Xdebug from Debian package, update source of php72 and php74" | T338208 [releng]
11:59 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts urldownloader1001.wikimedia.org [production]
11:59 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader1001.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:59 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:59 <hashar> Successfully published image docker-registry.discovery.wmnet/dev/fundraising-civiproxy-buster-php73-apache2:0.0.1-1-s4 [releng]
11:58 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader1001.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:55 <hashar> Building dev-images [releng]
11:55 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
11:51 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts urldownloader1001.wikimedia.org [production]
11:50 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts urldownloader1002.wikimedia.org [production]
11:50 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:50 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader1002.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:47 <gmodena@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:47 <gmodena@deploy1002> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:47 <btullis> restarted archiva for T329716 [analytics]
11:45 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader1002.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1018.eqiad.wmnet [production]
11:45 <gmodena@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:45 <gmodena@deploy1002> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
11:45 <btullis> restarted hive-servers2 and hive-metastore service on an-coord1002 [analytics]
11:43 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
11:40 <btullis> roll-restarting kafka-jumbo brokers for T329716 [analytics]
11:39 <btullis@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-jumbo-eqiad cluster: Roll restart of jvm daemons. [production]
11:37 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts urldownloader1002.wikimedia.org [production]
11:36 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts urldownloader2002.wikimedia.org [production]
11:36 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:36 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader2002.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:34 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: urldownloader2002.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
11:32 <btullis@cumin1001> END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) for Presto analytics cluster: Roll restart of all Presto's jvm daemons. [production]
11:31 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
11:28 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1017.eqiad.wmnet [production]
11:27 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1017.eqiad.wmnet [production]
11:25 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts urldownloader2002.wikimedia.org [production]
11:25 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts urldownloader2001.wikimedia.org [production]
11:25 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]