| 2024-11-15
      
      ยง | 
    
  | 13:59 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove e8 lo0 IP - ayounsi@cumin1002" | [production] | 
            
  | 13:59 | <ayounsi@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove e8 lo0 IP - ayounsi@cumin1002" | [production] | 
            
  | 13:57 | <fnegri@cloudcumin1001> | START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'tools-db' (T352206) | [tools] | 
            
  | 13:57 | <fnegri@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T352206) | [tools] | 
            
  | 13:57 | <fnegri@cloudcumin1001> | START - Cookbook wmcs.openstack.quota_increase (T352206) | [tools] | 
            
  | 13:55 | <ayounsi@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 13:55 | <ayounsi@cumin1002> | END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | [production] | 
            
  | 13:52 | <ayounsi@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 13:50 | <fnegri@cloudcumin1001> | END (FAIL) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=99) with prefix 'tools-db' (T352206) | [tools] | 
            
  | 13:49 | <fnegri@cloudcumin1001> | START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'tools-db' (T352206) | [tools] | 
            
  | 13:41 | <XioNoX> | test no-passwords on mr1-eqsin - T379464 | [production] | 
            
  | 13:31 | <ayounsi@cumin1002> | END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts sretest1004.eqiad.wmnet | [production] | 
            
  | 13:31 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 13:31 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: sretest1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - ayounsi@cumin1002" | [production] | 
            
  | 13:31 | <ayounsi@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: sretest1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - ayounsi@cumin1002" | [production] | 
            
  | 13:27 | <ayounsi@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 13:24 | <cmooney@cumin1002> | END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update homer wmf-plugin to export Netbox ipsec data - cmooney@cumin1002 | [production] | 
            
  | 13:23 | <ayounsi@cumin1002> | START - Cookbook sre.hosts.decommission for hosts sretest1004.eqiad.wmnet | [production] | 
            
  | 13:21 | <cmooney@cumin1002> | START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update homer wmf-plugin to export Netbox ipsec data - cmooney@cumin1002 | [production] | 
            
  | 13:19 | <cmooney@cumin1002> | END (FAIL) - Cookbook sre.deploy.python-code (exit_code=99) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update homer wmf-plugin to export Netbox ipsec data - cmooney@cumin1002 | [production] | 
            
  | 13:17 | <cmooney@cumin1002> | START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update homer wmf-plugin to export Netbox ipsec data - cmooney@cumin1002 | [production] | 
            
  | 13:01 | <moritzm> | imported 8u432-b06-2~deb12u1 to component/jdk8 for bookworm (forward port of the latest Java 8 security fixes for Bookworm) | [production] | 
            
  | 12:54 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host build2002.codfw.wmnet | [production] | 
            
  | 12:54 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host build2002.codfw.wmnet with OS bookworm | [production] | 
            
  | 12:51 | <arturo> | deployed new version of nova-fullstack, with IPv6 support (T379356) | [admin-monitoring] | 
            
  | 12:36 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on build2002.codfw.wmnet with reason: host reimage | [production] | 
            
  | 12:32 | <jmm@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on build2002.codfw.wmnet with reason: host reimage | [production] | 
            
  | 12:27 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply | [production] | 
            
  | 12:26 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply | [production] | 
            
  | 12:19 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply | [production] | 
            
  | 12:18 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 12:17 | <jmm@cumin2002> | START - Cookbook sre.hosts.reimage for host build2002.codfw.wmnet with OS bookworm | [production] | 
            
  | 12:17 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 12:16 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM build2002.codfw.wmnet - jmm@cumin2002" | [production] | 
            
  | 12:15 | <jmm@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM build2002.codfw.wmnet - jmm@cumin2002" | [production] | 
            
  | 12:15 | <jmm@cumin2002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) build2002.codfw.wmnet on all recursors | [production] | 
            
  | 12:15 | <jmm@cumin2002> | START - Cookbook sre.dns.wipe-cache build2002.codfw.wmnet on all recursors | [production] | 
            
  | 12:15 | <jmm@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 12:15 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM build2002.codfw.wmnet - jmm@cumin2002" | [production] | 
            
  | 12:11 | <cmooney@cumin1002> | END (FAIL) - Cookbook sre.netbox.update-extras (exit_code=1) rolling restart_daemons on A:netbox | [production] | 
            
  | 12:11 | <jmm@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM build2002.codfw.wmnet - jmm@cumin2002" | [production] | 
            
  | 12:08 | <aokoth@cumin1002> | END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Security Update | [production] | 
            
  | 12:03 | <jmm@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 12:03 | <jmm@cumin2002> | START - Cookbook sre.ganeti.makevm for new host build2002.codfw.wmnet | [production] | 
            
  | 12:01 | <cmooney@cumin1002> | START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox | [production] | 
            
  | 12:01 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.resource-report (exit_code=0) | [production] | 
            
  | 12:01 | <jmm@cumin2002> | START - Cookbook sre.ganeti.resource-report | [production] | 
            
  | 12:00 | <cmooney@cumin1002> | END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary | [production] | 
            
  | 11:58 | <cmooney@cumin1002> | START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary | [production] | 
            
  | 11:38 | <mfossati@deploy2002> | Finished deploy [airflow-dags/platform_eng@2c533d6]: hotfix image suggestions weekly snapshots (duration: 00m 57s) | [production] |