| 2025-01-16
      
      ยง | 
    
  | 16:44 | <kamila@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1113 | [production] | 
            
  | 16:43 | <kamila@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:43 | <kamila@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1113 | [production] | 
            
  | 16:43 | <kamila@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:43 | <kamila@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1460 to wikikube-worker1113 - kamila@cumin1002" | [production] | 
            
  | 16:42 | <kamila@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1460 to wikikube-worker1113 - kamila@cumin1002" | [production] | 
            
  | 16:39 | <kamila@cumin1002> | END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1449 to wikikube-worker1112 | [production] | 
            
  | 16:39 | <topranks> | manually restarting netbox service on netbox1003 to update interface validator | [production] | 
            
  | 16:39 | <kamila@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1112 | [production] | 
            
  | 16:38 | <kamila@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:38 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1461 to wikikube-worker1114 | [production] | 
            
  | 16:38 | <kamila@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1112 | [production] | 
            
  | 16:38 | <kamila@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:38 | <kamila@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1449 to wikikube-worker1112 - kamila@cumin1002" | [production] | 
            
  | 16:38 | <cmooney@cumin1002> | END (FAIL) - Cookbook sre.netbox.update-extras (exit_code=1) rolling restart_daemons on A:netbox | [production] | 
            
  | 16:37 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/eventstreams: apply | [production] | 
            
  | 16:37 | <cmooney@cumin1002> | START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox | [production] | 
            
  | 16:37 | <kamila@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1449 to wikikube-worker1112 - kamila@cumin1002" | [production] | 
            
  | 16:37 | <cmooney@cumin1002> | END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary | [production] | 
            
  | 16:37 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/eventstreams: apply | [production] | 
            
  | 16:36 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1460 to wikikube-worker1113 | [production] | 
            
  | 16:36 | <kamila@cumin1002> | END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1448 to wikikube-worker1111 | [production] | 
            
  | 16:36 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply | [production] | 
            
  | 16:35 | <cmooney@cumin1002> | START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary | [production] | 
            
  | 16:35 | <kamila@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1111 | [production] | 
            
  | 16:35 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/eventstreams: apply | [production] | 
            
  | 16:34 | <kamila@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1111 | [production] | 
            
  | 16:34 | <kamila@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:34 | <kamila@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1448 to wikikube-worker1111 - kamila@cumin1002" | [production] | 
            
  | 16:34 | <kamila@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:34 | <kamila@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1448 to wikikube-worker1111 - kamila@cumin1002" | [production] | 
            
  | 16:33 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1449 to wikikube-worker1112 | [production] | 
            
  | 16:29 | <kamila@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:28 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1448 to wikikube-worker1111 | [production] | 
            
  | 16:25 | <kamila@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw[1448-1449,1460-1463].eqiad.wmnet | [production] | 
            
  | 16:22 | <kamila@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host mw[1448-1449,1460-1463].eqiad.wmnet | [production] | 
            
  | 16:21 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/mobileapps: apply | [production] | 
            
  | 16:21 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/mobileapps: apply | [production] | 
            
  | 16:19 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply | [production] | 
            
  | 16:19 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/mobileapps: apply | [production] | 
            
  | 16:05 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1112047|dbconfig: Order json output entries]] (duration: 18m 52s) | [production] | 
            
  | 15:58 | <ladsgroup@deploy2002> | ladsgroup: Continuing with sync | [production] | 
            
  | 15:54 | <kamila@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1107-1110].eqiad.wmnet | [production] | 
            
  | 15:54 | <kamila@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1107-1110].eqiad.wmnet | [production] | 
            
  | 15:53 | <ladsgroup@deploy2002> | ladsgroup: Backport for [[gerrit:1112047|dbconfig: Order json output entries]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 15:52 | <kamila@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1107.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:51 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/eventstreams: sync | [production] | 
            
  | 15:51 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/eventstreams: sync | [production] | 
            
  | 15:46 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1112047|dbconfig: Order json output entries]] | [production] | 
            
  | 15:44 | <lucaswerkmeister-wmde@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1111949|Check known-good regex patterns directly (T380751)]] (duration: 14m 32s) | [production] |