| 2024-06-28
      
      ยง | 
    
  | 11:50 | <Dreamy_Jazz> | Finished run on `medium.dblist` | [production] | 
            
  | 11:47 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1028.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 11:45 | <btullis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply | [production] | 
            
  | 11:45 | <btullis@deploy1002> | helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply | [production] | 
            
  | 11:45 | <btullis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply | [production] | 
            
  | 11:44 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1028.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 11:44 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1029.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:44 | <btullis@deploy1002> | helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply | [production] | 
            
  | 11:44 | <cgoubert@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wikikube-worker1029.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:38 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1030.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:38 | <cgoubert@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wikikube-worker1030.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:35 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1031.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 11:31 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1031.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 11:31 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:30 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:29 | <jnuche@deploy1002> | Finished deploy [releng/jenkins-deploy@9b733de] (releasing): (no justification provided) (duration: 00m 44s) | [production] | 
            
  | 11:29 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1029.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:29 | <cgoubert@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wikikube-worker1029.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:29 | <jnuche@deploy1002> | Started deploy [releng/jenkins-deploy@9b733de] (releasing): (no justification provided) | [production] | 
            
  | 11:26 | <btullis@deploy1002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 11:24 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1028.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:23 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1028.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:18 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1031.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:18 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1031.eqiad.wmnet on all recursors | [production] | 
            
  | 11:18 | <cgoubert@cumin1002> | START - Cookbook sre.dns.wipe-cache wikikube-worker1031.eqiad.wmnet on all recursors | [production] | 
            
  | 11:17 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1450 to wikikube-worker1031 | [production] | 
            
  | 11:17 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1031 | [production] | 
            
  | 11:16 | <cgoubert@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1031 | [production] | 
            
  | 11:16 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 11:16 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1450 to wikikube-worker1031 - cgoubert@cumin1002" | [production] | 
            
  | 11:16 | <btullis@deploy1002> | helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 11:15 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1028.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:15 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1028.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:14 | <cgoubert@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1450 to wikikube-worker1031 - cgoubert@cumin1002" | [production] | 
            
  | 11:13 | <jnuche@deploy1002> | Finished deploy [releng/jenkins-deploy@9b733de] (releasing): (no justification provided) (duration: 00m 25s) | [production] | 
            
  | 11:13 | <Dreamy_Jazz> | Running `foreachwikiindblist medium.dblist extensions/CheckUser/maintenance/deleteReadOldRowsInCuChanges.php --batch-size=200` for T366781. `medium.dblist` does not include `loginwiki` or `metawiki` (which are to be done later). | [production] | 
            
  | 11:12 | <jnuche@deploy1002> | Started deploy [releng/jenkins-deploy@9b733de] (releasing): (no justification provided) | [production] | 
            
  | 11:11 | <Dreamy_Jazz> | `foreachwikiindblist group1-wikipedia.dblist extensions/CheckUser/maintenance/deleteReadOldRowsInCuChanges.php --batch-size=200` finished running | [production] | 
            
  | 11:11 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1030.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:11 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1030.eqiad.wmnet on all recursors | [production] | 
            
  | 11:11 | <cgoubert@cumin1002> | START - Cookbook sre.dns.wipe-cache wikikube-worker1030.eqiad.wmnet on all recursors | [production] | 
            
  | 11:09 | <cgoubert@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 11:09 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.rename from mw1450 to wikikube-worker1031 | [production] | 
            
  | 11:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw1418 to wikikube-worker1030 | [production] | 
            
  | 11:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1030 | [production] | 
            
  | 11:07 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:07 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 11:06 | <jelto@cumin1002> | END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab to new version | [production] | 
            
  | 11:04 | <cgoubert@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1030 | [production] | 
            
  | 11:04 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] |