| 2023-09-26
      
      ยง | 
    
  | 07:13 | <taavi@deploy2002> | Started scap: Backport for [[gerrit:958049|Enable wgMinervaEnableSiteNotice for knwiki (T346582)]], [[gerrit:960200|guwikisource: add audiobook namespace (T347189)]], [[gerrit:958946|add throttle rule for UIUC Wikipedia edit-a-thon October 13, 2023 (T346043)]] | [production] | 
            
  | 07:08 | <taavi@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol1007.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 07:05 | <taavi@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol1007.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 06:58 | <isaranto@deploy2002> | helmfile [ml-serve-eqiad] 'sync' command on namespace 'ores-legacy' for release 'main' . | [production] | 
            
  | 06:57 | <isaranto@deploy2002> | helmfile [ml-serve-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . | [production] | 
            
  | 06:56 | <isaranto@deploy2002> | helmfile [ml-staging-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . | [production] | 
            
  | 06:42 | <taavi@cumin1001> | START - Cookbook sre.hosts.reimage for host cloudcontrol1007.eqiad.wmnet with OS bullseye | [production] | 
            
  | 04:09 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db1229.eqiad.wmnet with OS bullseye | [production] | 
            
  | 03:54 | <mwpresync@deploy2002> | Pruned MediaWiki: 1.41.0-wmf.26 (duration: 02m 13s) | [production] | 
            
  | 03:52 | <mwpresync@deploy2002> | Finished scap: testwikis wikis to 1.41.0-wmf.28  refs T345889 (duration: 49m 31s) | [production] | 
            
  | 03:07 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1229.eqiad.wmnet with OS bullseye | [production] | 
            
  | 03:02 | <mwpresync@deploy2002> | Started scap: testwikis wikis to 1.41.0-wmf.28  refs T345889 | [production] | 
            
  | 02:44 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1232.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:43 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:42 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:42 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1231.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:42 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:41 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:39 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1233.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:39 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:39 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1230.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:39 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:37 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:37 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:30 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1226.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:30 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:29 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 02:27 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1232.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:25 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1231.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:23 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1233.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:20 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1230.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:20 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db1233.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:19 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db1232.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:18 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db1231.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:17 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db1230.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:14 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1226.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:11 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db1226.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 02:07 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1233.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:06 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1232.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:05 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1231.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:04 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1230.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:03 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1229.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:02 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1228.eqiad.wmnet with OS bullseye | [production] | 
            
  | 02:01 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1227.eqiad.wmnet with OS bullseye | [production] | 
            
  | 01:59 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host db1226.eqiad.wmnet with OS bullseye | [production] | 
            
  | 01:33 | <ejegg|food> | payments-wiki upgraded from 5596c7fd to 358e616e | [production] | 
            
  | 01:21 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1021.eqiad.wmnet with OS bullseye | [production] | 
            
  | 01:20 | <jclark@cumin1001> | START - Cookbook sre.hosts.reimage for host wdqs1021.eqiad.wmnet with OS bullseye | [production] | 
            
  | 01:20 | <jclark@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1017.eqiad.wmnet with OS bullseye | [production] | 
            
  | 01:19 | <jclark@cumin1001> | START - Cookbook sre.hosts.reimage for host wdqs1017.eqiad.wmnet with OS bullseye | [production] |