| 2024-11-14
      
      ยง | 
    
  | 18:13 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp4043.ulsfo.wmnet with reason: depooled, debugging | [production] | 
            
  | 18:13 | <sukhe@cumin1002> | START - Cookbook sre.hosts.downtime for 4:00:00 on cp4043.ulsfo.wmnet with reason: depooled, debugging | [production] | 
            
  | 18:11 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" | [production] | 
            
  | 18:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1311.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:05 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1308.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:04 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1190 gradually with 4 steps - Maint over | [production] | 
            
  | 18:02 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1309.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:01 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1312.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:59 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1307.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:57 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1310.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:53 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2139.codfw.wmnet with reason: host reimage | [production] | 
            
  | 17:52 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1306.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:49 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1311.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:46 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1308.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:45 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1312.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:45 | <jhancock@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2139.codfw.wmnet with reason: host reimage | [production] | 
            
  | 17:44 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1311.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:43 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1310.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:42 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1309.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:39 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1309.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:39 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1307.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:37 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1308.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:37 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1307.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:32 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1306.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:29 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1306.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:27 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host wikikube-worker2139.codfw.wmnet with OS bookworm | [production] | 
            
  | 17:26 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1312.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:25 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1311.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:25 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1310.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:24 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) status all services in all: None - None | [production] | 
            
  | 17:24 | <swfrench@cumin2002> | START - Cookbook sre.discovery.datacenter status all services in all: None - None | [production] | 
            
  | 17:21 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1309.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:19 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1308.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:19 | <ladsgroup@cumin1002> | START - Cookbook sre.mysql.pool db1190 gradually with 4 steps - Maint over | [production] | 
            
  | 17:18 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) depool all active/active services in eqiad: Network maintenance - None | [production] | 
            
  | 17:18 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1307.eqiad.wmnet with OS bullseye | [production] | 
            
  | 17:15 | <fabfur@cumin1002> | conftool action : set/pooled=no; selector: name=4043.ulsfo.wmnet | [production] | 
            
  | 17:13 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2139.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | [production] | 
            
  | 17:13 | <elukey@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 17:13 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1306.eqiad.wmnet with OS bullseye | [production] | 
            
  | 16:59 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1305.eqiad.wmnet with OS bullseye | [production] | 
            
  | 16:57 | <swfrench@cumin2002> | START - Cookbook sre.discovery.datacenter depool all active/active services in eqiad: Network maintenance - None | [production] | 
            
  | 16:52 | <mfossati@deploy2002> | Finished deploy [airflow-dags/platform_eng@7c4873e]: decouple article-level image suggestions from section-level ones (duration: 00m 53s) | [production] | 
            
  | 16:51 | <mfossati@deploy2002> | Started deploy [airflow-dags/platform_eng@7c4873e]: decouple article-level image suggestions from section-level ones | [production] | 
            
  | 16:45 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) status all services in all: None - None | [production] | 
            
  | 16:45 | <swfrench@cumin2002> | START - Cookbook sre.discovery.datacenter status all services in all: None - None | [production] | 
            
  | 16:41 | <wmbot~bd808@tools-bastion-12> | Restored service.template; changed health check to hit a PHP page | [tools.sal] | 
            
  | 16:40 | <James_F> | Zuul: [mediawiki/extensions/EmailNotifications] Disable selenium testing | [releng] | 
            
  | 16:40 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1305.eqiad.wmnet with reason: host reimage | [production] |