| 2023-08-03
      
      ยง | 
    
  | 15:23 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-misc: apply | [production] | 
            
  | 15:23 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-misc: apply | [production] | 
            
  | 15:23 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 15:22 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 15:22 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 15:22 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 15:22 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 15:21 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 15:21 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 15:20 | <moritzm> | installing glibc security updates on bookworm | [production] | 
            
  | 15:20 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 15:20 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 15:19 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 15:19 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 15:13 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 15:13 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 15:13 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 15:13 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 15:12 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 15:11 | <jgiannelos@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:11 | <jgiannelos@deploy1002> | helmfile [eqiad] START helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:11 | <jgiannelos@deploy1002> | helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:10 | <jgiannelos@deploy1002> | helmfile [codfw] START helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:10 | <jgiannelos@deploy1002> | helmfile [staging] DONE helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:10 | <jgiannelos@deploy1002> | helmfile [staging] START helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:09 | <jgiannelos@deploy1002> | helmfile [staging] DONE helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:09 | <jgiannelos@deploy1002> | helmfile [staging] START helmfile.d/services/wikifeeds: apply | [production] | 
            
  | 15:07 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 15:07 | <pt1979@cumin2002> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 15:05 | <cgoubert@cumin1001> | START - Cookbook sre.hosts.reimage for host kubernetes1025.eqiad.wmnet with OS bullseye | [production] | 
            
  | 15:02 | <claime> | Run homer on lsw1-f3-eqiad for kubernetes102[5-6] imaging - T343306 | [production] | 
            
  | 14:46 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host titan2001.codfw.wmnet with OS bookworm | [production] | 
            
  | 14:46 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" | [production] | 
            
  | 14:22 | <kamila@deploy1002> | helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply | [production] | 
            
  | 14:22 | <kamila@deploy1002> | helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply | [production] | 
            
  | 14:21 | <kamila@deploy1002> | helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply | [production] | 
            
  | 14:21 | <kamila@deploy1002> | helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply | [production] | 
            
  | 14:19 | <pt1979@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" | [production] | 
            
  | 14:05 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on titan2001.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:02 | <pt1979@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on titan2001.codfw.wmnet with reason: host reimage | [production] | 
            
  | 13:58 | <jforrester@deploy1002> | Finished scap: Backport for [[gerrit:945603|[Wikifunctions] Allow logged-in users to make function calls again]] (duration: 08m 24s) | [production] | 
            
  | 13:51 | <jforrester@deploy1002> | jforrester: Continuing with sync | [production] | 
            
  | 13:51 | <jforrester@deploy1002> | jforrester: Backport for [[gerrit:945603|[Wikifunctions] Allow logged-in users to make function calls again]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) | [production] | 
            
  | 13:49 | <jforrester@deploy1002> | Started scap: Backport for [[gerrit:945603|[Wikifunctions] Allow logged-in users to make function calls again]] | [production] | 
            
  | 13:46 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 13:46 | <pt1979@cumin2002> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 13:45 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 13:45 | <pt1979@cumin2002> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['titan2002'] | [production] | 
            
  | 13:40 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['titan2001'] | [production] | 
            
  | 13:35 | <pt1979@cumin2002> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['titan2001'] | [production] |