| 2024-12-16
      
      § | 
    
  | 07:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.move-vlan for host wikikube-worker2108 | [production] | 
            
  | 07:48 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2109 | [production] | 
            
  | 07:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.move-vlan for host wikikube-worker2109 | [production] | 
            
  | 07:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker2109.codfw.wmnet with OS bookworm | [production] | 
            
  | 07:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker2108.codfw.wmnet with OS bookworm | [production] | 
            
  | 07:45 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2108.codfw.wmnet | [production] | 
            
  | 07:44 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2108.codfw.wmnet | [production] | 
            
  | 07:44 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2109.codfw.wmnet | [production] | 
            
  | 07:43 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2109.codfw.wmnet | [production] | 
            
  | 03:24 | <JJMC89> | copypatrol-backend-prod-01 deploy e72437a..7fbf25d | [copypatrol] | 
            
  | 03:19 | <JJMC89> | copypatrol-backend-prod-01 deploy b0455da..e72437a | [copypatrol] | 
            
  | 03:04 | <JJMC89> | copypatrol-backend-prod-01 deploy 81ec727..b0455da T334264 | [copypatrol] | 
            
  
    | 2024-12-13
      
      § | 
    
  | 20:19 | <bking@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T376150, initialize wdqs internal main tier) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling source-only afterwards | [production] | 
            
  | 20:00 | <James_F> | Zuul: [design/codex] Switch Codex to Node 20 CI, for T343827 | [releng] | 
            
  | 19:57 | <James_F> | Zuul: Migrate all repos over to Node 20, except those that fail, for T343827 | [releng] | 
            
  | 19:53 | <James_F> | Zuul: Mark analytics/quarry/web as archived, for T308978 | [releng] | 
            
  | 19:53 | <James_F> | Zuul: Mark schemas/event/{primary,secondary} as archived, for T366836 | [releng] | 
            
  | 19:28 | <bking@cumin2002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudelastic1011.eqiad.wmnet with OS bullseye | [production] | 
            
  | 19:27 | <bking@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T376150, initialize wdqs internal main tier) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1025.eqiad.wmnet w/ force delete existing files, repooling source-only afterwards | [production] | 
            
  | 19:21 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wdqs1025.eqiad.wmnet with reason: T376150 | [production] | 
            
  | 19:21 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on wdqs1025.eqiad.wmnet with reason: T376150 | [production] | 
            
  | 19:10 | <mstyles@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:09 | <mstyles@deploy2002> | helmfile [eqiad] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:09 | <mstyles@deploy2002> | helmfile [codfw] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:09 | <mstyles@deploy2002> | helmfile [codfw] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:09 | <mstyles@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:09 | <mstyles@deploy2002> | helmfile [eqiad] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:08 | <mstyles@deploy2002> | helmfile [codfw] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:08 | <mstyles@deploy2002> | helmfile [codfw] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:08 | <mstyles@deploy2002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 19:07 | <mstyles@deploy2002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 18:26 | <bking@cumin2002> | START - Cookbook sre.hosts.reimage for host cloudelastic1011.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:25 | <bking@cumin2002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudelastic1011.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:15 | <James_F> | Docker: [operations-puppet] Fix mv logspam | [releng] | 
            
  | 18:12 | <James_F> | Zuul: Switch CI and production JS libraries that pass to Node 20, for T343827 | [releng] | 
            
  | 17:56 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2113.codfw.wmnet | [production] | 
            
  | 17:56 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2113.codfw.wmnet | [production] | 
            
  | 17:56 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2112.codfw.wmnet | [production] | 
            
  | 17:56 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2112.codfw.wmnet | [production] | 
            
  | 17:54 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2111.codfw.wmnet | [production] | 
            
  | 17:54 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2111.codfw.wmnet | [production] | 
            
  | 17:54 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2110.codfw.wmnet | [production] | 
            
  | 17:54 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2110.codfw.wmnet | [production] | 
            
  | 17:50 | <James_F> | Zuul: Mark mediawiki/event-schemas as archived, done 4 years ago; for T240985 | [releng] | 
            
  | 17:43 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2110.codfw.wmnet with OS bookworm | [production] | 
            
  | 17:41 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2111.codfw.wmnet with OS bookworm | [production] | 
            
  | 17:26 | <elukey@deploy2002> | helmfile [staging] DONE helmfile.d/services/kartotherian: sync | [production] | 
            
  | 17:24 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2110.codfw.wmnet with reason: host reimage | [production] |