| 2025-01-15
      
      ยง | 
    
  | 15:53 | <moritzm> | installing libsoup2.4 security updates | [production] | 
            
  | 15:52 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1422 to wikikube-worker1103 | [production] | 
            
  | 15:51 | <marostegui@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 15:51 | <kamila@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1102 | [production] | 
            
  | 15:51 | <kamila@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 15:51 | <kamila@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1421 to wikikube-worker1102 - kamila@cumin1002" | [production] | 
            
  | 15:51 | <kamila@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw1421 to wikikube-worker1102 - kamila@cumin1002" | [production] | 
            
  | 15:50 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2192.codfw.wmnet with reason: host reimage | [production] | 
            
  | 15:48 | <root@cumin1002> | END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for dbprov1005.eqiad.wmnet: Renew puppet certificate - root@cumin1002 | [production] | 
            
  | 15:47 | <marostegui@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2130.codfw.wmnet | [production] | 
            
  | 15:46 | <kamila@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 15:46 | <root@cumin1002> | START - Cookbook sre.puppet.renew-cert for dbprov1005.eqiad.wmnet: Renew puppet certificate - root@cumin1002 | [production] | 
            
  | 15:46 | <kamila@cumin1002> | START - Cookbook sre.hosts.rename from mw1421 to wikikube-worker1102 | [production] | 
            
  | 15:46 | <root@cumin1002> | END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for dbprov1004.eqiad.wmnet: Renew puppet certificate - root@cumin1002 | [production] | 
            
  | 15:43 | <kamila@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw[1421-1425].eqiad.wmnet | [production] | 
            
  | 15:43 | <root@cumin1002> | START - Cookbook sre.puppet.renew-cert for dbprov1004.eqiad.wmnet: Renew puppet certificate - root@cumin1002 | [production] | 
            
  | 15:40 | <kamila@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host mw[1421-1425].eqiad.wmnet | [production] | 
            
  | 15:36 | <moritzm> | installing python-django security updates | [production] | 
            
  | 15:33 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] | 
            
  | 15:32 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] | 
            
  | 15:30 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2224-2227].codfw.wmnet | [production] | 
            
  | 15:30 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2224-2227].codfw.wmnet | [production] | 
            
  | 15:30 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2192 | [production] | 
            
  | 15:30 | <jelto@cumin1002> | START - Cookbook sre.hosts.move-vlan for host wikikube-worker2192 | [production] | 
            
  | 15:30 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker2192.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:28 | <volans> | uploaded spicerack_9.1.0 to apt.wikimedia.org bullseye-wikimedia | [production] | 
            
  | 15:26 | <jelto> | homer 'cr*codfw*' commit 'T377877' | [production] | 
            
  | 15:25 | <jelto> | homer 'lsw1-c6-codfw*' commit 'T377877' | [production] | 
            
  | 15:23 | <jelto> | homer 'lsw1-d3-codfw*' commit 'T377877' | [production] | 
            
  | 15:22 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2225.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:16 | <tgr|away> | UTC afternoon deploys done | [production] | 
            
  | 15:15 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2226.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:13 | <tgr@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] (duration: 27m 56s) | [production] | 
            
  | 15:13 | <jynus@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbprov1005.eqiad.wmnet with reason: os upgrade | [production] | 
            
  | 15:12 | <jynus@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on dbprov1005.eqiad.wmnet with reason: os upgrade | [production] | 
            
  | 15:12 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2224.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:09 | <tgr@deploy2002> | tgr: Continuing with sync | [production] | 
            
  | 15:02 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2225.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:55 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2226.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:52 | <tgr@deploy2002> | tgr: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 14:51 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2224.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2225.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2226.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2224.codfw.wmnet with reason: host reimage | [production] | 
            
  | 14:45 | <tgr@deploy2002> | Started scap sync-world: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] | [production] | 
            
  | 14:43 | <lucaswerkmeister-wmde@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1111343|Yet more authentication domain overrides (T383729 T373737)]], [[gerrit:1111598|Move Beta Cluster favicons to this repository]], [[gerrit:1075211|Replace favicon.php with static.php (T374997)]] (duration: 15m 52s) | [production] | 
            
  | 14:41 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2227.codfw.wmnet with OS bookworm | [production] | 
            
  | 14:40 | <aqu> | Deployed refinery using scap, then deployed onto hdfs | [production] | 
            
  | 14:38 | <lucaswerkmeister-wmde@deploy2002> | tgr, matmarex, lucaswerkmeister-wmde: Continuing with sync | [production] | 
            
  | 14:36 | <aqu@deploy2002> | Finished deploy [analytics/refinery@eee2443] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@eee24435] (duration: 00m 28s) | [production] |