| 2024-12-16
      
      § | 
    
  | 23:29 | <tstarling@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] (duration: 12m 00s) | [production] | 
            
  | 23:24 | <tstarling@deploy2002> | tstarling: Continuing with sync | [production] | 
            
  | 23:23 | <tstarling@deploy2002> | tstarling: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 23:17 | <tstarling@deploy2002> | Started scap sync-world: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] | [production] | 
            
  | 22:22 | <ryankemper@cumin2002> | conftool action : set/pooled=yes:weight=10; selector: cluster=wdqs-internal-main,service=wdqs-main | [production] | 
            
  | 21:36 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudelastic1012.eqiad.wmnet with OS bullseye | [production] | 
            
  | 21:36 | <bking@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2002" | [production] | 
            
  | 21:33 | <bking@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2002" | [production] | 
            
  | 21:24 | <cjming> | end of UTC late backport window | [production] | 
            
  | 21:23 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] (duration: 11m 56s) | [production] | 
            
  | 21:19 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudelastic1012.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 21:17 | <cjming@deploy2002> | cjming, pppery: Continuing with sync | [production] | 
            
  | 21:16 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudelastic1012.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 21:15 | <cjming@deploy2002> | cjming, pppery: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:11 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] | [production] | 
            
  | 21:05 | <bking@cumin2002> | START - Cookbook sre.hosts.reimage for host cloudelastic1012.eqiad.wmnet with OS bullseye | [production] | 
            
  | 19:36 | <joal@deploy2002> | Finished deploy [airflow-dags/analytics@afda9d9]: Airflow analytics backfill deploy [airflow-dags/analytics@afda9d9a] (duration: 02m 58s) | [production] | 
            
  | 19:33 | <joal@deploy2002> | Started deploy [airflow-dags/analytics@afda9d9]: Airflow analytics backfill deploy [airflow-dags/analytics@afda9d9a] | [production] | 
            
  | 19:16 | <eevans@cumin1002> | END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching restbase1028.eqiad.wmnet: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002 | [production] | 
            
  | 19:07 | <eevans@cumin1002> | START - Cookbook sre.cassandra.roll-restart for nodes matching restbase1028.eqiad.wmnet: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002 | [production] | 
            
  | 19:05 | <swfrench@deploy2002> | Finished scap sync-world: T353817 - Additional deployment to clear remaining diffs (duration: 02m 51s) | [production] | 
            
  | 19:03 | <swfrench@deploy2002> | Started scap sync-world: T353817 - Additional deployment to clear remaining diffs | [production] | 
            
  | 18:37 | <otto@deploy2002> | otto: Continuing with sync | [production] | 
            
  | 18:35 | <otto@deploy2002> | otto: T353817 - Apache rewrite mediawiki.org/beacon/event to /beacon/event/index.php synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 18:31 | <otto@deploy2002> | Started scap sync-world: T353817 - Apache rewrite mediawiki.org/beacon/event to /beacon/event/index.php | [production] | 
            
  | 17:46 | <dancy@deploy2002> | Installation of scap version "4.133.0" completed for 1 hosts | [production] | 
            
  | 17:45 | <dancy@deploy2002> | Installing scap version "4.133.0" for 1 host(s) | [production] | 
            
  | 17:41 | <dancy@deploy2002> | Installing scap version "4.133.0" for 213 host(s) | [production] | 
            
  | 17:22 | <swfrench@deploy2002> | Finished scap sync-world: Deployment to pick up debug image changes - T381473 (duration: 06m 49s) | [production] | 
            
  | 17:21 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:21 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:15 | <swfrench@deploy2002> | Started scap sync-world: Deployment to pick up debug image changes - T381473 | [production] | 
            
  | 16:47 | <jdrewniak@deploy2002> | Synchronized portals: Wikimedia Portals Update: [[gerrit:1104683| Bumping portals to master (T128546)]] (duration: 02m 25s) | [production] | 
            
  | 16:44 | <jdrewniak@deploy2002> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:1104683| Bumping portals to master (T128546)]] (duration: 09m 25s) | [production] | 
            
  | 16:37 | <moritzm> | installing ipmitool bugfix updates from Bookworm point release | [production] | 
            
  | 16:05 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 16:05 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 16:04 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 16:04 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 16:03 | <hnowlan@deploy2002> | Finished scap sync-world: Rebuild and deploy to pick up new php8.1 base (duration: 23m 06s) | [production] | 
            
  | 16:00 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 16:00 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 15:54 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2095.codfw.wmnet | [production] |