| 2025-09-24
      
      ยง | 
    
  | 20:36 | <cmooney@cumin1003> | START - Cookbook sre.hosts.reimage for host sretest2009.codfw.wmnet with OS bookworm | [production] | 
            
  | 20:31 | <mfossati@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1191144|Fix typo in ReaderExperiments' ImageBrowsing stream configuration (T403259)]] (duration: 12m 40s) | [production] | 
            
  | 20:26 | <mfossati@deploy1003> | mfossati: Continuing with sync | [production] | 
            
  | 20:25 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-14 | [tools] | 
            
  | 20:25 | <mfossati@deploy1003> | mfossati: Backport for [[gerrit:1191144|Fix typo in ReaderExperiments' ImageBrowsing stream configuration (T403259)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:19 | <andrew@cloudcumin1001> | START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-14 | [tools] | 
            
  | 20:18 | <mfossati@deploy1003> | Started scap sync-world: Backport for [[gerrit:1191144|Fix typo in ReaderExperiments' ImageBrowsing stream configuration (T403259)]] | [production] | 
            
  | 20:18 | <cmooney@cumin1003> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest2009.mgmt.codfw.wmnet on all recursors | [production] | 
            
  | 20:18 | <cmooney@cumin1003> | START - Cookbook sre.dns.wipe-cache sretest2009.mgmt.codfw.wmnet on all recursors | [production] | 
            
  | 20:17 | <cmooney@cumin1003> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:17 | <cmooney@cumin1003> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add back entry for sretest2009 - cmooney@cumin1003" | [production] | 
            
  | 20:17 | <cmooney@cumin1003> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add back entry for sretest2009 - cmooney@cumin1003" | [production] | 
            
  | 20:16 | <esanders@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1190994|DbFactory: Use primary DB when running maintenance scripts (T405080)]], [[gerrit:1190995|DbFactory: Use primary DB when running maintenance scripts (T405080)]] (duration: 11m 45s) | [production] | 
            
  | 20:12 | <cmooney@cumin1003> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:11 | <esanders@deploy1003> | esanders: Continuing with sync | [production] | 
            
  | 20:10 | <esanders@deploy1003> | esanders: Backport for [[gerrit:1190994|DbFactory: Use primary DB when running maintenance scripts (T405080)]], [[gerrit:1190995|DbFactory: Use primary DB when running maintenance scripts (T405080)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:07 | <denisse> | Remove kibana.discovery.wmnet from Puppet CA - T364622 | [production] | 
            
  | 20:04 | <esanders@deploy1003> | Started scap sync-world: Backport for [[gerrit:1190994|DbFactory: Use primary DB when running maintenance scripts (T405080)]], [[gerrit:1190995|DbFactory: Use primary DB when running maintenance scripts (T405080)]] | [production] | 
            
  | 19:33 | <ejegg> | fundraising civicrm upgraded from 0081bc3f to 5e5445a9 | [production] | 
            
  | 19:16 | <ladsgroup@dns1004> | END - running authdns-update | [production] | 
            
  | 19:15 | <ladsgroup@dns1004> | START - running authdns-update | [production] | 
            
  | 18:36 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17986145339 (https://github.com/cluebotng/component-configs/commits/820291b11edc6256cfa07e9a4a73677df86e52d8) | [tools.cluebotng-trainer] | 
            
  | 18:34 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17986015781 (https://github.com/cluebotng/component-configs/commits/b0f088ec49a2156a18ad7d78d18640f6e8fe943c) | [tools.cluebotng-trainer] | 
            
  | 18:31 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985989347 (https://github.com/cluebotng/component-configs/commits/38b2f2235d143f0522d560a93c04e50e8fa38c77) | [tools.cluebotng-trainer] | 
            
  | 18:20 | <brennen@deploy1003> | rebuilt and synchronized wikiversions files: group1 to 1.45.0-wmf.20  refs T396381 | [production] | 
            
  | 18:19 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985728221 (https://github.com/cluebotng/component-configs/commits/34320f16093c0d4160ce346108bc14bfb95245f8) | [tools.cluebotng-trainer] | 
            
  | 18:11 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985446508 (https://github.com/cluebotng/component-configs/commits/34320f16093c0d4160ce346108bc14bfb95245f8) | [tools.cluebotng-trainer] | 
            
  | 18:08 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985386789 (https://github.com/cluebotng/component-configs/commits/a1633fc7ecf1bd4a310fcb03d02d0da81212427a) | [tools.cluebotng-trainer] | 
            
  | 18:07 | <brennen> | 1.45.0-wmf.20 train status (T396381): logs ok, no current blockers. rolling to group1. | [production] | 
            
  | 18:05 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985333851 (https://github.com/cluebotng/component-configs/commits/24f56031bca40f808e05920eb128fd892a3d9b92) | [tools.cluebotng-editsets] | 
            
  | 18:05 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985333827 (https://github.com/cluebotng/component-configs/commits/24f56031bca40f808e05920eb128fd892a3d9b92) | [tools.cluebotng-trainer] | 
            
  | 17:59 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985198519 (https://github.com/cluebotng/component-configs/commits/cfa2541734b05a9da326bbeab2e82cc21d6e91e4) | [tools.cluebotng-staging] | 
            
  | 17:58 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985198575 (https://github.com/cluebotng/component-configs/commits/cfa2541734b05a9da326bbeab2e82cc21d6e91e4) | [tools.cluebotng-review] | 
            
  | 17:57 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985198509 (https://github.com/cluebotng/component-configs/commits/cfa2541734b05a9da326bbeab2e82cc21d6e91e4) | [tools.cluebotng-editsets] | 
            
  | 17:57 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985198515 (https://github.com/cluebotng/component-configs/commits/cfa2541734b05a9da326bbeab2e82cc21d6e91e4) | [tools.cluebotng-trainer] | 
            
  | 17:57 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985198507 (https://github.com/cluebotng/component-configs/commits/cfa2541734b05a9da326bbeab2e82cc21d6e91e4) | [tools.cluebotng-monitoring] | 
            
  | 17:52 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985077117 (https://github.com/cluebotng/component-configs/commits/955cd61533af834d56d36117a81643d8ab9ba81f) | [tools.cluebotng-trainer] | 
            
  | 17:52 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985077157 (https://github.com/cluebotng/component-configs/commits/955cd61533af834d56d36117a81643d8ab9ba81f) | [tools.cluebotng-editsets] | 
            
  | 17:48 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17985011099 (https://github.com/cluebotng/component-configs/commits/f38bf48e73ce94da03cee36fb6cccbe483786e19) | [tools.cluebotng-editsets] | 
            
  | 17:41 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli | [tools] | 
            
  | 17:40 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17984820840 (https://github.com/cluebotng/component-configs/commits/6f47ae931d95d85e2c3c1d6b42f1eabc6d3b1960) | [tools.cluebotng-monitoring] | 
            
  | 17:40 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17984820843 (https://github.com/cluebotng/component-configs/commits/6f47ae931d95d85e2c3c1d6b42f1eabc6d3b1960) | [tools.cluebotng-staging] | 
            
  | 17:40 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17984820837 (https://github.com/cluebotng/component-configs/commits/6f47ae931d95d85e2c3c1d6b42f1eabc6d3b1960) | [tools.cluebotng-review] | 
            
  | 17:40 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17984820847 (https://github.com/cluebotng/component-configs/commits/6f47ae931d95d85e2c3c1d6b42f1eabc6d3b1960) | [tools.cluebotng-editsets] | 
            
  | 17:40 | <wm-bot2> | Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17984820831 (https://github.com/cluebotng/component-configs/commits/6f47ae931d95d85e2c3c1d6b42f1eabc6d3b1960) | [tools.cluebotng-trainer] | 
            
  | 17:32 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli | [tools] | 
            
  | 17:32 | <dcaro@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-cli | [tools] | 
            
  | 17:30 | <wmbot~dcaro@acme> | END (PASS) - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers (exit_code=0) for tools-k8s-worker-nfs-43 | [tools] | 
            
  | 17:28 | <wmbot~dcaro@acme> | START - Cookbook wmcs.toolforge.k8s.reboot_stuck_workers for tools-k8s-worker-nfs-43 | [tools] | 
            
  | 17:23 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli | [tools] |