| 2024-08-15
      
      ยง | 
    
  | 20:39 | <ebernhardson@deploy1003> | ebernhardson: Backport for [[gerrit:1063026|cirrus: Stop general writes to private wikis (T341332)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:37 | <ebernhardson@deploy1003> | Started scap sync-world: Backport for [[gerrit:1063026|cirrus: Stop general writes to private wikis (T341332)]] | [production] | 
            
  | 20:30 | <ebernhardson@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1063041|Revert "CommentFormatter: Switch from deprecated addJsConfigVars to new setJsConfigVar" (T372499)]] (duration: 10m 06s) | [production] | 
            
  | 20:25 | <ebernhardson@deploy1003> | ebernhardson, matmarex: Continuing with sync | [production] | 
            
  | 20:23 | <ebernhardson@deploy1003> | ebernhardson, matmarex: Backport for [[gerrit:1063041|Revert "CommentFormatter: Switch from deprecated addJsConfigVars to new setJsConfigVar" (T372499)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:20 | <ebernhardson@deploy1003> | Started scap sync-world: Backport for [[gerrit:1063041|Revert "CommentFormatter: Switch from deprecated addJsConfigVars to new setJsConfigVar" (T372499)]] | [production] | 
            
  | 19:38 | <andrewbogott> | deleting VM wikipathways-dev after email from project admin Alex | [wikipathways] | 
            
  | 19:21 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:21 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:20 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:20 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:19 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:19 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:18 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:18 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:18 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:18 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:16 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:15 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:15 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 19:15 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 19:15 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 18:54 | <tgr|away> | running global rename cleanup script per T372006#10055573 | [production] | 
            
  | 18:15 | <jhuneidi@deploy1003> | rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.18  refs T366963 | [production] | 
            
  | 18:02 | <aokoth@cumin1002> | END (PASS) - Cookbook sre.vrts.upgrade (exit_code=0)  on VRTS host vrts1001.eqiad.wmnet | [production] | 
            
  | 18:00 | <aokoth@cumin1002> | START - Cookbook sre.vrts.upgrade  on VRTS host vrts1001.eqiad.wmnet | [production] | 
            
  | 17:45 | <dwisehaupt@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:44 | <dwisehaupt@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update mgmt dns for civi2002 frpig2002 - dwisehaupt@cumin1002" | [production] | 
            
  | 17:44 | <dwisehaupt@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update mgmt dns for civi2002 frpig2002 - dwisehaupt@cumin1002" | [production] | 
            
  | 17:41 | <dwisehaupt@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:22 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool site ulsfo [reason: testing done, T369366] | [production] | 
            
  | 17:22 | <sukhe@cumin1002> | START - Cookbook sre.dns.admin DNS admin: pool site ulsfo [reason: testing done, T369366] | [production] | 
            
  | 17:13 | <jayme@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main2008.codfw.wmnet with OS bullseye | [production] | 
            
  | 17:07 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site ulsfo [reason: testing live change, T369366] | [production] | 
            
  | 17:07 | <sukhe@cumin1002> | START - Cookbook sre.dns.admin DNS admin: depool site ulsfo [reason: testing live change, T369366] | [production] | 
            
  | 17:01 | <JJMC89> | copypatrol-backend-prod-01 deploy ed212c4..81ec727 | [copypatrol] | 
            
  | 16:54 | <jayme@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main2008.codfw.wmnet with reason: host reimage | [production] | 
            
  | 16:53 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 16:52 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 16:52 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 16:51 | <jayme@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main2008.codfw.wmnet with reason: host reimage | [production] | 
            
  | 16:51 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 16:39 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] | 
            
  | 16:39 | <andrew@cloudcumin1001> | START - Cookbook wmcs.ceph.osd.undrain_node | [admin] | 
            
  | 16:39 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) | [admin] |