| 2024-09-17
      
      § | 
    
  | 08:40 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'T374848', diff saved to https://phabricator.wikimedia.org/P69203 and previous config saved to /var/cache/conftool/dbconfig/20240917-084036-arnaudb.json | [production] | 
            
  | 08:40 | <arnaudb@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2125.codfw.wmnet | [production] | 
            
  | 08:36 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2125 T374848', diff saved to https://phabricator.wikimedia.org/P69202 and previous config saved to /var/cache/conftool/dbconfig/20240917-083652-arnaudb.json | [production] | 
            
  | 08:31 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2124.codfw.wmnet | [production] | 
            
  | 08:31 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 08:31 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2124.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 08:31 | <arnaudb@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2124.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 08:26 | <arnaudb@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 08:18 | <arnaudb@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2124.codfw.wmnet | [production] | 
            
  | 08:16 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2124 T374847', diff saved to https://phabricator.wikimedia.org/P69201 and previous config saved to /var/cache/conftool/dbconfig/20240917-081642-arnaudb.json | [production] | 
            
  | 08:12 | <jnuche@deploy1003> | rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.23  refs T373642 | [production] | 
            
  | 08:04 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2121 T374846', diff saved to https://phabricator.wikimedia.org/P69200 and previous config saved to /var/cache/conftool/dbconfig/20240917-080453-arnaudb.json | [production] | 
            
  | 08:04 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2122.codfw.wmnet | [production] | 
            
  | 08:04 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 08:04 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2122.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 08:02 | <arnaudb@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2122.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 07:58 | <arnaudb@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 07:54 | <arnaudb@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2122.codfw.wmnet | [production] | 
            
  | 07:49 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2121 T374846', diff saved to https://phabricator.wikimedia.org/P69199 and previous config saved to /var/cache/conftool/dbconfig/20240917-074918-arnaudb.json | [production] | 
            
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2121.codfw.wmnet | [production] | 
            
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 07:38 | <arnaudb@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 07:35 | <hashar@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] (duration: 15m 36s) | [production] | 
            
  | 07:33 | <arnaudb@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 07:29 | <hashar@deploy1003> | hashar: Continuing with sync | [production] | 
            
  | 07:29 | <arnaudb@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2121.codfw.wmnet | [production] | 
            
  | 07:28 | <hashar@deploy1003> | hashar: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:26 | <vgutierrez> | testing purged 0.23 in cp4038 - T334078 | [production] | 
            
  | 07:20 | <hashar@deploy1003> | Started scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] | [production] | 
            
  | 07:11 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'depool db2121 T374845', diff saved to https://phabricator.wikimedia.org/P69198 and previous config saved to /var/cache/conftool/dbconfig/20240917-071120-arnaudb.json | [production] | 
            
  | 04:00 | <mwpresync@deploy1003> | Pruned MediaWiki: 1.43.0-wmf.20 (duration: 00m 58s) | [production] | 
            
  | 03:53 | <mwpresync@deploy1003> | Finished scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 (duration: 50m 47s) | [production] | 
            
  | 03:02 | <mwpresync@deploy1003> | Started scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 | [production] | 
            
  
    | 2024-09-16
      
      § | 
    
  | 22:49 | <Dreamy_Jazz> | Restarting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration | [production] | 
            
  | 20:53 | <jhathaway> | reloading puppetserver to enable strict mode | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:42 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:25 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:25 | <toyofuku@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] (duration: 08m 53s) | [production] | 
            
  | 20:24 | <pt1979@cumin2002> | END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | [production] | 
            
  | 20:21 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:20 | <toyofuku@deploy1003> | jdlrobson, toyofuku: Continuing with sync | [production] | 
            
  | 20:18 | <toyofuku@deploy1003> | jdlrobson, toyofuku: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:16 | <toyofuku@deploy1003> | Started scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] | [production] |