| 
      
        2024-09-17
      
      §
     | 
  
    
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2121.codfw.wmnet | 
  [production] | 
            
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 07:38 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 07:35 | 
  <hashar@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] (duration: 15m 36s) | 
  [production] | 
            
  | 07:33 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 07:29 | 
  <hashar@deploy1003> | 
  hashar: Continuing with sync | 
  [production] | 
            
  | 07:29 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.decommission for hosts db2121.codfw.wmnet | 
  [production] | 
            
  | 07:28 | 
  <hashar@deploy1003> | 
  hashar: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 07:26 | 
  <vgutierrez> | 
  testing purged 0.23 in cp4038 - T334078 | 
  [production] | 
            
  | 07:20 | 
  <hashar@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] | 
  [production] | 
            
  | 07:11 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'depool db2121 T374845', diff saved to https://phabricator.wikimedia.org/P69198 and previous config saved to /var/cache/conftool/dbconfig/20240917-071120-arnaudb.json | 
  [production] | 
            
  | 04:00 | 
  <mwpresync@deploy1003> | 
  Pruned MediaWiki: 1.43.0-wmf.20 (duration: 00m 58s) | 
  [production] | 
            
  | 03:53 | 
  <mwpresync@deploy1003> | 
  Finished scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 (duration: 50m 47s) | 
  [production] | 
            
  | 03:02 | 
  <mwpresync@deploy1003> | 
  Started scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 | 
  [production] | 
            
  
    | 
      
        2024-09-16
      
      §
     | 
  
    
  | 22:49 | 
  <Dreamy_Jazz> | 
  Restarting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration | 
  [production] | 
            
  | 20:53 | 
  <jhathaway> | 
  reloading puppetserver to enable strict mode | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:42 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:25 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:25 | 
  <toyofuku@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] (duration: 08m 53s) | 
  [production] | 
            
  | 20:24 | 
  <pt1979@cumin2002> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 20:21 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:20 | 
  <toyofuku@deploy1003> | 
  jdlrobson, toyofuku: Continuing with sync | 
  [production] | 
            
  | 20:18 | 
  <toyofuku@deploy1003> | 
  jdlrobson, toyofuku: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 20:16 | 
  <toyofuku@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] | 
  [production] | 
            
  | 18:27 | 
  <dancy@deploy1003> | 
  Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 06s) | 
  [production] | 
            
  | 18:27 | 
  <dancy@deploy1003> | 
  Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | 
  [production] | 
            
  | 18:27 | 
  <dancy@deploy1003> | 
  Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 04s) | 
  [production] | 
            
  | 18:27 | 
  <dancy@deploy1003> | 
  Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | 
  [production] | 
            
  | 18:24 | 
  <rzl> | 
  rzl@cumin1002:~$ sudo cumin O:logging::opensearch::collector 'chown -R opensearch-dashboards: /usr/share/opensearch-dashboards/plugins/phatality' | 
  [production] | 
            
  | 18:07 | 
  <dancy@deploy1003> | 
  Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 04s) | 
  [production] | 
            
  | 18:06 | 
  <dancy@deploy1003> | 
  Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | 
  [production] | 
            
  | 18:06 | 
  <dancy@deploy1003> | 
  Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 46s) | 
  [production] | 
            
  | 18:05 | 
  <dancy@deploy1003> | 
  Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | 
  [production] | 
            
  | 17:27 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2238 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69196 and previous config saved to /var/cache/conftool/dbconfig/20240916-172712-arnaudb.json | 
  [production] | 
            
  | 17:27 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2237 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69195 and previous config saved to /var/cache/conftool/dbconfig/20240916-172706-arnaudb.json | 
  [production] | 
            
  | 17:27 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2227 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69194 and previous config saved to /var/cache/conftool/dbconfig/20240916-172701-arnaudb.json | 
  [production] | 
            
  | 17:26 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2225 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69193 and previous config saved to /var/cache/conftool/dbconfig/20240916-172656-arnaudb.json | 
  [production] | 
            
  | 17:26 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2224 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69192 and previous config saved to /var/cache/conftool/dbconfig/20240916-172651-arnaudb.json | 
  [production] | 
            
  | 17:26 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2222 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69191 and previous config saved to /var/cache/conftool/dbconfig/20240916-172646-arnaudb.json | 
  [production] | 
            
  | 17:26 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2221 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69190 and previous config saved to /var/cache/conftool/dbconfig/20240916-172641-arnaudb.json | 
  [production] | 
            
  | 17:22 | 
  <mfossati@deploy1003> | 
  Finished deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) (duration: 00m 44s) | 
  [production] | 
            
  | 17:21 | 
  <mfossati@deploy1003> | 
  Started deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) | 
  [production] | 
            
  | 17:16 | 
  <dancy@deploy1003> | 
  Finished deploy [releng/phatality@b1a2a70]: testing (duration: 00m 05s) | 
  [production] |