| 2022-06-15
      
      ยง | 
    
  | 14:01 | <jbond@cumin1001> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "sync data - jbond@cumin1001" | [production] | 
            
  | 13:58 | <awight> | EU afternoon backport window complete. | [production] | 
            
  | 13:57 | <awight@deploy1002> | Synchronized php-1.39.0-wmf.16/extensions/Translate/src/PageTranslation/DeleteTranslatableBundleSpecialPage.php: Backport: [[gerrit:805749|Fix deletion of translation pages outside of NS_MAIN namespace (T310440)]] (duration: 00m 32s) | [production] | 
            
  | 13:55 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1034 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29833 and previous config saved to /var/cache/conftool/dbconfig/20220615-135508-root.json | [production] | 
            
  | 13:55 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1033 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29832 and previous config saved to /var/cache/conftool/dbconfig/20220615-135502-root.json | [production] | 
            
  | 13:54 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1032 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29831 and previous config saved to /var/cache/conftool/dbconfig/20220615-135458-root.json | [production] | 
            
  | 13:54 | <ayounsi@cumin2002> | END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: deploy new homer wmf-netbox - ayounsi@cumin2002 | [production] | 
            
  | 13:53 | <ayounsi@cumin2002> | START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: deploy new homer wmf-netbox - ayounsi@cumin2002 | [production] | 
            
  | 13:51 | <ayounsi@cumin2002> | END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: deploy new homer wmf-netbox - ayounsi@cumin2002 | [production] | 
            
  | 13:49 | <ayounsi@cumin2002> | START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1001.eqiad.wmnet with reason: deploy new homer wmf-netbox - ayounsi@cumin2002 | [production] | 
            
  | 13:45 | <otto@deploy1002> | helmfile [staging] DONE helmfile.d/services/eventstreams: apply | [production] | 
            
  | 13:45 | <otto@deploy1002> | helmfile [staging] START helmfile.d/services/eventstreams: apply | [production] | 
            
  | 13:41 | <otto@deploy1002> | helmfile [staging] DONE helmfile.d/services/eventstreams: apply | [production] | 
            
  | 13:41 | <otto@deploy1002> | helmfile [staging] START helmfile.d/services/eventstreams: apply | [production] | 
            
  | 13:40 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1034 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29830 and previous config saved to /var/cache/conftool/dbconfig/20220615-134004-root.json | [production] | 
            
  | 13:39 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1033 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29829 and previous config saved to /var/cache/conftool/dbconfig/20220615-133958-root.json | [production] | 
            
  | 13:39 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1032 (re)pooling @ 75%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29828 and previous config saved to /var/cache/conftool/dbconfig/20220615-133954-root.json | [production] | 
            
  | 13:38 | <awight@deploy1002> | Synchronized php-1.39.0-wmf.16/extensions/VisualEditor/modules/ve-mw/ui/dialogs/ve.ui.MWTransclusionDialog.js: Backport: [[gerrit:805745|Restore internal mechanism to use either back or close button (T310602)]] (duration: 00m 37s) | [production] | 
            
  | 13:33 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depooling db1134 (T310011)', diff saved to https://phabricator.wikimedia.org/P29827 and previous config saved to /var/cache/conftool/dbconfig/20220615-133334-marostegui.json | [production] | 
            
  | 13:33 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1134.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 13:33 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime for 12:00:00 on db1134.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 13:33 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repooling after maintenance db1135 (T310011)', diff saved to https://phabricator.wikimedia.org/P29826 and previous config saved to /var/cache/conftool/dbconfig/20220615-133326-marostegui.json | [production] | 
            
  | 13:31 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v3.2 (duration: 01m 08s) | [production] | 
            
  | 13:30 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v3.2 | [production] | 
            
  | 13:29 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v3.2 (duration: 02m 06s) | [production] | 
            
  | 13:27 | <mwdebug-deploy@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 13:27 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v3.2 | [production] | 
            
  | 13:27 | <mwdebug-deploy@deploy1002> | helmfile [codfw] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 13:27 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply | [production] | 
            
  | 13:26 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] START helmfile.d/services/mwdebug: apply | [production] | 
            
  | 13:25 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1034 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29825 and previous config saved to /var/cache/conftool/dbconfig/20220615-132500-root.json | [production] | 
            
  | 13:24 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1033 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29824 and previous config saved to /var/cache/conftool/dbconfig/20220615-132454-root.json | [production] | 
            
  | 13:24 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1032 (re)pooling @ 50%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29823 and previous config saved to /var/cache/conftool/dbconfig/20220615-132450-root.json | [production] | 
            
  | 13:18 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29822 and previous config saved to /var/cache/conftool/dbconfig/20220615-131820-marostegui.json | [production] | 
            
  | 13:09 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1034 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29821 and previous config saved to /var/cache/conftool/dbconfig/20220615-130956-root.json | [production] | 
            
  | 13:09 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v3.1 (duration: 01m 03s) | [production] | 
            
  | 13:09 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1033 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29820 and previous config saved to /var/cache/conftool/dbconfig/20220615-130951-root.json | [production] | 
            
  | 13:09 | <marostegui@cumin1001> | dbctl commit (dc=all): 'es1032 (re)pooling @ 25%: After upgrade', diff saved to https://phabricator.wikimedia.org/P29819 and previous config saved to /var/cache/conftool/dbconfig/20220615-130946-root.json | [production] | 
            
  | 13:08 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v3.1 | [production] | 
            
  | 13:04 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v3.1 (duration: 01m 43s) | [production] | 
            
  | 13:03 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repooling after maintenance db1135', diff saved to https://phabricator.wikimedia.org/P29818 and previous config saved to /var/cache/conftool/dbconfig/20220615-130315-marostegui.json | [production] | 
            
  | 13:02 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v3.1 | [production] | 
            
  | 13:00 | <volans@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on netbox2002.codfw.wmnet with reason: Netbox upgrade to 3.2 | [production] | 
            
  | 13:00 | <volans@cumin1001> | START - Cookbook sre.hosts.downtime for 4:00:00 on netbox2002.codfw.wmnet with reason: Netbox upgrade to 3.2 | [production] | 
            
  | 13:00 | <volans@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on netbox1002.eqiad.wmnet with reason: Netbox upgrade to 3.2 | [production] | 
            
  | 13:00 | <volans@cumin1001> | START - Cookbook sre.hosts.downtime for 4:00:00 on netbox1002.eqiad.wmnet with reason: Netbox upgrade to 3.2 | [production] | 
            
  | 12:56 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v2.11.12 (duration: 00m 58s) | [production] | 
            
  | 12:55 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v2.11.12 | [production] | 
            
  | 12:55 | <ayounsi@deploy1002> | Finished deploy [netbox/deploy@7bbf659]: deploying v2.11.12 (duration: 00m 05s) | [production] | 
            
  | 12:55 | <ayounsi@deploy1002> | Started deploy [netbox/deploy@7bbf659]: deploying v2.11.12 | [production] |