| 2023-08-25
      
      ยง | 
    
  | 11:09 | <cgoubert@deploy1002> | helmfile [codfw] [main] DONE helmfile.d/services/mw-jobrunner : sync | [production] | 
            
  | 11:09 | <cgoubert@deploy1002> | helmfile [codfw] [canary] START helmfile.d/services/mw-jobrunner : sync | [production] | 
            
  | 11:09 | <cgoubert@deploy1002> | helmfile [codfw] [main] START helmfile.d/services/mw-jobrunner : sync | [production] | 
            
  | 11:01 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 11:00 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 11:00 | <fabfur> | enabled puppet and pybal on lvs2011 (T344587) | [production] | 
            
  | 11:00 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 11:00 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 10:59 | <claime> | Deploying mediawiki: Add missing controls for php-fpm - T341320 | [production] | 
            
  | 10:59 | <fabfur@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs2011.codfw.wmnet | [production] | 
            
  | 10:56 | <fabfur@cumin1001> | START - Cookbook sre.hosts.reboot-single for host lvs2011.codfw.wmnet | [production] | 
            
  | 10:51 | <jayme@deploy1002> | helmfile [aux-k8s-eqiad] DONE helmfile.d/aus-k8s-eqiad-services/jaeger: apply | [production] | 
            
  | 10:48 | <jayme@deploy1002> | helmfile [aux-k8s-eqiad] START helmfile.d/aus-k8s-eqiad-services/jaeger: apply | [production] | 
            
  | 10:38 | <fabfur> | disabled puppet and pybal on lvs2011 for reboot (T344587) | [production] | 
            
  | 10:28 | <kartik@deploy1002> | Finished scap: Backport for [[gerrit:951487|ext.uls.interface.js: Inline isNamed() method (T344635)]] (duration: 14m 06s) | [production] | 
            
  | 10:22 | <kartik@deploy1002> | abi and kartik: Continuing with sync | [production] | 
            
  | 10:15 | <kartik@deploy1002> | abi and kartik: Backport for [[gerrit:951487|ext.uls.interface.js: Inline isNamed() method (T344635)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) | [production] | 
            
  | 10:14 | <kartik@deploy1002> | Started scap: Backport for [[gerrit:951487|ext.uls.interface.js: Inline isNamed() method (T344635)]] | [production] | 
            
  | 10:10 | <fabfur> | enabled puppet and pybal on lvs2012 (T344587) | [production] | 
            
  | 10:09 | <fabfur@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs2012.codfw.wmnet | [production] | 
            
  | 10:09 | <mvernon@cumin1001> | END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies (exit_code=0) rolling reboot on A:thanos-fe | [production] | 
            
  | 10:06 | <fabfur@cumin1001> | START - Cookbook sre.hosts.reboot-single for host lvs2012.codfw.wmnet | [production] | 
            
  | 10:06 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "new bastion - jmm@cumin2002" | [production] | 
            
  | 10:03 | <jmm@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "new bastion - jmm@cumin2002" | [production] | 
            
  | 09:57 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 09:57 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 09:57 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 09:56 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 09:56 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:55 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:55 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:54 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM bast6003.wikimedia.org | [production] | 
            
  | 09:54 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:52 | <jmm@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 09:51 | <jmm@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 09:50 | <jmm@cumin2002> | START - Cookbook sre.ganeti.reboot-vm for VM bast6003.wikimedia.org | [production] | 
            
  | 09:47 | <fabfur> | disabling puppet and pybal on lvs2012 for reboot (T344587) | [production] | 
            
  | 09:44 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:44 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:44 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 09:44 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:43 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:42 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:42 | <cgoubert@deploy1002> | helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:42 | <cgoubert@deploy1002> | helmfile [staging-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:41 | <cgoubert@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:41 | <cgoubert@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:34 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-codfw | [production] | 
            
  | 09:28 | <mvernon@cumin2002> | START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-codfw | [production] | 
            
  | 09:24 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] |