| 2024-06-27
      
      ยง | 
    
  | 12:38 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65527 and previous config saved to /var/cache/conftool/dbconfig/20240627-123805-marostegui.json | [production] | 
            
  | 12:22 | <jclark@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 12:19 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P65524 and previous config saved to /var/cache/conftool/dbconfig/20240627-121942-marostegui.json | [production] | 
            
  | 12:17 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 12:15 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 12:14 | <cmooney@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 12:12 | <cmooney@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 12:12 | <cmooney@cumin1002> | END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) | [production] | 
            
  | 12:12 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 12:12 | <cgoubert@deploy1002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 12:11 | <cmooney@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 12:10 | <cmooney@cumin1002> | END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) | [production] | 
            
  | 12:10 | <cmooney@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 12:10 | <cgoubert@deploy1002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P65523 and previous config saved to /var/cache/conftool/dbconfig/20240627-120751-marostegui.json | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [staging] DONE helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <cgoubert@deploy1002> | helmfile [staging] START helmfile.d/services/machinetranslation: apply | [production] | 
            
  | 12:07 | <wmbot~dcaro@urcuchillay> | START - Cookbook wmcs.ceph.osd.depool_and_destroy (T309789) | [admin] | 
            
  | 12:06 | <wmbot~dcaro@urcuchillay> | END (PASS) - Cookbook wmcs.ceph.unset_cluster_maintenance (exit_code=0) | [admin] | 
            
  | 12:05 | <wmbot~dcaro@urcuchillay> | START - Cookbook wmcs.ceph.unset_cluster_maintenance | [admin] | 
            
  | 12:05 | <wmbot~dcaro@urcuchillay> | END (PASS) - Cookbook wmcs.ceph.set_cluster_in_maintenance (exit_code=0) | [admin] | 
            
  | 12:04 | <wmbot~dcaro@urcuchillay> | START - Cookbook wmcs.ceph.set_cluster_in_maintenance | [admin] | 
            
  | 12:04 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2175 (T367856)', diff saved to https://phabricator.wikimedia.org/P65522 and previous config saved to /var/cache/conftool/dbconfig/20240627-120435-marostegui.json | [production] | 
            
  | 12:00 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/toolhub: apply | [production] | 
            
  | 12:00 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/toolhub: apply | [production] | 
            
  | 11:59 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/toolhub: apply | [production] | 
            
  | 11:59 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/toolhub: apply | [production] | 
            
  | 11:59 | <cgoubert@deploy1002> | helmfile [staging] DONE helmfile.d/services/toolhub: apply | [production] | 
            
  | 11:58 | <cgoubert@deploy1002> | helmfile [staging] START helmfile.d/services/toolhub: apply | [production] | 
            
  | 11:53 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:52 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65521 and previous config saved to /var/cache/conftool/dbconfig/20240627-115244-marostegui.json | [production] | 
            
  | 11:51 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:51 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:49 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:49 | <cgoubert@deploy1002> | helmfile [staging] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:48 | <cgoubert@deploy1002> | helmfile [staging] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 11:47 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:47 | <cgoubert@deploy1002> | helmfile [eqiad] START helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:46 | <cgoubert@deploy1002> | helmfile [codfw] DONE helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:46 | <cgoubert@deploy1002> | helmfile [codfw] START helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:46 | <cgoubert@deploy1002> | helmfile [staging] DONE helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:46 | <cgoubert@deploy1002> | helmfile [staging] START helmfile.d/services/developer-portal: apply | [production] | 
            
  | 11:42 | <jgiannelos@deploy1002> | helmfile [staging] DONE helmfile.d/services/mobileapps: apply | [production] | 
            
  | 11:42 | <jgiannelos@deploy1002> | helmfile [staging] START helmfile.d/services/mobileapps: apply | [production] | 
            
  | 11:41 | <jgiannelos@deploy1002> | helmfile [staging] DONE helmfile.d/services/mobileapps: apply | [production] | 
            
  | 11:41 | <cgoubert@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply | [production] |