| 2024-07-03
      
      ยง | 
    
  | 18:54 | <cmooney@cumin1002> | START - Cookbook sre.hosts.reimage for host sretest2002.codfw.wmnet with OS bookworm | [production] | 
            
  | 18:36 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 18:36 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 18:35 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 18:34 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 17:50 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 17:49 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 17:49 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 17:48 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 17:46 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 17:45 | <bking@cumin2002> | END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_eqiad | [production] | 
            
  | 17:45 | <bking@cumin2002> | START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_eqiad | [production] | 
            
  | 17:44 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 17:44 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 17:43 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 17:43 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 17:41 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 17:41 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 17:40 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-api-int: apply | [production] | 
            
  | 17:40 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 17:37 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 17:37 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 17:36 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 17:36 | <marostegui@cumin1002> | dbctl commit (dc=all): 'db2207 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P65758 and previous config saved to /var/cache/conftool/dbconfig/20240703-173601-root.json | [production] | 
            
  | 17:35 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-misc: apply | [production] | 
            
  | 17:35 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-misc: apply | [production] | 
            
  | 17:35 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-misc: apply | [production] | 
            
  | 17:35 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-misc: apply | [production] | 
            
  | 17:35 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply | [production] | 
            
  | 17:34 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply | [production] | 
            
  | 17:34 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply | [production] | 
            
  | 17:34 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply | [production] | 
            
  | 17:34 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 17:33 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 17:33 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 17:31 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 17:30 | <cdanis@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 17:29 | <cdanis@deploy1002> | helmfile [eqiad] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 17:28 | <cdanis@deploy1002> | helmfile [codfw] DONE helmfile.d/services/mw-debug: apply | [production] | 
            
  | 17:28 | <wmbot~dcaro@urcuchillay> | END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) (T309789) | [admin] | 
            
  | 17:28 | <cdanis@deploy1002> | helmfile [codfw] START helmfile.d/services/mw-debug: apply | [production] | 
            
  | 17:22 | <jforrester@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:20 | <marostegui@cumin1002> | dbctl commit (dc=all): 'db2207 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P65756 and previous config saved to /var/cache/conftool/dbconfig/20240703-172055-root.json | [production] | 
            
  | 17:19 | <jforrester@deploy1002> | helmfile [eqiad] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:19 | <jforrester@deploy1002> | helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:17 | <jforrester@deploy1002> | helmfile [codfw] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:17 | <jforrester@deploy1002> | helmfile [staging] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:15 | <jforrester@deploy1002> | helmfile [staging] START helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:11 | <jforrester@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply | [production] | 
            
  | 17:10 | <jforrester@deploy1002> | helmfile [eqiad] START helmfile.d/services/wikifunctions: apply | [production] |