| 2024-10-17
      
      ยง | 
    
  | 16:51 | <dcausse@deploy2002> | helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 16:50 | <swfrench@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 16:49 | <swfrench@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 16:49 | <mutante> | phab2002 T377396 - fix UIDs/GIDs for phab-related system users:  vcs: uid 496 -> 497 |  aphlict: uid 497 -> uid 496, gid 497 -> gid 496 | chown aphlict:aphlict /var/log/aphlict | chown aphlict:aphlict /run/aphlict | [production] | 
            
  | 16:48 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2219', diff saved to https://phabricator.wikimedia.org/P70283 and previous config saved to /var/cache/conftool/dbconfig/20241017-164830-ladsgroup.json | [production] | 
            
  | 16:42 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70282 and previous config saved to /var/cache/conftool/dbconfig/20241017-164256-arnaudb.json | [production] | 
            
  | 16:41 | <btullis@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | [production] | 
            
  | 16:40 | <btullis@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | [production] | 
            
  | 16:38 | <btullis@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | [production] | 
            
  | 16:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70281 and previous config saved to /var/cache/conftool/dbconfig/20241017-163324-ladsgroup.json | [production] | 
            
  | 16:28 | <btullis@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | [production] | 
            
  | 16:27 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70280 and previous config saved to /var/cache/conftool/dbconfig/20241017-162749-arnaudb.json | [production] | 
            
  | 16:12 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172 (T367781)', diff saved to https://phabricator.wikimedia.org/P70279 and previous config saved to /var/cache/conftool/dbconfig/20241017-161242-arnaudb.json | [production] | 
            
  | 16:02 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/page-analytics: apply | [production] | 
            
  | 16:01 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/page-analytics: apply | [production] | 
            
  | 16:00 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/media-analytics: apply | [production] | 
            
  | 16:00 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/media-analytics: apply | [production] | 
            
  | 15:59 | <dcausse@deploy2002> | helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:59 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/geo-analytics: apply | [production] | 
            
  | 15:59 | <dcausse@deploy2002> | helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:58 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/geo-analytics: apply | [production] | 
            
  | 15:58 | <dcausse@deploy2002> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:58 | <dcausse@deploy2002> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:57 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/editor-analytics: apply | [production] | 
            
  | 15:57 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/editor-analytics: apply | [production] | 
            
  | 15:56 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/edit-analytics: apply | [production] | 
            
  | 15:56 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/edit-analytics: apply | [production] | 
            
  | 15:52 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/device-analytics: apply | [production] | 
            
  | 15:51 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/device-analytics: apply | [production] | 
            
  | 15:51 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/edit-analytics: apply | [production] | 
            
  | 15:50 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/edit-analytics: apply | [production] | 
            
  | 15:48 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/device-analytics: apply | [production] | 
            
  | 15:48 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/device-analytics: apply | [production] | 
            
  | 15:47 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply | [production] | 
            
  | 15:47 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply | [production] | 
            
  | 15:45 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply | [production] | 
            
  | 15:45 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply | [production] | 
            
  | 15:44 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/changeprop: apply | [production] | 
            
  | 15:44 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/changeprop: apply | [production] | 
            
  | 15:41 | <hnowlan@deploy1003> | helmfile [staging] DONE helmfile.d/services/changeprop: apply | [production] | 
            
  | 15:40 | <hnowlan@deploy1003> | helmfile [staging] START helmfile.d/services/changeprop: apply | [production] | 
            
  | 15:39 | <jayme@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestagemaster2005.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:35 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P70278 and previous config saved to /var/cache/conftool/dbconfig/20241017-153546-ladsgroup.json | [production] | 
            
  | 15:34 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70277 and previous config saved to /var/cache/conftool/dbconfig/20241017-153257-ladsgroup.json | [production] | 
            
  | 15:33 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 15:33 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 15:32 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172 (T376905)', diff saved to https://phabricator.wikimedia.org/P70276 and previous config saved to /var/cache/conftool/dbconfig/20241017-153238-ladsgroup.json | [production] | 
            
  | 15:20 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P70275 and previous config saved to /var/cache/conftool/dbconfig/20241017-152040-ladsgroup.json | [production] | 
            
  | 15:17 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70274 and previous config saved to /var/cache/conftool/dbconfig/20241017-151731-ladsgroup.json | [production] | 
            
  | 15:14 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'Depooling db2172 (T367781)', diff saved to https://phabricator.wikimedia.org/P70273 and previous config saved to /var/cache/conftool/dbconfig/20241017-151216-arnaudb.json | [production] |