| 2024-07-25
      
      ยง | 
    
  | 10:49 | <aborrero@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 | [admin] | 
            
  | 10:48 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 | [admin] | 
            
  | 10:48 | <aborrero@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 | [admin] | 
            
  | 10:47 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/26 | [admin] | 
            
  | 10:42 | <elukey> | upload docker-report 0.0.15 to bullseye-wimedia and upgrade build2001 | [production] | 
            
  | 10:00 | <cgoubert@cumin1002> | conftool action : set/pooled=yes; selector: name=kubernetes1051.eqiad.wmnet,cluster=kubernetes,service=kubesvc [reason: Uncordoning kubernetes1051 - T369011] | [production] | 
            
  | 09:57 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 09:54 | <cgoubert@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 09:35 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 09:32 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 09:27 | <brouberol@deploy1002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply | [production] | 
            
  | 09:26 | <brouberol@deploy1002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply | [production] | 
            
  | 09:19 | <elukey> | move dump_cloud_ip_ranges from puppetmaster1001 to puppetserver1001 - T368023 | [production] | 
            
  | 08:57 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 08:57 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 08:52 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 08:52 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 08:42 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 08:42 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 08:37 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component wmcs-k8s-metrics | [tools] | 
            
  | 08:37 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.k8s.component.deploy for component wmcs-k8s-metrics | [tools] | 
            
  | 08:29 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:28 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:27 | <aborrero@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:27 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:25 | <aborrero@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:25 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/25 | [admin] | 
            
  | 08:05 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component wmcs-k8s-metrics | [toolsbeta] | 
            
  | 08:04 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.k8s.component.deploy for component wmcs-k8s-metrics | [toolsbeta] | 
            
  | 08:01 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 08:01 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 07:58 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 07:58 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/23 | [admin] | 
            
  | 07:38 | <kart_> | Updated cxserver to 2024-07-22-050142-production (T363968) | [production] | 
            
  | 07:37 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db2176 (T367856)', diff saved to https://phabricator.wikimedia.org/P66924 and previous config saved to /var/cache/conftool/dbconfig/20240725-073742-marostegui.json | [production] | 
            
  | 07:37 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 6:00:00 on db2176.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 07:37 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 6:00:00 on db2176.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 07:37 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174 (T367856)', diff saved to https://phabricator.wikimedia.org/P66923 and previous config saved to /var/cache/conftool/dbconfig/20240725-073720-marostegui.json | [production] | 
            
  | 07:37 | <kartik@deploy1002> | helmfile [eqiad] DONE helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:36 | <brouberol@deploy1002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply | [production] | 
            
  | 07:36 | <kartik@deploy1002> | helmfile [eqiad] START helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:35 | <brouberol@deploy1002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply | [production] | 
            
  | 07:35 | <kartik@deploy1002> | helmfile [codfw] DONE helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:35 | <kartik@deploy1002> | helmfile [codfw] START helmfile.d/services/cxserver: apply | [production] | 
            
  | 07:22 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P66922 and previous config saved to /var/cache/conftool/dbconfig/20240725-072213-marostegui.json | [production] | 
            
  | 07:14 | <XioNoX> | add transit BGP session to KPN in esams | [production] | 
            
  | 07:07 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P66921 and previous config saved to /var/cache/conftool/dbconfig/20240725-070706-marostegui.json | [production] | 
            
  | 06:51 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174 (T367856)', diff saved to https://phabricator.wikimedia.org/P66920 and previous config saved to /var/cache/conftool/dbconfig/20240725-065159-marostegui.json | [production] | 
            
  | 00:43 | <zabe@deploy1002> | Finished scap: Backport for [[gerrit:1056632|Further configs for cswikivoyage (T370913)]] (duration: 08m 22s) | [production] | 
            
  | 00:39 | <zabe@deploy1002> | zabe: Continuing with sync | [production] |