| 
      
        2023-02-02
      
      ยง
     | 
  
    
  | 18:03 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1037.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 17:52 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2043.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 17:49 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on mc2043.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 17:47 | 
  <jiji@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1037.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 17:45 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on mc1037.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 17:33 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host mc2043.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 17:32 | 
  <jiji@cumin1001> | 
  START - Cookbook sre.hosts.reimage for host mc1037.eqiad.wmnet with OS bullseye | 
  [production] | 
            
  | 17:29 | 
  <aokoth@cumin1001> | 
  START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Production (gitlab1004) to 15.7.6-ce.0 | 
  [production] | 
            
  | 17:12 | 
  <elukey@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/changeprop: sync | 
  [production] | 
            
  | 17:12 | 
  <elukey@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/changeprop: sync | 
  [production] | 
            
  | 16:53 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:52 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:51 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:50 | 
  <dancy@deploy1002> | 
  Installation of scap version "4.34.0" completed for 561 hosts | 
  [production] | 
            
  | 16:50 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:50 | 
  <dancy@deploy1002> | 
  Installing scap version "4.34.0" for 561 hosts | 
  [production] | 
            
  | 16:50 | 
  <mvolz@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:49 | 
  <mvolz@deploy1002> | 
  helmfile [staging] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:48 | 
  <mvolz@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:48 | 
  <mvolz@deploy1002> | 
  helmfile [staging] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:47 | 
  <elukey@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/changeprop: sync | 
  [production] | 
            
  | 16:46 | 
  <elukey@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/changeprop: sync | 
  [production] | 
            
  | 16:25 | 
  <btullis@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host aqs2007.codfw.wmnet | 
  [production] | 
            
  | 16:18 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:17 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:17 | 
  <btullis@cumin1001> | 
  START - Cookbook sre.hosts.reboot-single for host aqs2007.codfw.wmnet | 
  [production] | 
            
  | 16:17 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:16 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:16 | 
  <mvolz@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:15 | 
  <mvolz@deploy1002> | 
  helmfile [staging] START helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 16:10 | 
  <volans> | 
  uploaded python3-wmflib_1.2.1 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia | 
  [production] | 
            
  | 16:10 | 
  <dzahn@cumin1001> | 
  END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab Replica gitlab2002 to 15.7.6-ce.0 | 
  [production] | 
            
  | 15:40 | 
  <jnuche@deploy1002> | 
  Finished deploy [releng/jenkins-deploy@e38efa6] (releasing): (no justification provided) (duration: 07m 01s) | 
  [production] | 
            
  | 15:38 | 
  <aokoth@cumin1001> | 
  END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) on GitLab host gitlab2002.wikimedia.org with reason: Security Release | 
  [production] | 
            
  | 15:37 | 
  <aokoth@cumin1001> | 
  START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Security Release | 
  [production] | 
            
  | 15:35 | 
  <aokoth@cumin1001> | 
  END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) on GitLab host gitlab2002.wikimedia.org with reason: Security Release | 
  [production] | 
            
  | 15:35 | 
  <aokoth@cumin1001> | 
  START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Security Release | 
  [production] | 
            
  | 15:34 | 
  <dzahn@cumin1001> | 
  START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab Replica gitlab2002 to 15.7.6-ce.0 | 
  [production] | 
            
  | 15:33 | 
  <jnuche@deploy1002> | 
  Started deploy [releng/jenkins-deploy@e38efa6] (releasing): (no justification provided) | 
  [production] | 
            
  | 15:24 | 
  <jmm@cumin2002> | 
  END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host ganeti3004 | 
  [production] | 
            
  | 15:17 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.network.configure-switch-interfaces for host ganeti3004 | 
  [production] | 
            
  | 15:06 | 
  <btullis@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host aqs2006.codfw.wmnet | 
  [production] | 
            
  | 15:03 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 15:03 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: bast3004 was renamed as ganeti4004 - jmm@cumin2002" | 
  [production] | 
            
  | 15:02 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: bast3004 was renamed as ganeti4004 - jmm@cumin2002" | 
  [production] | 
            
  | 15:00 | 
  <vgutierrez> | 
  rolling restart of varnish in cache::text - T315676 | 
  [production] | 
            
  | 14:59 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 14:59 | 
  <btullis@cumin1001> | 
  START - Cookbook sre.hosts.reboot-single for host aqs2006.codfw.wmnet | 
  [production] | 
            
  | 14:55 | 
  <cgoubert@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/zotero: apply | 
  [production] | 
            
  | 14:45 | 
  <cgoubert@deploy1002> | 
  helmfile [staging] START helmfile.d/services/zotero: apply | 
  [production] |