| 
      
        2024-06-24
      
      ยง
     | 
  
    
  | 10:03 | 
  <cgoubert@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 10:02 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-redis-7 | 
  [tools] | 
            
  | 10:01 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-redis-6 | 
  [tools] | 
            
  | 09:59 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-redis-6 | 
  [tools] | 
            
  | 09:59 | 
  <cgoubert@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 09:58 | 
  <fnegri@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.k8s.worker.drain for node tools-k8s-worker-nfs-43 | 
  [tools] | 
            
  | 09:57 | 
  <jelto@cumin1002> | 
  START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab Replica to new version | 
  [production] | 
            
  | 09:56 | 
  <cgoubert@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on mw1407.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 09:56 | 
  <cgoubert@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on mw1420.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 09:53 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-cumin-1 | 
  [tools] | 
            
  | 09:52 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-cumin-1 | 
  [tools] | 
            
  | 09:51 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-k8s-haproxy-5 | 
  [tools] | 
            
  | 09:50 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-k8s-haproxy-5 | 
  [tools] | 
            
  | 09:49 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-harbor-1 | 
  [tools] | 
            
  | 09:47 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-harbor-1 | 
  [tools] | 
            
  | 09:46 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker role in the tools cluster | 
  [tools] | 
            
  | 09:46 | 
  <taavi@cloudcumin1001> | 
  Added a new k8s worker tools-k8s-worker-107.tools.eqiad1.wikimedia.cloud to the cluster | 
  [tools] | 
            
  | 09:46 | 
  <hnowlan@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/thumbor: apply | 
  [production] | 
            
  | 09:45 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] DONE helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:44 | 
  <mvolz@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:44 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:44 | 
  <mvolz@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:44 | 
  <mvolz@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:43 | 
  <mvolz@deploy1002> | 
  helmfile [staging] START helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:42 | 
  <cgoubert@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host mw1420.eqiad.wmnet with OS buster | 
  [production] | 
            
  | 09:42 | 
  <hnowlan@deploy1002> | 
  helmfile [codfw] START helmfile.d/services/thumbor: apply | 
  [production] | 
            
  | 09:42 | 
  <hnowlan@deploy1002> | 
  helmfile [eqiad] DONE helmfile.d/services/thumbor: apply | 
  [production] | 
            
  | 09:41 | 
  <cgoubert@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host mw1407.eqiad.wmnet with OS buster | 
  [production] | 
            
  | 09:40 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-prometheus-6 | 
  [tools] | 
            
  | 09:39 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-prometheus-6 | 
  [tools] | 
            
  | 09:39 | 
  <hnowlan@deploy1002> | 
  helmfile [eqiad] START helmfile.d/services/thumbor: apply | 
  [production] | 
            
  | 09:35 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the tools cluster | 
  [tools] | 
            
  | 09:35 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-puppetserver-01 | 
  [tools] | 
            
  | 09:34 | 
  <claime> | 
  Reimaging scap::proxies, mediawiki deployments may be unavailable - T368058 | 
  [production] | 
            
  | 09:34 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-puppetserver-01 | 
  [tools] | 
            
  | 09:33 | 
  <mvolz@deploy1002> | 
  helmfile [staging] DONE helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:33 | 
  <mvolz@deploy1002> | 
  helmfile [staging] START helmfile.d/services/citoid: apply | 
  [production] | 
            
  | 09:33 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-puppetdb-2 | 
  [tools] | 
            
  | 09:32 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-puppetdb-2 | 
  [tools] | 
            
  | 09:31 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-mail-4 | 
  [tools] | 
            
  | 09:30 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker role in the tools cluster | 
  [tools] | 
            
  | 09:30 | 
  <taavi@cloudcumin1001> | 
  Added a new k8s worker tools-k8s-worker-106.tools.eqiad1.wikimedia.cloud to the cluster | 
  [tools] | 
            
  | 09:30 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-mail-4 | 
  [tools] | 
            
  | 09:30 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-legacy-redirector-2 | 
  [tools] | 
            
  | 09:28 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-legacy-redirector-2 | 
  [tools] | 
            
  | 09:27 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-imagebuilder-2 | 
  [tools] | 
            
  | 09:26 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-imagebuilder-2 | 
  [tools] | 
            
  | 09:25 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-proxy-8 | 
  [tools] | 
            
  | 09:24 | 
  <taavi@cloudcumin1001> | 
  START - Cookbook wmcs.openstack.migrate_server_to_ovs for server tools-proxy-8 | 
  [tools] | 
            
  | 09:24 | 
  <taavi@cloudcumin1001> | 
  END (PASS) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=0) for server tools-services-05 | 
  [tools] |