| 2024-05-06
      
      § | 
    
  | 06:35 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on db2165.codfw.wmnet with reason: host reimage | [production] | 
            
  | 06:30 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2102.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 06:30 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 4:00:00 on db2102.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 06:30 | <marostegui@cumin1002> | START - Cookbook sre.hosts.reimage for host db1193.eqiad.wmnet with OS bookworm | [production] | 
            
  | 06:28 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depool db1193', diff saved to https://phabricator.wikimedia.org/P61871 and previous config saved to /var/cache/conftool/dbconfig/20240506-062814-root.json | [production] | 
            
  | 06:17 | <sfaci@deploy1002> | helmfile [staging] DONE helmfile.d/services/editor-analytics: apply | [production] | 
            
  | 06:17 | <marostegui@cumin1002> | START - Cookbook sre.hosts.reimage for host db2165.codfw.wmnet with OS bookworm | [production] | 
            
  | 06:14 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depool db2165 T363977', diff saved to https://phabricator.wikimedia.org/P61870 and previous config saved to /var/cache/conftool/dbconfig/20240506-061416-root.json | [production] | 
            
  | 06:13 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Promote db2161 to s8 primary T363977', diff saved to https://phabricator.wikimedia.org/P61869 and previous config saved to /var/cache/conftool/dbconfig/20240506-061311-marostegui.json | [production] | 
            
  | 06:12 | <marostegui> | Starting s8 codfw failover from db2165 to db2161 - T363977 | [production] | 
            
  | 06:07 | <sfaci@deploy1002> | helmfile [staging] START helmfile.d/services/editor-analytics: apply | [production] | 
            
  | 05:50 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 33 hosts with reason: Primary switchover s8 T363977 | [production] | 
            
  | 05:50 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Set db2161 with weight 0 T363977', diff saved to https://phabricator.wikimedia.org/P61868 and previous config saved to /var/cache/conftool/dbconfig/20240506-055013-root.json | [production] | 
            
  | 05:50 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on 33 hosts with reason: Primary switchover s8 T363977 | [production] | 
            
  | 05:26 | <marostegui@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2165.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 05:26 | <marostegui@cumin1002> | START - Cookbook sre.hosts.downtime for 4:00:00 on db2165.codfw.wmnet with reason: Maintenance | [production] | 
            
  
    | 2024-05-05
      
      § | 
    
  | 11:47 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 400cc9cb84 (update Hebrew pa'al verbs) | [tools.lexeme-forms] | 
            
  | 11:40 | <James_F> | Zuul: Add Piracalamina to CI allowlist | [releng] | 
            
  | 11:09 | <brennen@deploy1002> | Finished deploy [phabricator/deployment@dd53761]: test deploy phab1004 for T364271 (duration: 00m 32s) | [production] | 
            
  | 11:08 | <brennen@deploy1002> | Started deploy [phabricator/deployment@dd53761]: test deploy phab1004 for T364271 | [production] | 
            
  | 11:08 | <brennen@deploy1002> | Finished deploy [phabricator/deployment@dd53761]: test deploy phab2002 for T364271 (duration: 00m 32s) | [production] | 
            
  | 11:07 | <brennen@deploy1002> | Started deploy [phabricator/deployment@dd53761]: test deploy phab2002 for T364271 | [production] | 
            
  | 11:04 | <taavi@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on phab.wmfusercontent.org with reason: brennen is deploying things | [production] | 
            
  | 11:03 | <taavi@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on phab.wmfusercontent.org with reason: brennen is deploying things | [production] | 
            
  | 11:03 | <taavi@cumin1002> | END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1:00:00 on phabricator.wikimedia.org with reason: brennen is deploying things | [production] | 
            
  | 11:03 | <taavi@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on phabricator.wikimedia.org with reason: brennen is deploying things | [production] | 
            
  | 11:03 | <taavi@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on phab1004.eqiad.wmnet with reason: brennen is deploying things | [production] | 
            
  | 11:03 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 19c8210d68 (Hebrew pa'al verbs) | [tools.lexeme-forms] | 
            
  | 11:03 | <taavi@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on phab1004.eqiad.wmnet with reason: brennen is deploying things | [production] | 
            
  | 10:47 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 6b0e493e20 (fix language setting, T363626) | [tools.wd-image-positions] | 
            
  | 10:42 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 73baa98186 (l10n updates: de, eu, fi, ko, mk, nb, nl; T363626) | [tools.wd-image-positions] | 
            
  | 10:12 | <wmbot~bd808@tools-bastion-12> | Built new image from git hash 4a80583b (T362500). | [tools.wikibugs] | 
            
  | 09:53 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed c6407a31ae (make “logged in as” translatable, T363626) | [tools.wd-image-positions] | 
            
  | 09:48 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 17817c0cad (GitHub actions fix, pulled without webservice restart, T363626) | [tools.wd-image-positions] | 
            
  | 09:41 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 279399cf63 (fix double “image scale” text from language fallback) | [tools.wd-image-positions] | 
            
  | 09:35 | <wmbot~lucaswerkmeister@tools-sgebastion-10> | deployed 4da2a2bc42 (settings page, T363626) | [tools.wd-image-positions] | 
            
  | 08:42 | <taavi> | taavi@gerrit1003 ~ $ sudo systemctl restart apache2 | [production] | 
            
  | 08:16 | <brennen> | Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1027516 | [releng] | 
            
  | 07:19 | <taavi> | reload zuul to add sam walton to allowlist | [releng] | 
            
  | 07:06 | <taavi@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component ingress-nginx | [tools] | 
            
  | 07:06 | <taavi@cloudcumin1001> | START - Cookbook wmcs.toolforge.k8s.component.deploy for component ingress-nginx | [tools] | 
            
  | 06:25 | <James_F> | Zuul: Add ConfirmEdit to phan dependencies for AbuseFilter, for T20110 | [releng] |