| 2024-01-05
      
      § | 
    
  | 14:38 | <pfischer@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 14:37 | <pfischer@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 14:14 | <jelto@deploy2002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 14:14 | <jelto@deploy2002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 13:42 | <jelto@deploy2002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 13:41 | <jelto@deploy2002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 13:23 | <jelto@deploy2002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 13:23 | <jelto@deploy2002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 11:56 | <kamila@cumin1002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mw1379.eqiad.wmnet | [production] | 
            
  | 11:49 | <kamila@cumin1002> | START - Cookbook sre.hosts.reboot-single for host mw1379.eqiad.wmnet | [production] | 
            
  | 09:26 | <moritzm> | installing 5.10.205 kernels on Bullseye hosts | [production] | 
            
  | 09:15 | <_joe_> | upgrading conftool across the fleet | [production] | 
            
  | 08:01 | <moritzm> | installing 6.1.69 kernels on Bookworm hosts | [production] | 
            
  | 01:27 | <zabe> | zabe@mwmaint2002:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=arzwiki --logwiki=metawiki 'WanderingPlaywrite' 'WanderingPlaywright' # T354397 | [production] | 
            
  | 00:59 | <cwhite> | restarted prometheus@k8s on prometheus1006 and backed up the wal for OOM loop investigation | [production] | 
            
  | 00:52 | <cwhite> | restarted prometheus@k8s on prometheus1005 and backed up the wal for OOM loop investigation | [production] | 
            
  
    | 2024-01-04
      
      § | 
    
  | 23:10 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 23:10 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:34 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:33 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:33 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:33 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:31 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:31 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:29 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:29 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:29 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:29 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:25 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:25 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 22:24 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 22:24 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 22:22 | <dani@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:22 | <dani@deploy2002> | helmfile [eqiad] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:22 | <dani@deploy2002> | helmfile [codfw] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:21 | <dani@deploy2002> | helmfile [codfw] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:21 | <dani@deploy2002> | helmfile [staging] DONE helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:21 | <dani@deploy2002> | helmfile [staging] START helmfile.d/services/miscweb: apply | [production] | 
            
  | 22:00 | <rzl@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 22:00 | <rzl@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 21:38 | <ebernhardson@deploy2002> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 21:38 | <ebernhardson@deploy2002> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 21:27 | <brennen> | end of utc late backport window | [production] | 
            
  | 21:26 | <brennen@deploy2002> | Finished scap: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] (duration: 08m 01s) | [production] | 
            
  | 21:20 | <brennen@deploy2002> | brennen and dreamyjazz: Continuing with sync | [production] | 
            
  | 21:19 | <brennen@deploy2002> | brennen and dreamyjazz: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:18 | <brennen@deploy2002> | Started scap: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] | [production] | 
            
  | 21:17 | <brennen@deploy2002> | Finished scap: Backport for [[gerrit:987734|Check for invalid JSON on a good response from PhotoDNA (T354370)]] (duration: 07m 57s) | [production] | 
            
  | 21:11 | <brennen@deploy2002> | brennen and dreamyjazz: Continuing with sync | [production] | 
            
  | 21:10 | <brennen@deploy2002> | brennen and dreamyjazz: Backport for [[gerrit:987734|Check for invalid JSON on a good response from PhotoDNA (T354370)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] |