| 2025-10-23
      
      ยง | 
    
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] START helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply | [production] | 
            
  | 09:00 | <akosiaris@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply | [production] | 
            
  | 08:59 | <akosiaris@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 08:59 | <akosiaris@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 08:59 | <akosiaris@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 08:58 | <akosiaris@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 08:57 | <akosiaris@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 08:56 | <akosiaris@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 08:51 | <akosiaris@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 08:50 | <akosiaris@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 08:50 | <akosiaris@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply | [production] | 
            
  | 08:50 | <akosiaris@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-timeline: apply | [production] | 
            
  | 08:50 | <akosiaris@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 08:50 | <akosiaris@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply | [production] | 
            
  | 08:49 | <akosiaris@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 08:49 | <akosiaris@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-media: apply | [production] | 
            
  | 08:49 | <akosiaris@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 08:49 | <akosiaris@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-constraints: apply | [production] | 
            
  | 08:31 | <kharlan@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1198131|Instrument the Suggested investigations feature (T404177)]] (duration: 12m 35s) | [production] | 
            
  | 08:27 | <kharlan@deploy2002> | kharlan: Continuing with sync | [production] | 
            
  | 08:27 | <klausman@deploy2002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 08:26 | <klausman@deploy2002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 08:25 | <klausman@deploy2002> | helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 08:25 | <klausman@deploy2002> | helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 08:24 | <klausman@deploy2002> | helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 08:24 | <klausman@deploy2002> | helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 08:23 | <kharlan@deploy2002> | kharlan: Backport for [[gerrit:1198131|Instrument the Suggested investigations feature (T404177)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 08:19 | <kharlan@deploy2002> | Started scap sync-world: Backport for [[gerrit:1198131|Instrument the Suggested investigations feature (T404177)]] | [production] | 
            
  | 08:14 | <ryankemper> | [WDQS] `ryankemper@cumin2002:~$ sudo -E cumin 'wdqs1014*' 'systemctl restart wdqs-blazegraph'` (restart service to fix 12 hour deadlock) | [production] | 
            
  | 07:58 | <dcausse> | closing UTC morning backport window | [production] | 
            
  | 07:56 | <dcausse@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1198215|Revert "cirrus: enable completion search with defaultsort A/B test"]] (duration: 09m 38s) | [production] | 
            
  | 07:52 | <dcausse@deploy2002> | dcausse: Continuing with sync | [production] | 
            
  | 07:51 | <dcausse@deploy2002> | dcausse: Backport for [[gerrit:1198215|Revert "cirrus: enable completion search with defaultsort A/B test"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 07:47 | <dcausse@deploy2002> | Started scap sync-world: Backport for [[gerrit:1198215|Revert "cirrus: enable completion search with defaultsort A/B test"]] | [production] | 
            
  | 07:44 | <dcausse@deploy2002> | Sync cancelled. | [production] | 
            
  | 07:43 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T406920, sync categories journal) xfer categories from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 07:32 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T406920, sync categories journal) xfer categories from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 07:31 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T406920, sync categories journal) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 07:21 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T406920, sync categories journal) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 07:20 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T406920, sync categories journal) xfer categories from wdqs2008.codfw.wmnet -> wdqs2018.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 07:18 | <dcausse@deploy2002> | dcausse: Backport for [[gerrit:1197642|cirrus: enable completion search with defaultsort A/B test (T404858)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 07:13 | <dcausse@deploy2002> | Started scap sync-world: Backport for [[gerrit:1197642|cirrus: enable completion search with defaultsort A/B test (T404858)]] | [production] |