| 2025-10-01
      
      ยง | 
    
  | 11:03 | <cgoubert@deploy2002> | helmfile [codfw] START helmfile.d/services/zotero: apply | [production] | 
            
  | 11:03 | <cgoubert@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/zotero: apply | [production] | 
            
  | 11:03 | <cgoubert@deploy2002> | helmfile [staging] DONE helmfile.d/services/zotero: apply | [production] | 
            
  | 11:02 | <cgoubert@deploy2002> | helmfile [staging] START helmfile.d/services/zotero: apply | [production] | 
            
  | 11:02 | <cgoubert@deploy2002> | helmfile [eqiad] START helmfile.d/services/zotero: apply | [production] | 
            
  | 11:02 | <cgoubert@deploy2002> | helmfile [codfw] DONE helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:01 | <cgoubert@deploy2002> | helmfile [codfw] START helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:01 | <cgoubert@deploy2002> | helmfile [staging] DONE helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:01 | <cgoubert@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:01 | <cgoubert@deploy2002> | helmfile [staging] START helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:01 | <cgoubert@deploy2002> | helmfile [eqiad] START helmfile.d/services/ratelimit: apply | [production] | 
            
  | 11:00 | <cgoubert@deploy2002> | helmfile [codfw] DONE helmfile.d/services/mw-experimental: apply | [production] | 
            
  | 10:59 | <cgoubert@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply | [production] | 
            
  | 10:59 | <cgoubert@deploy2002> | helmfile [codfw] START helmfile.d/services/mw-experimental: apply | [production] | 
            
  | 10:59 | <cgoubert@deploy2002> | helmfile [eqiad] START helmfile.d/services/mw-experimental: apply | [production] | 
            
  | 10:59 | <cgoubert@deploy2002> | helmfile [codfw] DONE helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:58 | <cgoubert@deploy2002> | helmfile [codfw] START helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:58 | <cgoubert@deploy2002> | helmfile [staging] DONE helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:58 | <cgoubert@deploy2002> | helmfile [staging] START helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:57 | <cgoubert@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:57 | <cgoubert@deploy2002> | helmfile [eqiad] START helmfile.d/services/api-gateway: apply | [production] | 
            
  | 10:56 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1197 (T401906)', diff saved to https://phabricator.wikimedia.org/P83541 and previous config saved to /var/cache/conftool/dbconfig/20251001-105652-fceratto.json | [production] | 
            
  | 10:55 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db1197 (T401906)', diff saved to https://phabricator.wikimedia.org/P83540 and previous config saved to /var/cache/conftool/dbconfig/20251001-105538-fceratto.json | [production] | 
            
  | 10:55 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1197.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 10:55 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1188 (T401906)', diff saved to https://phabricator.wikimedia.org/P83539 and previous config saved to /var/cache/conftool/dbconfig/20251001-105514-fceratto.json | [production] | 
            
  | 10:55 | <claime> | Starting eqiad Wikikube kubernetes cluster upgrade to 1.31 - T405703 | [production] | 
            
  | 10:45 | <hashar@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1192860|Revert "Replace LoginNotify::getInstance with service injection" (T406094)]] (duration: 13m 47s) | [production] | 
            
  | 10:40 | <hashar@deploy2002> | hashar, dreamyjazz: Continuing with sync | [production] | 
            
  | 10:40 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P83538 and previous config saved to /var/cache/conftool/dbconfig/20251001-104006-fceratto.json | [production] | 
            
  | 10:36 | <hashar@deploy2002> | hashar, dreamyjazz: Backport for [[gerrit:1192860|Revert "Replace LoginNotify::getInstance with service injection" (T406094)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 10:31 | <hashar@deploy2002> | Started scap sync-world: Backport for [[gerrit:1192860|Revert "Replace LoginNotify::getInstance with service injection" (T406094)]] | [production] | 
            
  | 10:25 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P83537 and previous config saved to /var/cache/conftool/dbconfig/20251001-102458-fceratto.json | [production] | 
            
  | 10:16 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [tools] | 
            
  | 10:11 | <klausman@deploy2002> | helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 10:11 | <klausman@deploy2002> | helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 10:11 | <klausman@deploy2002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 10:10 | <klausman@deploy2002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 10:10 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [tools] | 
            
  | 10:09 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1188 (T401906)', diff saved to https://phabricator.wikimedia.org/P83536 and previous config saved to /var/cache/conftool/dbconfig/20251001-100951-fceratto.json | [production] | 
            
  | 10:09 | <klausman@deploy2002> | helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 10:08 | <klausman@deploy2002> | helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 10:08 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db1188 (T401906)', diff saved to https://phabricator.wikimedia.org/P83535 and previous config saved to /var/cache/conftool/dbconfig/20251001-100837-fceratto.json | [production] | 
            
  | 10:08 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1188.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 10:08 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1182 (T401906)', diff saved to https://phabricator.wikimedia.org/P83534 and previous config saved to /var/cache/conftool/dbconfig/20251001-100814-fceratto.json | [production] | 
            
  | 09:59 | <kharlan@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1192853|CreateAccount: Fix server side logging of CAPTCHA class (T405239)]], [[gerrit:1192852|CreateAccount: Fix server side logging of CAPTCHA class (T405239)]] (duration: 15m 47s) | [production] | 
            
  | 09:55 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [toolsbeta] | 
            
  | 09:54 | <kharlan@deploy2002> | kharlan: Continuing with sync | [production] | 
            
  | 09:53 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P83533 and previous config saved to /var/cache/conftool/dbconfig/20251001-095306-fceratto.json | [production] | 
            
  | 09:50 | <kharlan@deploy2002> | kharlan: Backport for [[gerrit:1192853|CreateAccount: Fix server side logging of CAPTCHA class (T405239)]], [[gerrit:1192852|CreateAccount: Fix server side logging of CAPTCHA class (T405239)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 09:49 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] |