| 2025-07-29
      
      ยง | 
    
  | 13:40 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.08 | [production] | 
            
  | 13:40 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.07 | [production] | 
            
  | 13:39 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.07 | [production] | 
            
  | 13:39 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.06 | [production] | 
            
  | 13:39 | <lucaswerkmeister-wmde@deploy1003> | lucaswerkmeister-wmde, bwang: Backport for [[gerrit:1172683|Enable new mobile search experience everywhere (not including empty search recommendations) (T380515)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 13:39 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.06 | [production] | 
            
  | 13:39 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.05 | [production] | 
            
  | 13:38 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.05 | [production] | 
            
  | 13:38 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.04 | [production] | 
            
  | 13:38 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.04 | [production] | 
            
  | 13:38 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.03 | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.03 | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.02 | [production] | 
            
  | 13:37 | <lucaswerkmeister-wmde@deploy1003> | Started scap sync-world: Backport for [[gerrit:1172683|Enable new mobile search experience everywhere (not including empty search recommendations) (T380515)]] | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.02 | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.01 | [production] | 
            
  | 13:37 | <Emperor> | check container dbs for all commons original containers T400700 | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.01 | [production] | 
            
  | 13:37 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.00 | [production] | 
            
  | 13:36 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.00 | [production] | 
            
  | 13:36 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P80257 and previous config saved to /var/cache/conftool/dbconfig/20250729-133623-fceratto.json | [production] | 
            
  | 13:31 | <Lucas_WMDE> | lucaswerkmeister-wmde@deploy1003 ~ $ mwscript-k8s --follow --comment=T400644 -- namespaceDupes mkwikibooks --fix --add-prefix=T400644/ | tee T40064-2 | [production] | 
            
  | 13:29 | <Lucas_WMDE> | lucaswerkmeister-wmde@deploy1003 ~ $ mwscript-k8s --follow --comment=T400644 -- namespaceDupes mkwikibooks --fix | tee T400644 | [production] | 
            
  | 13:26 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.04 | [production] | 
            
  | 13:26 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.04 | [production] | 
            
  | 13:26 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.03 | [production] | 
            
  | 13:25 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.03 | [production] | 
            
  | 13:25 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.02 | [production] | 
            
  | 13:25 | <lucaswerkmeister-wmde@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] (duration: 09m 14s) | [production] | 
            
  | 13:24 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.02 | [production] | 
            
  | 13:24 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.01 | [production] | 
            
  | 13:24 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.01 | [production] | 
            
  | 13:22 | <fceratto@deploy1003> | helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . | [production] | 
            
  | 13:21 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P80254 and previous config saved to /var/cache/conftool/dbconfig/20250729-132116-fceratto.json | [production] | 
            
  | 13:20 | <lucaswerkmeister-wmde@deploy1003> | lucaswerkmeister-wmde, aleksandar: Continuing with sync | [production] | 
            
  | 13:18 | <lucaswerkmeister-wmde@deploy1003> | lucaswerkmeister-wmde, aleksandar: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 13:18 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.00 | [production] | 
            
  | 13:17 | <mvernon@cumin2002> | START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.00 | [production] | 
            
  | 13:16 | <lucaswerkmeister-wmde@deploy1003> | Started scap sync-world: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] | [production] | 
            
  | 13:12 | <dani@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1173441|Undeploy Readers Use Cases Survey v2 (T399736)]] (duration: 09m 19s) | [production] | 
            
  | 13:09 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Depooling db2216 (T399249)', diff saved to https://phabricator.wikimedia.org/P80252 and previous config saved to /var/cache/conftool/dbconfig/20250729-130936-marostegui.json | [production] | 
            
  | 13:09 | <marostegui@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2216.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 13:08 | <mvernon@cumin2002> | END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.6b | [production] | 
            
  | 13:06 | <dani@deploy1003> | dani: Continuing with sync | [production] | 
            
  | 13:06 | <fceratto@deploy1003> | helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . | [production] | 
            
  | 13:06 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1254 (T399728)', diff saved to https://phabricator.wikimedia.org/P80251 and previous config saved to /var/cache/conftool/dbconfig/20250729-130608-fceratto.json | [production] | 
            
  | 13:05 | <dani@deploy1003> | dani: Backport for [[gerrit:1173441|Undeploy Readers Use Cases Survey v2 (T399736)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 13:03 | <fceratto@cumin1002> | dbctl commit (dc=all): 'Depooling db1254 (T399728)', diff saved to https://phabricator.wikimedia.org/P80250 and previous config saved to /var/cache/conftool/dbconfig/20250729-130316-fceratto.json | [production] | 
            
  | 13:03 | <fceratto@cumin1002> | DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1254.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 13:03 | <dani@deploy1003> | Started scap sync-world: Backport for [[gerrit:1173441|Undeploy Readers Use Cases Survey v2 (T399736)]] | [production] |