651-700 of 10000 results (20ms)
2025-07-29 ยง
13:39 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.06 [production]
13:39 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.05 [production]
13:38 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.05 [production]
13:38 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.04 [production]
13:38 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.04 [production]
13:38 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.03 [production]
13:37 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.03 [production]
13:37 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.02 [production]
13:37 <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1172683|Enable new mobile search experience everywhere (not including empty search recommendations) (T380515)]] [production]
13:37 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.02 [production]
13:37 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.01 [production]
13:37 <Emperor> check container dbs for all commons original containers T400700 [production]
13:37 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.01 [production]
13:37 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.00 [production]
13:36 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.00 [production]
13:36 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P80257 and previous config saved to /var/cache/conftool/dbconfig/20250729-133623-fceratto.json [production]
13:31 <Lucas_WMDE> lucaswerkmeister-wmde@deploy1003 ~ $ mwscript-k8s --follow --comment=T400644 -- namespaceDupes mkwikibooks --fix --add-prefix=T400644/ | tee T40064-2 [production]
13:29 <Lucas_WMDE> lucaswerkmeister-wmde@deploy1003 ~ $ mwscript-k8s --follow --comment=T400644 -- namespaceDupes mkwikibooks --fix | tee T400644 [production]
13:26 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.04 [production]
13:26 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.04 [production]
13:26 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.03 [production]
13:25 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.03 [production]
13:25 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.02 [production]
13:25 <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] (duration: 09m 14s) [production]
13:24 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.02 [production]
13:24 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.01 [production]
13:24 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.01 [production]
13:22 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
13:21 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1254', diff saved to https://phabricator.wikimedia.org/P80254 and previous config saved to /var/cache/conftool/dbconfig/20250729-132116-fceratto.json [production]
13:20 <lucaswerkmeister-wmde@deploy1003> lucaswerkmeister-wmde, aleksandar: Continuing with sync [production]
13:18 <lucaswerkmeister-wmde@deploy1003> lucaswerkmeister-wmde, aleksandar: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:18 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.00 [production]
13:17 <mvernon@cumin2002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.00 [production]
13:16 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
13:16 <wmbot~dcaro@acme> Added a new k8s worker-nfs tools-k8s-worker-nfs-82.tools.eqiad1.wikimedia.cloud to the cluster [tools]
13:16 <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1173456|Localize mk.wikibooks sitename and metanamespace (T400644)]] [production]
13:12 <dani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1173441|Undeploy Readers Use Cases Survey v2 (T399736)]] (duration: 09m 19s) [production]
13:09 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2216 (T399249)', diff saved to https://phabricator.wikimedia.org/P80252 and previous config saved to /var/cache/conftool/dbconfig/20250729-130936-marostegui.json [production]
13:09 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2216.codfw.wmnet with reason: Maintenance [production]
13:08 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.6b [production]
13:06 <dani@deploy1003> dani: Continuing with sync [production]
13:06 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster [tools]
13:06 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
13:06 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker-nfs role in the tools cluster [tools]
13:06 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1254 (T399728)', diff saved to https://phabricator.wikimedia.org/P80251 and previous config saved to /var/cache/conftool/dbconfig/20250729-130608-fceratto.json [production]
13:06 <wmbot~dcaro@acme> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the tools cluster [tools]
13:05 <dani@deploy1003> dani: Backport for [[gerrit:1173441|Undeploy Readers Use Cases Survey v2 (T399736)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:05 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=0) for a worker-nfs role in the tools cluster [tools]
13:05 <wmbot~dcaro@acme> Added a new k8s worker-nfs tools-k8s-worker-nfs-81.tools.eqiad1.wikimedia.cloud to the cluster [tools]
13:03 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1254 (T399728)', diff saved to https://phabricator.wikimedia.org/P80250 and previous config saved to /var/cache/conftool/dbconfig/20250729-130316-fceratto.json [production]