251-300 of 10000 results (95ms)
2025-10-15 §
07:33 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 30%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83906 and previous config saved to /var/cache/conftool/dbconfig/20251015-073309-root.json [production]
07:28 <fceratto@cumin1002> START - Cookbook sre.mysql.pool es2032 gradually with 4 steps - Pool es2032.codfw.wmnet in after cloning [production]
07:27 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1195409|hCaptcha: Enable on enwiki (T402366)]] (duration: 09m 02s) [production]
07:23 <kharlan@deploy2002> kharlan: Continuing with sync [production]
07:21 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1195409|hCaptcha: Enable on enwiki (T402366)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:20 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader2004.wikimedia.org [production]
07:18 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1195409|hCaptcha: Enable on enwiki (T402366)]] [production]
07:18 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 25%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83904 and previous config saved to /var/cache/conftool/dbconfig/20251015-071810-root.json [production]
07:18 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 25%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83903 and previous config saved to /var/cache/conftool/dbconfig/20251015-071803-root.json [production]
07:16 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host urldownloader2004.wikimedia.org [production]
07:03 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 20%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83901 and previous config saved to /var/cache/conftool/dbconfig/20251015-070304-root.json [production]
07:02 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 20%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83900 and previous config saved to /var/cache/conftool/dbconfig/20251015-070258-root.json [production]
06:47 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 10%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83899 and previous config saved to /var/cache/conftool/dbconfig/20251015-064758-root.json [production]
06:47 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 10%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83898 and previous config saved to /var/cache/conftool/dbconfig/20251015-064752-root.json [production]
06:46 <jmm@dns1004> END - running authdns-update [production]
06:45 <jmm@dns1004> START - running authdns-update [production]
06:32 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 7%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83897 and previous config saved to /var/cache/conftool/dbconfig/20251015-063252-root.json [production]
06:32 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 7%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83896 and previous config saved to /var/cache/conftool/dbconfig/20251015-063246-root.json [production]
06:17 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 5%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83895 and previous config saved to /var/cache/conftool/dbconfig/20251015-061746-root.json [production]
06:17 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 5%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83894 and previous config saved to /var/cache/conftool/dbconfig/20251015-061740-root.json [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone_es (exit_code=0) of es1032.eqiad.wmnet onto es1055.eqiad.wmnet [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1032 gradually with 4 steps - Pool es1032.eqiad.wmnet in after cloning [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone_es (exit_code=0) of es1031.eqiad.wmnet onto es1054.eqiad.wmnet [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1031 gradually with 4 steps - Pool es1031.eqiad.wmnet in after cloning [production]
06:02 <marostegui@cumin1003> dbctl commit (dc=all): 'es1057 (re)pooling @ 1%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83891 and previous config saved to /var/cache/conftool/dbconfig/20251015-060240-root.json [production]
06:02 <marostegui@cumin1003> dbctl commit (dc=all): 'es1052 (re)pooling @ 1%: Host provisioned T406488', diff saved to https://phabricator.wikimedia.org/P83890 and previous config saved to /var/cache/conftool/dbconfig/20251015-060234-root.json [production]
06:02 <marostegui@cumin1003> dbctl commit (dc=all): 'Add es1052 and es1057 to dbctl depooled T406488', diff saved to https://phabricator.wikimedia.org/P83889 and previous config saved to /var/cache/conftool/dbconfig/20251015-060210-marostegui.json [production]
05:55 <marostegui@cumin1003> START - Cookbook sre.mysql.clone of db1260.eqiad.wmnet onto db1261.eqiad.wmnet [production]
05:54 <marostegui@cumin1003> dbctl commit (dc=all): 'Add db1260 to dbctl depooled T406550', diff saved to https://phabricator.wikimedia.org/P83886 and previous config saved to /var/cache/conftool/dbconfig/20251015-055457-marostegui.json [production]
05:43 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2206 - Depool db2206.codfw.wmnet to then clone it to db2248.codfw.wmnet - marostegui@cumin1003 [production]
05:43 <marostegui@cumin1003> START - Cookbook sre.mysql.depool db2206 - Depool db2206.codfw.wmnet to then clone it to db2248.codfw.wmnet - marostegui@cumin1003 [production]
05:43 <marostegui@cumin1003> START - Cookbook sre.mysql.clone of db2206.codfw.wmnet onto db2248.codfw.wmnet [production]
05:27 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1032 gradually with 4 steps - Pool es1032.eqiad.wmnet in after cloning [production]
05:27 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1031 gradually with 4 steps - Pool es1031.eqiad.wmnet in after cloning [production]
04:56 <eileen> civicrm upgraded from 4d3107fc to 25df5996 [production]
01:40 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196198|Make tags be links to wish-index with filter applied (T406719)]] (duration: 07m 25s) [production]
01:36 <musikanimal@deploy2002> hmonroy, musikanimal: Continuing with sync [production]
01:35 <musikanimal@deploy2002> hmonroy, musikanimal: Backport for [[gerrit:1196198|Make tags be links to wish-index with filter applied (T406719)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:33 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1196198|Make tags be links to wish-index with filter applied (T406719)]] [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 06s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-14 §
23:39 <musikanimal@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196194|wish-index: pass in wishesData so that initial filters are set (T400945)]] (duration: 07m 08s) [production]
23:35 <musikanimal@deploy2002> musikanimal: Continuing with sync [production]
23:34 <musikanimal@deploy2002> musikanimal: Backport for [[gerrit:1196194|wish-index: pass in wishesData so that initial filters are set (T400945)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:32 <musikanimal@deploy2002> Started scap sync-world: Backport for [[gerrit:1196194|wish-index: pass in wishesData so that initial filters are set (T400945)]] [production]
21:55 <greg-g> (from eileen) civicrm upgraded from f68c287a to 4d3107fc [production]
21:43 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196166|Set reader experiment to true (T406916)]] (duration: 11m 26s) [production]
21:38 <ladsgroup@deploy2002> ksarabia, ladsgroup: Continuing with sync [production]
21:34 <ladsgroup@deploy2002> ksarabia, ladsgroup: Backport for [[gerrit:1196166|Set reader experiment to true (T406916)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:32 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1196166|Set reader experiment to true (T406916)]] [production]