2025-05-13
ยง
|
14:26 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P76056 and previous config saved to /var/cache/conftool/dbconfig/20250513-142608-root.json |
[production] |
14:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P76055 and previous config saved to /var/cache/conftool/dbconfig/20250513-142513-root.json |
[production] |
14:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 60%: Repooling', diff saved to https://phabricator.wikimedia.org/P76054 and previous config saved to /var/cache/conftool/dbconfig/20250513-142503-root.json |
[production] |
14:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 60%: Repooling', diff saved to https://phabricator.wikimedia.org/P76053 and previous config saved to /var/cache/conftool/dbconfig/20250513-142501-root.json |
[production] |
14:19 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host pc1018.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
14:18 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host pc1018.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host pc1018.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host db1258.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
14:15 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
14:15 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for pc1018 db1258 - jclark@cumin1002" |
[production] |
14:15 |
<jclark@cumin1002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for pc1018 db1258 - jclark@cumin1002" |
[production] |
14:14 |
<bking@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
14:11 |
<bking@cumin2002> |
START - Cookbook sre.hosts.rename from elastic1071 to cirrussearch1071 |
[production] |
14:11 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P76052 and previous config saved to /var/cache/conftool/dbconfig/20250513-141102-root.json |
[production] |
14:10 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 20%: Repooling', diff saved to https://phabricator.wikimedia.org/P76051 and previous config saved to /var/cache/conftool/dbconfig/20250513-141007-root.json |
[production] |
14:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P76050 and previous config saved to /var/cache/conftool/dbconfig/20250513-140958-root.json |
[production] |
14:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P76049 and previous config saved to /var/cache/conftool/dbconfig/20250513-140956-root.json |
[production] |
14:09 |
<jclark@cumin1002> |
START - Cookbook sre.dns.netbox |
[production] |
14:00 |
<hnowlan> |
finalising rollout of restbaseless enwiki PCS APIs routed via rest-gateway |
[production] |
13:59 |
<kamila@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply |
[production] |
13:58 |
<kamila@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-cron: apply |
[production] |
13:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P76048 and previous config saved to /var/cache/conftool/dbconfig/20250513-135557-root.json |
[production] |
13:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P76047 and previous config saved to /var/cache/conftool/dbconfig/20250513-135502-root.json |
[production] |
13:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P76046 and previous config saved to /var/cache/conftool/dbconfig/20250513-135452-root.json |
[production] |
13:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P76045 and previous config saved to /var/cache/conftool/dbconfig/20250513-135451-root.json |
[production] |
13:51 |
<Lucas_WMDE> |
UTC afternoon backport+config window done |
[production] |
13:50 |
<lucaswerkmeister-wmde@deploy1003> |
Sync cancelled. |
[production] |
13:47 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool site eqsin [reason: cr3-eqsin upgrade finished, T364092] |
[production] |
13:47 |
<ayounsi@cumin1002> |
START - Cookbook sre.dns.admin DNS admin: pool site eqsin [reason: cr3-eqsin upgrade finished, T364092] |
[production] |
13:46 |
<lucaswerkmeister-wmde@deploy1003> |
d3r1ck01, lucaswerkmeister-wmde: Backport for [[gerrit:1145096|SUL3: Fix account creation by username & email (with temp password) (T390751)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:40 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 20%: Repooling', diff saved to https://phabricator.wikimedia.org/P76044 and previous config saved to /var/cache/conftool/dbconfig/20250513-134051-root.json |
[production] |
13:39 |
<lucaswerkmeister-wmde@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1145096|SUL3: Fix account creation by username & email (with temp password) (T390751)]] |
[production] |
13:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P76043 and previous config saved to /var/cache/conftool/dbconfig/20250513-133956-root.json |
[production] |
13:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P76042 and previous config saved to /var/cache/conftool/dbconfig/20250513-133947-root.json |
[production] |
13:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P76041 and previous config saved to /var/cache/conftool/dbconfig/20250513-133946-root.json |
[production] |
13:37 |
<lucaswerkmeister-wmde@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1145096|SUL3: Fix account creation by username & email (with temp password) (T390751)]], [[gerrit:1145193|SUL3: Fix account creation by username & email (with temp password) (T390751)]] (duration: 14m 07s) |
[production] |
13:31 |
<lucaswerkmeister-wmde@deploy1003> |
lucaswerkmeister-wmde, matmarex, d3r1ck01: Continuing with sync |
[production] |
13:30 |
<lucaswerkmeister-wmde@deploy1003> |
lucaswerkmeister-wmde, matmarex, d3r1ck01: Backport for [[gerrit:1145096|SUL3: Fix account creation by username & email (with temp password) (T390751)]], [[gerrit:1145193|SUL3: Fix account creation by username & email (with temp password) (T390751)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P76039 and previous config saved to /var/cache/conftool/dbconfig/20250513-132545-root.json |
[production] |
13:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P76038 and previous config saved to /var/cache/conftool/dbconfig/20250513-132451-root.json |
[production] |
13:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P76037 and previous config saved to /var/cache/conftool/dbconfig/20250513-132442-root.json |
[production] |
13:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2242 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P76036 and previous config saved to /var/cache/conftool/dbconfig/20250513-132441-root.json |
[production] |
13:23 |
<lucaswerkmeister-wmde@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1145096|SUL3: Fix account creation by username & email (with temp password) (T390751)]], [[gerrit:1145193|SUL3: Fix account creation by username & email (with temp password) (T390751)]] |
[production] |
13:22 |
<lucaswerkmeister-wmde@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1144600|CirrusSearch: weighted tags mapping (during maintenance inflicted reindexing) (T389053)]] (duration: 15m 19s) |
[production] |
13:16 |
<lucaswerkmeister-wmde@deploy1003> |
lucaswerkmeister-wmde, pfischer: Continuing with sync |
[production] |
13:15 |
<XioNoX> |
cr3-eqsin> request vmhost reboot - T364092 |
[production] |
13:14 |
<lucaswerkmeister-wmde@deploy1003> |
lucaswerkmeister-wmde, pfischer: Backport for [[gerrit:1144600|CirrusSearch: weighted tags mapping (during maintenance inflicted reindexing) (T389053)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:10 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1255 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P76035 and previous config saved to /var/cache/conftool/dbconfig/20250513-131040-root.json |
[production] |
13:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1256 (re)pooling @ 3%: Repooling', diff saved to https://phabricator.wikimedia.org/P76034 and previous config saved to /var/cache/conftool/dbconfig/20250513-130945-root.json |
[production] |
13:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2241 (re)pooling @ 20%: Repooling', diff saved to https://phabricator.wikimedia.org/P76033 and previous config saved to /var/cache/conftool/dbconfig/20250513-130937-root.json |
[production] |