|
2025-06-19
ยง
|
| 21:15 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P78486 and previous config saved to /var/cache/conftool/dbconfig/20250619-211502-marostegui.json |
[production] |
| 20:59 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1202 (T396130)', diff saved to https://phabricator.wikimedia.org/P78485 and previous config saved to /var/cache/conftool/dbconfig/20250619-205955-marostegui.json |
[production] |
| 20:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1202 (T396130)', diff saved to https://phabricator.wikimedia.org/P78484 and previous config saved to /var/cache/conftool/dbconfig/20250619-205505-marostegui.json |
[production] |
| 20:54 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1202.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1194 (T396130)', diff saved to https://phabricator.wikimedia.org/P78483 and previous config saved to /var/cache/conftool/dbconfig/20250619-205443-marostegui.json |
[production] |
| 20:40 |
<kostajh> |
UTC late deploys done |
[production] |
| 20:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P78482 and previous config saved to /var/cache/conftool/dbconfig/20250619-203935-marostegui.json |
[production] |
| 20:36 |
<kharlan@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1161588|PageChangeEmissionTest: order move events by kind. (T397087)]], [[gerrit:1161589|DomainEvents: Constant repeating notifications (T397103)]] (duration: 10m 08s) |
[production] |
| 20:29 |
<kharlan@deploy1003> |
kharlan, matmarex: Continuing with sync |
[production] |
| 20:28 |
<kharlan@deploy1003> |
kharlan, matmarex: Backport for [[gerrit:1161588|PageChangeEmissionTest: order move events by kind. (T397087)]], [[gerrit:1161589|DomainEvents: Constant repeating notifications (T397103)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:26 |
<kharlan@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1161588|PageChangeEmissionTest: order move events by kind. (T397087)]], [[gerrit:1161589|DomainEvents: Constant repeating notifications (T397103)]] |
[production] |
| 20:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P78481 and previous config saved to /var/cache/conftool/dbconfig/20250619-202428-marostegui.json |
[production] |
| 20:15 |
<kharlan@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1159626|Configure instrument for CheckUser - UserInfoCard (T386440)]], [[gerrit:1161581|Set category collation to `uca-pl-u-kn` for plwikiquote (T397466)]] (duration: 10m 30s) |
[production] |
| 20:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1194 (T396130)', diff saved to https://phabricator.wikimedia.org/P78480 and previous config saved to /var/cache/conftool/dbconfig/20250619-200921-marostegui.json |
[production] |
| 20:08 |
<kharlan@deploy1003> |
kharlan, msz2001, mimurawil: Continuing with sync |
[production] |
| 20:06 |
<kharlan@deploy1003> |
kharlan, msz2001, mimurawil: Backport for [[gerrit:1159626|Configure instrument for CheckUser - UserInfoCard (T386440)]], [[gerrit:1161581|Set category collation to `uca-pl-u-kn` for plwikiquote (T397466)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:04 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1194 (T396130)', diff saved to https://phabricator.wikimedia.org/P78479 and previous config saved to /var/cache/conftool/dbconfig/20250619-200432-marostegui.json |
[production] |
| 20:04 |
<kharlan@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1159626|Configure instrument for CheckUser - UserInfoCard (T386440)]], [[gerrit:1161581|Set category collation to `uca-pl-u-kn` for plwikiquote (T397466)]] |
[production] |
| 20:04 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1194.eqiad.wmnet with reason: Maintenance |
[production] |
| 20:04 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1191 (T396130)', diff saved to https://phabricator.wikimedia.org/P78478 and previous config saved to /var/cache/conftool/dbconfig/20250619-200409-marostegui.json |
[production] |
| 19:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P78477 and previous config saved to /var/cache/conftool/dbconfig/20250619-194902-marostegui.json |
[production] |
| 19:36 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply |
[production] |
| 19:36 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply |
[production] |
| 19:35 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply |
[production] |
| 19:35 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply |
[production] |
| 19:33 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P78476 and previous config saved to /var/cache/conftool/dbconfig/20250619-193355-marostegui.json |
[production] |
| 19:25 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 19:24 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 19:18 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1191 (T396130)', diff saved to https://phabricator.wikimedia.org/P78475 and previous config saved to /var/cache/conftool/dbconfig/20250619-191848-marostegui.json |
[production] |
| 19:14 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1191 (T396130)', diff saved to https://phabricator.wikimedia.org/P78474 and previous config saved to /var/cache/conftool/dbconfig/20250619-191401-marostegui.json |
[production] |
| 19:13 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1191.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:13 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1181 (T396130)', diff saved to https://phabricator.wikimedia.org/P78473 and previous config saved to /var/cache/conftool/dbconfig/20250619-191339-marostegui.json |
[production] |
| 18:58 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P78472 and previous config saved to /var/cache/conftool/dbconfig/20250619-185832-marostegui.json |
[production] |
| 18:46 |
<chuckonwumelu@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api |
[toolsbeta] |
| 18:43 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P78471 and previous config saved to /var/cache/conftool/dbconfig/20250619-184325-marostegui.json |
[production] |
| 18:43 |
<chuckonwumelu@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component components-api |
[toolsbeta] |
| 18:28 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1181 (T396130)', diff saved to https://phabricator.wikimedia.org/P78470 and previous config saved to /var/cache/conftool/dbconfig/20250619-182817-marostegui.json |
[production] |
| 18:23 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1181 (T396130)', diff saved to https://phabricator.wikimedia.org/P78469 and previous config saved to /var/cache/conftool/dbconfig/20250619-182320-marostegui.json |
[production] |
| 18:23 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance |
[production] |
| 18:22 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T396130)', diff saved to https://phabricator.wikimedia.org/P78468 and previous config saved to /var/cache/conftool/dbconfig/20250619-182258-marostegui.json |
[production] |
| 18:07 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P78467 and previous config saved to /var/cache/conftool/dbconfig/20250619-180751-marostegui.json |
[production] |
| 18:04 |
<taavi@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all NFS workers |
[tools] |
| 17:57 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[tools] |
| 17:52 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P78466 and previous config saved to /var/cache/conftool/dbconfig/20250619-175244-marostegui.json |
[production] |
| 17:49 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[tools] |
| 17:48 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[toolsbeta] |
| 17:41 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[toolsbeta] |
| 17:37 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T396130)', diff saved to https://phabricator.wikimedia.org/P78465 and previous config saved to /var/cache/conftool/dbconfig/20250619-173737-marostegui.json |
[production] |
| 17:32 |
<sukhe> |
forcing agent run on A:liberica-drmrs to merge CR 1161576 |
[production] |
| 17:31 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1174 (T396130)', diff saved to https://phabricator.wikimedia.org/P78464 and previous config saved to /var/cache/conftool/dbconfig/20250619-173142-marostegui.json |
[production] |