|
2025-07-28
§
|
| 20:55 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2153.codfw.wmnet with reason: Maintenance |
[production] |
| 20:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T399249)', diff saved to https://phabricator.wikimedia.org/P80146 and previous config saved to /var/cache/conftool/dbconfig/20250728-205536-marostegui.json |
[production] |
| 20:53 |
<cjming@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1173397|aswikisource: add publisher (প্ৰকাশক) namespace (T399269)]] (duration: 08m 56s) |
[production] |
| 20:50 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P80145 and previous config saved to /var/cache/conftool/dbconfig/20250728-205005-fceratto.json |
[production] |
| 20:47 |
<cjming@deploy1003> |
cjming, anzx: Continuing with sync |
[production] |
| 20:46 |
<cjming@deploy1003> |
cjming, anzx: Backport for [[gerrit:1173397|aswikisource: add publisher (প্ৰকাশক) namespace (T399269)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:44 |
<cjming@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1173397|aswikisource: add publisher (প্ৰকাশক) namespace (T399269)]] |
[production] |
| 20:40 |
<cjming@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] (duration: 09m 08s) |
[production] |
| 20:40 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P80144 and previous config saved to /var/cache/conftool/dbconfig/20250728-204028-marostegui.json |
[production] |
| 20:35 |
<cjming@deploy1003> |
cjming, anzx: Continuing with sync |
[production] |
| 20:34 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P80143 and previous config saved to /var/cache/conftool/dbconfig/20250728-203458-fceratto.json |
[production] |
| 20:33 |
<cjming@deploy1003> |
cjming, anzx: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:31 |
<cjming@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1172862|mnwwiktionary: update reconstruction namespace (T400441)]] |
[production] |
| 20:27 |
<cjming@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] (duration: 08m 39s) |
[production] |
| 20:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146', diff saved to https://phabricator.wikimedia.org/P80142 and previous config saved to /var/cache/conftool/dbconfig/20250728-202521-marostegui.json |
[production] |
| 20:21 |
<cjming@deploy1003> |
cjming, anzx: Continuing with sync |
[production] |
| 20:20 |
<cjming@deploy1003> |
cjming, anzx: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:19 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2182 (T399728)', diff saved to https://phabricator.wikimedia.org/P80141 and previous config saved to /var/cache/conftool/dbconfig/20250728-201950-fceratto.json |
[production] |
| 20:18 |
<cjming@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1172659|throttle: add rules for Wikimania 2025 (T400276)]] |
[production] |
| 20:16 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db2182 (T399728)', diff saved to https://phabricator.wikimedia.org/P80140 and previous config saved to /var/cache/conftool/dbconfig/20250728-201655-fceratto.json |
[production] |
| 20:16 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 20:16 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80139 and previous config saved to /var/cache/conftool/dbconfig/20250728-201633-fceratto.json |
[production] |
| 20:10 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2146 (T399249)', diff saved to https://phabricator.wikimedia.org/P80138 and previous config saved to /var/cache/conftool/dbconfig/20250728-201013-marostegui.json |
[production] |
| 20:01 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P80137 and previous config saved to /var/cache/conftool/dbconfig/20250728-200125-fceratto.json |
[production] |
| 19:47 |
<dancy@deploy1003> |
Finished deploy [releng/jenkins-deploy@b89eed0] (releasing): Disabling the MediaWiki publish WMF single-version image job (T398873) (duration: 01m 11s) |
[production] |
| 19:46 |
<dancy@deploy1003> |
Started deploy [releng/jenkins-deploy@b89eed0] (releasing): Disabling the MediaWiki publish WMF single-version image job (T398873) |
[production] |
| 19:46 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P80136 and previous config saved to /var/cache/conftool/dbconfig/20250728-194618-fceratto.json |
[production] |
| 19:31 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80135 and previous config saved to /var/cache/conftool/dbconfig/20250728-193110-fceratto.json |
[production] |
| 19:28 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db2168 (T399728)', diff saved to https://phabricator.wikimedia.org/P80134 and previous config saved to /var/cache/conftool/dbconfig/20250728-192817-fceratto.json |
[production] |
| 19:28 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 19:27 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80133 and previous config saved to /var/cache/conftool/dbconfig/20250728-192754-fceratto.json |
[production] |
| 19:27 |
<fabfur> |
restarting haproxykafka on A:cp-ulsfo (T400620) |
[production] |
| 19:17 |
<fabfur> |
updating haproxykafka to v0.3.11 on A:cp-ulsfo (T400620) |
[production] |
| 19:12 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P80132 and previous config saved to /var/cache/conftool/dbconfig/20250728-191247-fceratto.json |
[production] |
| 18:57 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P80131 and previous config saved to /var/cache/conftool/dbconfig/20250728-185739-fceratto.json |
[production] |
| 18:42 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80130 and previous config saved to /var/cache/conftool/dbconfig/20250728-184232-fceratto.json |
[production] |
| 18:39 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Depooling db2159 (T399728)', diff saved to https://phabricator.wikimedia.org/P80129 and previous config saved to /var/cache/conftool/dbconfig/20250728-183939-fceratto.json |
[production] |
| 18:39 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2159.codfw.wmnet with reason: Maintenance |
[production] |
| 18:39 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T399728)', diff saved to https://phabricator.wikimedia.org/P80128 and previous config saved to /var/cache/conftool/dbconfig/20250728-183916-fceratto.json |
[production] |
| 18:26 |
<ejegg> |
payments-wiki upgraded from b942983f to a0f165ad |
[production] |
| 18:24 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P80127 and previous config saved to /var/cache/conftool/dbconfig/20250728-182409-fceratto.json |
[production] |
| 18:22 |
<fabfur> |
haproxykafka 0.3.11 uploaded to apt repo (T400620) |
[production] |
| 18:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2146 (T399249)', diff saved to https://phabricator.wikimedia.org/P80126 and previous config saved to /var/cache/conftool/dbconfig/20250728-182134-marostegui.json |
[production] |
| 18:21 |
<marostegui@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db2146.codfw.wmnet with reason: Maintenance |
[production] |
| 18:21 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2145 (T399249)', diff saved to https://phabricator.wikimedia.org/P80125 and previous config saved to /var/cache/conftool/dbconfig/20250728-182111-marostegui.json |
[production] |
| 18:15 |
<fabfur> |
repooled cp4037 (T400620) |
[production] |
| 18:15 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet |
[production] |
| 18:14 |
<fabfur> |
depooling cp4037 to upgrade new haproxykafka version (T400620) |
[production] |
| 18:13 |
<fabfur@cumin1002> |
conftool action : set/pooled=no; selector: name=cp4037.ulsfo.wmnet |
[production] |
| 18:09 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P80124 and previous config saved to /var/cache/conftool/dbconfig/20250728-180901-fceratto.json |
[production] |