|
2023-03-13
ยง
|
| 08:07 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45741 and previous config saved to /var/cache/conftool/dbconfig/20230313-080738-marostegui.json |
[production] |
| 08:05 |
<nfraison@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 08:05 |
<nfraison@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 08:02 |
<moritzm> |
installing curl security updates |
[production] |
| 07:58 |
<zabe@deploy2002> |
Finished scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] (duration: 07m 02s) |
[production] |
| 07:53 |
<zabe@deploy2002> |
zabe: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 07:52 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45740 and previous config saved to /var/cache/conftool/dbconfig/20230313-075232-marostegui.json |
[production] |
| 07:51 |
<zabe@deploy2002> |
Started scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] |
[production] |
| 07:37 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45739 and previous config saved to /var/cache/conftool/dbconfig/20230313-073725-marostegui.json |
[production] |
| 07:37 |
<marostegui> |
Remove pagetriage_log from enwiki T328309 |
[production] |
| 07:32 |
<kartik@deploy2002> |
Finished scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] (duration: 17m 04s) |
[production] |
| 07:25 |
<kartik@deploy2002> |
kartik: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 07:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45738 and previous config saved to /var/cache/conftool/dbconfig/20230313-072219-marostegui.json |
[production] |
| 07:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45737 and previous config saved to /var/cache/conftool/dbconfig/20230313-071522-marostegui.json |
[production] |
| 07:15 |
<kartik@deploy2002> |
Started scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] |
[production] |
| 07:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2120.codfw.wmnet with reason: Maintenance |
[production] |
| 07:15 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2120.codfw.wmnet with reason: Maintenance |
[production] |
| 07:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45736 and previous config saved to /var/cache/conftool/dbconfig/20230313-071501-marostegui.json |
[production] |
| 06:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P45735 and previous config saved to /var/cache/conftool/dbconfig/20230313-065954-marostegui.json |
[production] |
| 06:52 |
<marostegui_> |
Remove pagetriage_log from testwiki and test2wiki T328309 |
[production] |
| 06:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P45734 and previous config saved to /var/cache/conftool/dbconfig/20230313-064448-marostegui.json |
[production] |
| 06:35 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9873 |
[production] |
| 06:35 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 9873 |
[production] |
| 06:34 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9507 |
[production] |
| 06:34 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 9507 |
[production] |
| 06:33 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 15830 |
[production] |
| 06:33 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 15830 |
[production] |
| 06:31 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9902 |
[production] |
| 06:31 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 9902 |
[production] |
| 06:29 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8966 |
[production] |
| 06:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45733 and previous config saved to /var/cache/conftool/dbconfig/20230313-062942-marostegui.json |
[production] |
| 06:29 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 8966 |
[production] |
| 06:27 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 34549 |
[production] |
| 06:27 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 34549 |
[production] |
| 06:25 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 29357 |
[production] |
| 06:25 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'configure' for AS: 29357 |
[production] |
| 06:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2108 (T329260)', diff saved to https://phabricator.wikimedia.org/P45732 and previous config saved to /var/cache/conftool/dbconfig/20230313-062244-marostegui.json |
[production] |
| 06:22 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2108.codfw.wmnet with reason: Maintenance |
[production] |
| 06:22 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2108.codfw.wmnet with reason: Maintenance |
[production] |
| 06:21 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 138886 |
[production] |
| 06:19 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'configure' for AS: 138886 |
[production] |
| 06:18 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2100.codfw.wmnet with reason: Maintenance |
[production] |
| 06:18 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2100.codfw.wmnet with reason: Maintenance |
[production] |
| 06:16 |
<marostegui_> |
Deploy schema change on s3 codfw dbmaint T329684 |
[production] |
| 06:13 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2098.codfw.wmnet with reason: Maintenance |
[production] |
| 06:13 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2098.codfw.wmnet with reason: Maintenance |
[production] |
| 04:37 |
<kart_> |
Updated cxserver to 2023-03-09-061555-production (T331097, T327102, T326541) |
[production] |
| 04:19 |
<kartik@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/cxserver: apply |
[production] |
| 04:19 |
<kartik@deploy2002> |
helmfile [codfw] START helmfile.d/services/cxserver: apply |
[production] |
| 04:18 |
<kartik@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/cxserver: apply |
[production] |