|
2023-03-13
ยง
|
| 10:07 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 38082 |
[production] |
| 10:07 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 668 |
[production] |
| 10:06 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.peering with action 'email' for AS: 668 |
[production] |
| 10:05 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 10:05 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 10:02 |
<moritzm> |
imported dh-php 0.35+wmf1+buster1+icu67u1 T329491 |
[production] |
| 09:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2150 (T329260)', diff saved to https://phabricator.wikimedia.org/P45753 and previous config saved to /var/cache/conftool/dbconfig/20230313-095728-marostegui.json |
[production] |
| 09:55 |
<vgutierrez> |
Enable haproxy hardening in cp hosts globally - T323944 |
[production] |
| 09:52 |
<zabe@deploy2002> |
Finished scap: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] (duration: 07m 40s) |
[production] |
| 09:51 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2150 (T329260)', diff saved to https://phabricator.wikimedia.org/P45752 and previous config saved to /var/cache/conftool/dbconfig/20230313-095119-marostegui.json |
[production] |
| 09:51 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2150.codfw.wmnet with reason: Maintenance |
[production] |
| 09:51 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2150.codfw.wmnet with reason: Maintenance |
[production] |
| 09:50 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2122 (T329260)', diff saved to https://phabricator.wikimedia.org/P45751 and previous config saved to /var/cache/conftool/dbconfig/20230313-095058-marostegui.json |
[production] |
| 09:48 |
<jayme> |
pcc-worker1003:~# rm -r /srv/jenkins/puppet-compiler/40076 - / back to 70% |
[production] |
| 09:46 |
<zabe@deploy2002> |
jforrester and zabe: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 09:45 |
<jayme> |
pcc-worker1002:~# rm -r /srv/jenkins/puppet-compiler/40078 - / back to 47% usage |
[production] |
| 09:44 |
<zabe@deploy2002> |
Started scap: Backport for [[gerrit:896037|Drop loading of former extension Renameuser's i18n strings [Re-apply]]] |
[production] |
| 09:44 |
<zabe@deploy2002> |
Finished scap: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] (duration: 07m 52s) |
[production] |
| 09:40 |
<jayme> |
pcc-worker1001:~# rm -r /srv/jenkins/puppet-compiler/40079 /srv/jenkins/puppet-compiler/38943 - / back to 68% usage |
[production] |
| 09:38 |
<zabe@deploy2002> |
zabe: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 09:36 |
<zabe@deploy2002> |
Started scap: Backport for [[gerrit:897804|Revert "Revert "Unload RenameUser, now part of core: Part I of II"" (T331685)]] |
[production] |
| 09:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2122', diff saved to https://phabricator.wikimedia.org/P45750 and previous config saved to /var/cache/conftool/dbconfig/20230313-093552-marostegui.json |
[production] |
| 09:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2122', diff saved to https://phabricator.wikimedia.org/P45749 and previous config saved to /var/cache/conftool/dbconfig/20230313-092045-marostegui.json |
[production] |
| 09:16 |
<moritzm> |
installing python-werkzeug security updates |
[production] |
| 09:05 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2122 (T329260)', diff saved to https://phabricator.wikimedia.org/P45748 and previous config saved to /var/cache/conftool/dbconfig/20230313-090539-marostegui.json |
[production] |
| 08:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2122 (T329260)', diff saved to https://phabricator.wikimedia.org/P45747 and previous config saved to /var/cache/conftool/dbconfig/20230313-085937-marostegui.json |
[production] |
| 08:59 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2122.codfw.wmnet with reason: Maintenance |
[production] |
| 08:59 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2122.codfw.wmnet with reason: Maintenance |
[production] |
| 08:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121 (T329260)', diff saved to https://phabricator.wikimedia.org/P45746 and previous config saved to /var/cache/conftool/dbconfig/20230313-085916-marostegui.json |
[production] |
| 08:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121', diff saved to https://phabricator.wikimedia.org/P45745 and previous config saved to /var/cache/conftool/dbconfig/20230313-084409-marostegui.json |
[production] |
| 08:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121', diff saved to https://phabricator.wikimedia.org/P45744 and previous config saved to /var/cache/conftool/dbconfig/20230313-082903-marostegui.json |
[production] |
| 08:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121 (T329260)', diff saved to https://phabricator.wikimedia.org/P45743 and previous config saved to /var/cache/conftool/dbconfig/20230313-081357-marostegui.json |
[production] |
| 08:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2121 (T329260)', diff saved to https://phabricator.wikimedia.org/P45742 and previous config saved to /var/cache/conftool/dbconfig/20230313-080759-marostegui.json |
[production] |
| 08:07 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 08:07 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 08:07 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45741 and previous config saved to /var/cache/conftool/dbconfig/20230313-080738-marostegui.json |
[production] |
| 08:05 |
<nfraison@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 08:05 |
<nfraison@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 08:02 |
<moritzm> |
installing curl security updates |
[production] |
| 07:58 |
<zabe@deploy2002> |
Finished scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] (duration: 07m 02s) |
[production] |
| 07:53 |
<zabe@deploy2002> |
zabe: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 07:52 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45740 and previous config saved to /var/cache/conftool/dbconfig/20230313-075232-marostegui.json |
[production] |
| 07:51 |
<zabe@deploy2002> |
Started scap: Backport for [[gerrit:897188|use core Renameuser classes (T27482)]], [[gerrit:897187|UserRenameHandler: Use core RenameUser classes (T27482)]] |
[production] |
| 07:37 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P45739 and previous config saved to /var/cache/conftool/dbconfig/20230313-073725-marostegui.json |
[production] |
| 07:37 |
<marostegui> |
Remove pagetriage_log from enwiki T328309 |
[production] |
| 07:32 |
<kartik@deploy2002> |
Finished scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] (duration: 17m 04s) |
[production] |
| 07:25 |
<kartik@deploy2002> |
kartik: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 07:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45738 and previous config saved to /var/cache/conftool/dbconfig/20230313-072219-marostegui.json |
[production] |
| 07:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db2120 (T329260)', diff saved to https://phabricator.wikimedia.org/P45737 and previous config saved to /var/cache/conftool/dbconfig/20230313-071522-marostegui.json |
[production] |
| 07:15 |
<kartik@deploy2002> |
Started scap: Backport for [[gerrit:897404|testwiki: Enable Section Translation on 11 Wikipedias (T327102 T326541)]] |
[production] |