|
2022-10-19
ยง
|
| 11:54 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1101:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35562 and previous config saved to /var/cache/conftool/dbconfig/20221019-115443-ladsgroup.json |
[production] |
| 11:54 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:54 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:54 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35561 and previous config saved to /var/cache/conftool/dbconfig/20221019-115421-ladsgroup.json |
[production] |
| 11:44 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1096:3315', diff saved to https://phabricator.wikimedia.org/P35560 and previous config saved to /var/cache/conftool/dbconfig/20221019-114431-ladsgroup.json |
[production] |
| 11:43 |
<jnuche@deploy1002> |
Installation of scap version "4.27.1" completed for 552 hosts |
[production] |
| 11:43 |
<jnuche@deploy1002> |
Installing scap version "4.27.1" for 552 hosts |
[production] |
| 11:39 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3317', diff saved to https://phabricator.wikimedia.org/P35559 and previous config saved to /var/cache/conftool/dbconfig/20221019-113915-ladsgroup.json |
[production] |
| 11:30 |
<jnuche@deploy1002> |
Installing scap version "4.27.1" for 553 hosts |
[production] |
| 11:29 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1096:3315 (T318955)', diff saved to https://phabricator.wikimedia.org/P35558 and previous config saved to /var/cache/conftool/dbconfig/20221019-112925-ladsgroup.json |
[production] |
| 11:25 |
<hnowlan@deploy1002> |
helmfile [eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:24 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3317', diff saved to https://phabricator.wikimedia.org/P35557 and previous config saved to /var/cache/conftool/dbconfig/20221019-112409-ladsgroup.json |
[production] |
| 11:23 |
<hnowlan@deploy1002> |
helmfile [eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 11:22 |
<hnowlan@deploy1002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:21 |
<hnowlan@deploy1002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
| 11:14 |
<hnowlan@deploy1002> |
helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:13 |
<hnowlan@deploy1002> |
helmfile [staging-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 11:12 |
<hnowlan@deploy1002> |
helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:11 |
<hnowlan@deploy1002> |
helmfile [staging-codfw] START helmfile.d/admin 'apply'. |
[production] |
| 11:10 |
<hnowlan@deploy1002> |
helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 11:10 |
<hnowlan@deploy1002> |
helmfile [staging-codfw] START helmfile.d/admin 'apply'. |
[production] |
| 11:09 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35556 and previous config saved to /var/cache/conftool/dbconfig/20221019-110902-ladsgroup.json |
[production] |
| 11:07 |
<Emperor> |
upload wmf-beamer-style 0.2 to apt |
[production] |
| 11:06 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1131 (T314041)', diff saved to https://phabricator.wikimedia.org/P35555 and previous config saved to /var/cache/conftool/dbconfig/20221019-110635-ladsgroup.json |
[production] |
| 11:06 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1131.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:06 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1131.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:05 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1098:3317 (T318950)', diff saved to https://phabricator.wikimedia.org/P35554 and previous config saved to /var/cache/conftool/dbconfig/20221019-110552-ladsgroup.json |
[production] |
| 11:05 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:05 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:03 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1096:3315 (T318955)', diff saved to https://phabricator.wikimedia.org/P35553 and previous config saved to /var/cache/conftool/dbconfig/20221019-110308-ladsgroup.json |
[production] |
| 11:03 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1096.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:02 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db1096.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:20 |
<cgoubert@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 10:18 |
<cgoubert@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 10:18 |
<cgoubert@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 10:17 |
<cgoubert@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 10:17 |
<claime> |
Deploying mediawiki helm chart v0.2.4 on k8s-experimental mwdebug - T321042 |
[production] |
| 10:08 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 09:58 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 09:23 |
<urbanecm@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:21 |
<urbanecm@deploy1002> |
helmfile [codfw] START helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:21 |
<urbanecm@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:18 |
<urbanecm@deploy1002> |
helmfile [eqiad] START helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:14 |
<urbanecm@deploy1002> |
helmfile [staging] DONE helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:13 |
<urbanecm@deploy1002> |
helmfile [staging] START helmfile.d/services/linkrecommendation: apply |
[production] |
| 09:01 |
<XioNoX> |
remove DHCP server and access zone on mr1-eqiad - T320962 |
[production] |
| 08:15 |
<hashar@deploy1002> |
Synchronized php: group1 wikis to 1.40.0-wmf.6 refs T320511 (duration: 03m 37s) |
[production] |
| 08:12 |
<hashar@deploy1002> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.40.0-wmf.6 refs T320511 |
[production] |
| 07:45 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:844428|[growth] Turn mentorship off by default (T321056)]] (duration: 05m 14s) |
[production] |
| 07:41 |
<urbanecm@deploy1002> |
urbanecm and urbanecm: Backport for [[gerrit:844428|[growth] Turn mentorship off by default (T321056)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet |
[production] |