|
2024-05-27
ยง
|
| 10:37 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1189.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:37 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1175 (T364299)', diff saved to https://phabricator.wikimedia.org/P63297 and previous config saved to /var/cache/conftool/dbconfig/20240527-103734-marostegui.json |
[production] |
| 10:26 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2150 (re)pooling @ 100%: Repooling T365797', diff saved to https://phabricator.wikimedia.org/P63296 and previous config saved to /var/cache/conftool/dbconfig/20240527-102639-root.json |
[production] |
| 10:26 |
<stevemunene@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub-next: sync on staging |
[production] |
| 10:22 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P63295 and previous config saved to /var/cache/conftool/dbconfig/20240527-102226-marostegui.json |
[production] |
| 10:14 |
<stevemunene@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub-next: apply on staging |
[production] |
| 10:12 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 10:12 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 10:11 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2150 (re)pooling @ 75%: Repooling T365797', diff saved to https://phabricator.wikimedia.org/P63294 and previous config saved to /var/cache/conftool/dbconfig/20240527-101133-root.json |
[production] |
| 10:07 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P63293 and previous config saved to /var/cache/conftool/dbconfig/20240527-100717-marostegui.json |
[production] |
| 10:05 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1200 (T364069)', diff saved to https://phabricator.wikimedia.org/P63292 and previous config saved to /var/cache/conftool/dbconfig/20240527-100523-marostegui.json |
[production] |
| 10:05 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1200.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:05 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db1200.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:05 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1185 (T364069)', diff saved to https://phabricator.wikimedia.org/P63291 and previous config saved to /var/cache/conftool/dbconfig/20240527-100459-marostegui.json |
[production] |
| 10:04 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 10:04 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:58 |
<stevemunene@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub-next: sync on staging |
[production] |
| 09:56 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2150 (re)pooling @ 50%: Repooling T365797', diff saved to https://phabricator.wikimedia.org/P63290 and previous config saved to /var/cache/conftool/dbconfig/20240527-095626-root.json |
[production] |
| 09:56 |
<ladsgroup@deploy1002> |
Finished scap: Backport for [[gerrit:1035852|Update tagline and wordmark of Persian Wikibooks (T365913)]] (duration: 16m 59s) |
[production] |
| 09:54 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:54 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:52 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:52 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:52 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1175 (T364299)', diff saved to https://phabricator.wikimedia.org/P63289 and previous config saved to /var/cache/conftool/dbconfig/20240527-095208-marostegui.json |
[production] |
| 09:49 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1185', diff saved to https://phabricator.wikimedia.org/P63288 and previous config saved to /var/cache/conftool/dbconfig/20240527-094951-marostegui.json |
[production] |
| 09:49 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:47 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:46 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:45 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox-dev2002.codfw.wmnet with reason: add python-social-auth and update wheels - ayounsi@cumin1002 - T308002 |
[production] |
| 09:45 |
<stevemunene@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub-next: apply on staging |
[production] |
| 09:44 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:44 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:42 |
<ladsgroup@deploy1002> |
ebrahim and ladsgroup: Continuing with sync |
[production] |
| 09:41 |
<ladsgroup@deploy1002> |
ebrahim and ladsgroup: Backport for [[gerrit:1035852|Update tagline and wordmark of Persian Wikibooks (T365913)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 09:41 |
<ayounsi@cumin1002> |
START - Cookbook sre.deploy.python-code netbox to netbox-dev2002.codfw.wmnet with reason: add python-social-auth and update wheels - ayounsi@cumin1002 - T308002 |
[production] |
| 09:41 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2150 (re)pooling @ 25%: Repooling T365797', diff saved to https://phabricator.wikimedia.org/P63287 and previous config saved to /var/cache/conftool/dbconfig/20240527-094120-root.json |
[production] |
| 09:39 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:39 |
<ladsgroup@deploy1002> |
Started scap: Backport for [[gerrit:1035852|Update tagline and wordmark of Persian Wikibooks (T365913)]] |
[production] |
| 09:39 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:39 |
<zabe@deploy1002> |
Finished scap: Backport for [[gerrit:1036193|Stop writing to af_user(_text)/afh_user(_text) in group1 wikis (T337920)]] (duration: 29m 43s) |
[production] |
| 09:37 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 64096 |
[production] |
| 09:36 |
<ayounsi@cumin1002> |
START - Cookbook sre.network.peering with action 'configure' for AS: 64096 |
[production] |
| 09:34 |
<ladsgroup@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2129.codfw.wmnet with reason: Maintenance |
[production] |
| 09:34 |
<ladsgroup@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2129.codfw.wmnet with reason: Maintenance |
[production] |
| 09:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1185', diff saved to https://phabricator.wikimedia.org/P63286 and previous config saved to /var/cache/conftool/dbconfig/20240527-093443-marostegui.json |
[production] |
| 09:33 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2129', diff saved to https://phabricator.wikimedia.org/P63285 and previous config saved to /var/cache/conftool/dbconfig/20240527-093306-root.json |
[production] |
| 09:31 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:31 |
<logmsgbot> |
@deploy1002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 09:26 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2150 (re)pooling @ 10%: Repooling T365797', diff saved to https://phabricator.wikimedia.org/P63284 and previous config saved to /var/cache/conftool/dbconfig/20240527-092614-root.json |
[production] |