|
2024-07-05
ยง
|
| 20:55 |
<wmbot~bd808@tools-bastion-12> |
Restarted bridgebot job to pick up new container build (T368317, MR!8) |
[tools.bridgebot] |
| 20:05 |
<akosiaris@deploy1003> |
helmfile [staging] DONE helmfile.d/services/api-gateway: apply |
[production] |
| 20:04 |
<akosiaris@deploy1003> |
helmfile [staging] START helmfile.d/services/api-gateway: apply |
[production] |
| 18:56 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2171 (T367856)', diff saved to https://phabricator.wikimedia.org/P65886 and previous config saved to /var/cache/conftool/dbconfig/20240705-185604-marostegui.json |
[production] |
| 18:55 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2171.codfw.wmnet with reason: Maintenance |
[production] |
| 18:55 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2171.codfw.wmnet with reason: Maintenance |
[production] |
| 18:55 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2157 (T367856)', diff saved to https://phabricator.wikimedia.org/P65885 and previous config saved to /var/cache/conftool/dbconfig/20240705-185542-marostegui.json |
[production] |
| 18:40 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P65884 and previous config saved to /var/cache/conftool/dbconfig/20240705-184034-marostegui.json |
[production] |
| 18:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P65883 and previous config saved to /var/cache/conftool/dbconfig/20240705-183428-root.json |
[production] |
| 18:25 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P65882 and previous config saved to /var/cache/conftool/dbconfig/20240705-182527-marostegui.json |
[production] |
| 18:19 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P65881 and previous config saved to /var/cache/conftool/dbconfig/20240705-181923-root.json |
[production] |
| 18:10 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2157 (T367856)', diff saved to https://phabricator.wikimedia.org/P65880 and previous config saved to /var/cache/conftool/dbconfig/20240705-181020-marostegui.json |
[production] |
| 18:04 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P65879 and previous config saved to /var/cache/conftool/dbconfig/20240705-180417-root.json |
[production] |
| 17:56 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2207 (T352010)', diff saved to https://phabricator.wikimedia.org/P65878 and previous config saved to /var/cache/conftool/dbconfig/20240705-175653-ladsgroup.json |
[production] |
| 17:49 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P65877 and previous config saved to /var/cache/conftool/dbconfig/20240705-174912-root.json |
[production] |
| 17:41 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P65876 and previous config saved to /var/cache/conftool/dbconfig/20240705-174146-ladsgroup.json |
[production] |
| 17:34 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P65875 and previous config saved to /var/cache/conftool/dbconfig/20240705-173406-root.json |
[production] |
| 17:26 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P65874 and previous config saved to /var/cache/conftool/dbconfig/20240705-172639-ladsgroup.json |
[production] |
| 17:19 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P65873 and previous config saved to /var/cache/conftool/dbconfig/20240705-171901-root.json |
[production] |
| 17:11 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2207 (T352010)', diff saved to https://phabricator.wikimedia.org/P65872 and previous config saved to /var/cache/conftool/dbconfig/20240705-171131-ladsgroup.json |
[production] |
| 17:03 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db1246 (re)pooling @ 1%: Repooling', diff saved to https://phabricator.wikimedia.org/P65871 and previous config saved to /var/cache/conftool/dbconfig/20240705-170356-root.json |
[production] |
| 17:00 |
<logmsgbot> |
andrewtavis-wmde@deploy1002 Finished deploy [airflow-dags/wmde@73c6618]: (no justification provided) (duration: 00m 06s) |
[production] |
| 17:00 |
<logmsgbot> |
andrewtavis-wmde@deploy1002 Started deploy [airflow-dags/wmde@73c6618]: (no justification provided) |
[production] |
| 17:00 |
<wmbot~bd808@tools-bastion-12> |
Replaced tool-bridgebot/znc container with tool-containers/bnc container (T366970) |
[tools.bridgebot] |
| 15:49 |
<arturo> |
deleted a bunch of leaked VMs -- timeout waiting for A record |
[admin-monitoring] |
| 13:40 |
<hashar@deploy1002> |
Finished deploy [integration/docroot@18c8279]: Add AQS documentation to landing page - T368484 (duration: 00m 06s) |
[production] |
| 13:40 |
<hashar@deploy1002> |
Started deploy [integration/docroot@18c8279]: Add AQS documentation to landing page - T368484 |
[production] |
| 12:57 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1246.eqiad.wmnet with reason: Long schema change |
[production] |
| 12:57 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db1246.eqiad.wmnet with reason: Long schema change |
[production] |
| 12:52 |
<aborrero@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno |
[tools] |
| 12:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db2157 (T367856)', diff saved to https://phabricator.wikimedia.org/P65869 and previous config saved to /var/cache/conftool/dbconfig/20240705-125152-marostegui.json |
[production] |
| 12:51 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno |
[tools] |
| 12:51 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2157.codfw.wmnet with reason: Maintenance |
[production] |
| 12:51 |
<aborrero@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno |
[toolsbeta] |
| 12:51 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2157.codfw.wmnet with reason: Maintenance |
[production] |
| 12:51 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2128 (T367856)', diff saved to https://phabricator.wikimedia.org/P65868 and previous config saved to /var/cache/conftool/dbconfig/20240705-125130-marostegui.json |
[production] |
| 12:51 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno |
[toolsbeta] |
| 12:36 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2128', diff saved to https://phabricator.wikimedia.org/P65867 and previous config saved to /var/cache/conftool/dbconfig/20240705-123623-marostegui.json |
[production] |
| 12:34 |
<aborrero@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno |
[tools] |
| 12:34 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno |
[tools] |
| 12:33 |
<aborrero@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component kyverno |
[toolsbeta] |
| 12:33 |
<aborrero@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component kyverno |
[toolsbeta] |
| 12:29 |
<wmbot~arturo@nostromo> |
END (PASS) - Cookbook wmcs.toolforge.k8s.kyverno.copy_images_to_registry (exit_code=0) |
[tools] |
| 12:29 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/bitnami-kubectl:1.26.4 |
[tools] |
| 12:29 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/toolforge-kyverno-reports-controller:v1.10.7 |
[tools] |
| 12:28 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/toolforge-kyverno-cleanup-controller:v1.10.7 |
[tools] |
| 12:28 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/toolforge-kyverno-background-controller:v1.10.7 |
[tools] |
| 12:28 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/toolforge-kyverno-kyvernopre:v1.10.7 |
[tools] |
| 12:28 |
<wmbot~lucaswerkmeister@tools-bastion-13> |
deployed 1013a7234d (l10n updates: ar, de, uk) |
[tools.lexeme-forms] |
| 12:28 |
<wmbot~arturo@nostromo> |
Updating container image docker-registry.tools.wmflabs.org/toolforge-kyverno-kyverno:v1.10.7 |
[tools] |