|
2026-09-29
ยง
|
| 17:52 |
<ebysans@deploy1003> |
Finished deploy [analytics/refinery@613ef4d] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@613ef4d9] (duration: 00m 46s) |
[production] |
| 17:51 |
<ebysans@deploy1003> |
Started deploy [analytics/refinery@613ef4d] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@613ef4d9] |
[production] |
| 17:51 |
<cdobbins@cumin1004> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ncredir5004.eqsin.wmnet with OS trixie |
[production] |
| 17:50 |
<lerickson@deploy1003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply |
[production] |
| 17:46 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 17:45 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 17:44 |
<sandraebele> |
Deployed refinery-source using jenkins as part of weekly deployment train |
[production] |
| 17:43 |
<sandraebele> |
Deployed refinery-source using jenkins as part of weekly deployment train |
[analytics] |
| 17:39 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 17:10 |
<dcaro@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api |
[toolsbeta] |
| 17:01 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T420707, T420707: initial data for new host) xfer scholarly_articles from wdqs2023.codfw.wmnet -> wdqs1035.eqiad.wmnet, repooling source-only afterwards |
[production] |
| 17:01 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T420707, T420707: initial data for new host) xfer wdqs-all from wdqs2013.codfw.wmnet -> wdqs1034.eqiad.wmnet, repooling source-only afterwards |
[production] |
| 17:00 |
<ryankemper@cumin2003> |
START - Cookbook sre.wdqs.data-transfer (T420707, T420707: initial data for new host) xfer wdqs-all from wdqs2021.codfw.wmnet -> wdqs1033.eqiad.wmnet, repooling source-only afterwards |
[production] |
| 16:58 |
<brett@puppetserver1001> |
conftool action : set/pooled=yes; selector: name=cp5028.* |
[production] |
| 16:54 |
<ryankemper@deploy1003> |
Finished deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host (duration: 00m 04s) |
[production] |
| 16:54 |
<ryankemper@deploy1003> |
Started deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host |
[production] |
| 16:54 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[toolsbeta] |
| 16:54 |
<ryankemper@deploy1003> |
Finished deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host (duration: 00m 04s) |
[production] |
| 16:54 |
<ryankemper@deploy1003> |
Started deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host |
[production] |
| 16:54 |
<ryankemper@deploy1003> |
Finished deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host (duration: 00m 04s) |
[production] |
| 16:54 |
<ryankemper@deploy1003> |
Started deploy [wdqs/wdqs@cf64fe9]: T420707: deploy to fresh wdqs host |
[production] |
| 16:36 |
<sukhe@puppetserver1001> |
conftool action : set/pooled=no; selector: name=cp5028.eqsin.wmnet |
[production] |
| 16:36 |
<sukhe@puppetserver1001> |
conftool action : set/pooled=no; selector: name=cp5028 |
[production] |
| 16:35 |
<inflatador> |
bking@cephosd1001 `sudo radosgw-admin user create --uid=matomo --display-name="Matomo on K8s"` T436186 |
[production] |
| 16:22 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 16:21 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 16:20 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 16:19 |
<urbanecm@deploy1003> |
mwscript-k8s job started: GrowthExperiments:reassignMentees --wiki=enwiki --mentor=Blacephalon --performer=Blacephalon --as-job # T418194 |
[production] |
| 16:19 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 16:19 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 16:19 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 16:18 |
<jhathaway@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply |
[production] |
| 16:16 |
<lerickson@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 16:15 |
<jhathaway@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-cron: apply |
[production] |
| 16:13 |
<dcaro@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api |
[toolsbeta] |
| 16:03 |
<dcaro@cloudcumin1001> |
START - Cookbook wmcs.toolforge.component.deploy for component jobs-api |
[toolsbeta] |
| 15:59 |
<jhathaway> |
updating puppet stdlib, should be a noop |
[production] |
| 15:43 |
<brett@cumin1004> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-upload_eqsin - 7.1.1-2~bpo13+wmf3 () |
[production] |
| 15:39 |
<brett@cumin1004> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-text_eqsin - 7.1.1-2~bpo13+wmf3 () |
[production] |
| 15:23 |
<dzahn@cumin1004> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host zuul1005.eqiad.wmnet with OS trixie |
[production] |
| 15:14 |
<cdobbins@cumin1004> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ncredir5004.eqsin.wmnet with reason: host reimage |
[production] |
| 15:13 |
<ejegg> |
payments-wiki upgraded from 49e656bc to dae59de9 |
[fundraising] |
| 15:09 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir5004.eqsin.wmnet with reason: host reimage |
[production] |
| 15:08 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 15:08 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply |
[production] |
| 14:32 |
<cgoubert@cumin2003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on wikikube-worker1152.eqiad.wmnet with reason: hardware/networking issues |
[production] |
| 14:23 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox |
[production] |
| 14:21 |
<cmooney@cumin1004> |
START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox |
[production] |
| 14:21 |
<moritzm> |
installing rsyslog security updates |
[production] |
| 14:19 |
<cdobbins@cumin1004> |
START - Cookbook sre.hosts.reimage for host ncredir5004.eqsin.wmnet with OS trixie |
[production] |