2023-04-25
ยง
|
18:39 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: 0.3.123 |
[production] |
18:18 |
<jhuneidi@deploy1002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.6 refs T330212 |
[production] |
16:55 |
<ejegg> |
payments-wiki upgraded from 2a4c450d to f30bc859 |
[production] |
15:39 |
<akosiaris@deploy1002> |
helmfile [eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
15:39 |
<akosiaris@deploy1002> |
helmfile [eqiad] START helmfile.d/admin 'apply'. |
[production] |
15:34 |
<akosiaris@deploy1002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
15:33 |
<akosiaris@deploy1002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
15:32 |
<akosiaris@deploy1002> |
helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
15:31 |
<akosiaris@deploy1002> |
helmfile [staging-codfw] START helmfile.d/admin 'apply'. |
[production] |
15:31 |
<akosiaris@deploy1002> |
helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
15:31 |
<akosiaris@deploy1002> |
helmfile [staging-eqiad] START helmfile.d/admin 'apply'. |
[production] |
15:30 |
<dancy@deploy1002> |
Installation of scap version "4.50.0" completed for 1 hosts |
[production] |
15:30 |
<dancy@deploy1002> |
Installing scap version "4.50.0" for 1 hosts |
[production] |
15:28 |
<XioNoX> |
update cr2-eqsin BBIX interface |
[production] |
15:27 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
15:27 |
<btullis@cumin1001> |
Added views for new wiki: azwikimedia T330442 |
[production] |
15:25 |
<dancy@deploy1002> |
Installing scap version "4.50.0" for 592 hosts |
[production] |
15:24 |
<cgoubert@cumin2002> |
END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool restbase-async in eqiad: T335015 |
[production] |
15:22 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on irc2002.wikimedia.org with reason: Non-functional, WIP for Bullseye update |
[production] |
15:22 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on irc2002.wikimedia.org with reason: Non-functional, WIP for Bullseye update |
[production] |
15:22 |
<claime> |
Datacenter Service Switchback concluded - T335015 |
[production] |
15:21 |
<cgoubert@deploy1002> |
Synchronized README: check the deployment server after switchback - T335015 (duration: 19m 55s) |
[production] |
15:19 |
<cgoubert@cumin2002> |
END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) restbase-async.discovery.wmnet on all recursors |
[production] |
15:19 |
<cgoubert@cumin2002> |
START - Cookbook sre.dns.wipe-cache restbase-async.discovery.wmnet on all recursors |
[production] |
15:19 |
<cgoubert@cumin2002> |
START - Cookbook sre.discovery.service-route depool restbase-async in eqiad: T335015 |
[production] |
15:18 |
<claime> |
Restoring restbase-async to codfw only - T335015 |
[production] |
15:18 |
<cgoubert@deploy1002> |
Finished deploy [restbase/deploy@a08f56d]: (no justification provided) (duration: 13m 06s) |
[production] |
15:08 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-logging1002.eqiad.wmnet with OS bullseye |
[production] |
15:05 |
<cgoubert@deploy1002> |
Started deploy [restbase/deploy@a08f56d]: (no justification provided) |
[production] |
15:02 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
15:02 |
<inflatador> |
[WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` |
[production] |
15:02 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
15:02 |
<btullis@cumin1001> |
Added views for new wiki: vewikimedia T330704 |
[production] |
15:01 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
15:01 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
15:01 |
<btullis@cumin1001> |
Added views for new wiki: ckbwiktionary T331834 |
[production] |
15:01 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
15:00 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
15:00 |
<btullis@cumin1001> |
Added views for new wiki: fatwiki T335018 |
[production] |
15:00 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
15:00 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
15:00 |
<btullis@cumin1001> |
Added views for new wiki: kcgwiktionary T334739 |
[production] |
15:00 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
14:59 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) |
[production] |
14:59 |
<btullis@cumin1001> |
Added views for new wiki: guwwikinews T334408 |
[production] |
14:59 |
<btullis@cumin1001> |
START - Cookbook sre.wikireplicas.add-wiki |
[production] |
14:58 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: 0.3.123 (duration: 07m 38s) |
[production] |
14:54 |
<cgoubert@deploy2002> |
Unlocked for deployment [ALL REPOSITORIES]: Datacenter Service Switchback - T335015 (duration: 81m 19s) |
[production] |
14:51 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-logging1002.eqiad.wmnet with reason: host reimage |
[production] |
14:50 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: 0.3.123 |
[production] |