|
2026-10-29
§
|
| 07:43 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 06:56 |
<marostegui> |
DB circular replication has been disabled everywhere T436501 |
[production] |
| 06:56 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s1 |
[production] |
| 06:55 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s1 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s4 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s4 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s8 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s8 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s7 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s7 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s3 |
[production] |
| 06:51 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s3 |
[production] |
| 06:51 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s2 |
[production] |
| 06:50 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s2 |
[production] |
| 06:49 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s5 |
[production] |
| 06:49 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s5 |
[production] |
| 06:47 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s6 |
[production] |
| 06:47 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s6 |
[production] |
| 06:46 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section es7 |
[production] |
| 06:46 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section es7 |
[production] |
| 06:43 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section es6 |
[production] |
| 06:43 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section es6 |
[production] |
| 06:40 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x4 |
[production] |
| 06:40 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x4 |
[production] |
| 06:38 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x3 |
[production] |
| 06:37 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x3 |
[production] |
| 06:36 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x1 |
[production] |
| 06:35 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x1 |
[production] |
| 06:10 |
<kartik@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 06:03 |
<kartik@deploy1003> |
helmfile [eqiad] START helmfile.d/services/machinetranslation: apply |
[production] |
| 06:00 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 05:54 |
<kartik@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 05:49 |
<kartik@deploy1003> |
helmfile [codfw] START helmfile.d/services/machinetranslation: apply |
[production] |
| 05:48 |
<kartik@deploy1003> |
helmfile [staging] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 05:48 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . |
[production] |
| 05:48 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 05:45 |
<kartik@deploy1003> |
helmfile [staging] START helmfile.d/services/machinetranslation: apply |
[production] |
| 05:27 |
<kartik@deploy1003> |
helmfile [ml-serve-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . |
[production] |
| 05:23 |
<kartik@deploy1003> |
helmfile [ml-serve-eqiad] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . |
[production] |
| 05:20 |
<kartik@deploy1003> |
helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . |
[production] |
| 04:14 |
<herron@cumin1004> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1262: depooling replica after host flap |
[production] |
| 04:11 |
<herron@cumin1004> |
START - Cookbook sre.mysql.depool depool db1262: depooling replica after host flap |
[production] |
| 00:00 |
<root@deploy1003> |
helmfile [staging] DONE helmfile.d/services/shellbox: sync |
[production] |
| 00:00 |
<root@deploy1003> |
helmfile [staging] START helmfile.d/services/shellbox: sync |
[production] |
|
2026-10-28
§
|
| 23:11 |
<egardner@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) (duration: 36m 58s) |
[production] |
| 23:00 |
<egardner@deploy1003> |
sbassett, egardner: Continuing with deployment |
[production] |
| 22:56 |
<egardner@deploy1003> |
sbassett, egardner: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) synced to the testservers (see https://wikitech.wikimedia.org/ |
[production] |
| 22:34 |
<egardner@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) |
[production] |
| 22:30 |
<egardner@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1357787|Disable Discord QuickSurvey]] (duration: 10m 41s) |
[production] |
| 22:25 |
<egardner@deploy1003> |
derenrich, egardner: Continuing with deployment |
[production] |