|
2025-07-21
§
|
| 14:42 |
<bking@cumin2002> |
START - Cookbook sre.wdqs.data-reload reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/scope=wikidata_main/ using stat1009.eqiad.wmnet) |
[production] |
| 14:42 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/scope=wikidata_main/ using stat1009.eqiad.wmnet) |
[production] |
| 13:53 |
<bking@cumin2002> |
START - Cookbook sre.wdqs.data-reload reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/scope=wikidata_main/ using stat1009.eqiad.wmnet) |
[production] |
| 13:53 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
| 13:50 |
<bking@cumin2002> |
START - Cookbook sre.wdqs.data-reload reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
| 13:49 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs://wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
| 13:49 |
<bking@cumin2002> |
START - Cookbook sre.wdqs.data-reload reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs://wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
| 13:48 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs://wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
| 13:48 |
<bking@cumin2002> |
START - Cookbook sre.wdqs.data-reload reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs://wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250714/wiki=wikidata/ using stat1009.eqiad.wmnet) |
[production] |
|
2025-07-16
§
|
| 15:02 |
<inflatador> |
bking@apt1002 publish wmf-opensearch-search-plugins_1.3.20+8_amd64 to component/opensearch13 bullseye-wikimedia |
[production] |
| 13:37 |
<bking@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 13:36 |
<bking@deploy1003> |
helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 13:35 |
<bking@deploy1003> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:33 |
<bking@deploy1003> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
| 13:32 |
<bking@deploy1003> |
helmfile [eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:32 |
<bking@deploy1003> |
helmfile [eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 13:32 |
<bking@deploy1003> |
helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:29 |
<bking@deploy1003> |
helmfile [staging-codfw] START helmfile.d/admin 'apply'. |
[production] |
| 13:29 |
<bking@deploy1003> |
helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:26 |
<bking@deploy1003> |
helmfile [staging-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 13:26 |
<bking@deploy1003> |
helmfile [eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:26 |
<bking@deploy1003> |
helmfile [eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 13:19 |
<bking@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 13:19 |
<bking@deploy1003> |
helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
|
2025-07-07
§
|
| 22:58 |
<bking@cumin1002> |
END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 20:11 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 20:10 |
<bking@cumin1002> |
END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 18:55 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 17:58 |
<bking@cumin1002> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 17:58 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 17:40 |
<bking@cumin1002> |
conftool action : set/pooled=true; selector: dnsdisc=search-omega*,name=eqiad |
[production] |
| 17:40 |
<bking@cumin1002> |
conftool action : set/pooled=true; selector: dnsdisc=search-psi*,name=eqiad |
[production] |
| 17:40 |
<bking@cumin1002> |
conftool action : set/pooled=true; selector: dnsdisc=search*,name=eqiad |
[production] |
| 17:12 |
<bking@cumin1002> |
END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 17:07 |
<bking@cumin1002> |
conftool action : set/pooled=false; selector: dnsdisc=search-psi*,name=eqiad |
[production] |
| 17:07 |
<bking@cumin1002> |
conftool action : set/pooled=false; selector: dnsdisc=search-omega*,name=eqiad |
[production] |
| 17:06 |
<bking@cumin1002> |
conftool action : set/pooled=false; selector: dnsdisc=search*,name=eqiad |
[production] |
| 16:16 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 16:15 |
<bking@cumin1002> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 16:00 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 15:02 |
<bking@cumin1002> |
END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |
| 14:28 |
<bking@cumin1002> |
START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 |
[production] |