|
2019-06-12
§
|
| 16:06 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-restart (exit_code=0) |
[production] |
| 15:49 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-restart |
[production] |
| 15:37 |
<legoktm> |
re-enabled bawolff's gerrit account |
[production] |
| 15:14 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-restart (exit_code=97) |
[production] |
| 14:38 |
<marostegui> |
Start replication on all threads on labsdb1010 - T222978 |
[production] |
| 14:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1077 after recovering from a crash (duration: 00m 47s) |
[production] |
| 13:19 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-restart |
[production] |
| 11:55 |
<godog> |
swift eqiad-prod: put back ms-be1033 - T223518 |
[production] |
| 10:52 |
<godog> |
force-upgrade mtail to 3.0.0~rc24.1-1 on wezen - T225604 |
[production] |
| 10:36 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1077 after recovering from a crash (duration: 00m 47s) |
[production] |
| 10:18 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 10:18 |
<akosiaris@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 10:17 |
<akosiaris@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 10:17 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade --dry-run --debug production stable/zotero [namespace: zotero, clusters: eqiad,codfw] |
[production] |
| 10:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after a crash (duration: 00m 48s) |
[production] |
| 09:51 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-restart (exit_code=0) |
[production] |
| 08:59 |
<hashar> |
Gracefully stopping Zuul (kill -SIGUSR1) to prepare for the restart of the CI Jenkins T225322 |
[production] |
| 08:41 |
<onimisionipe> |
pool map2003. reimage and setup is complete - T224395 |
[production] |
| 08:31 |
<gehel@cumin2001> |
START - Cookbook sre.elasticsearch.rolling-restart |
[production] |
| 06:49 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after a crash (duration: 00m 49s) |
[production] |
|
2019-06-10
§
|
| 19:39 |
<thcipriani> |
restarting jenkins |
[production] |
| 19:11 |
<akosiaris> |
refresh all zotero pods in all clusters |
[production] |
| 19:11 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 19:11 |
<akosiaris@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 19:11 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 19:11 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 19:10 |
<akosiaris@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 19:10 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-eqiad.yaml production stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 19:10 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 19:10 |
<akosiaris@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 19:10 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 17:55 |
<ottomata> |
rolling restart of AQS service using scap deploy for new mediawiki_history_snaphost |
[production] |
| 17:55 |
<otto@deploy1001> |
Started restart [analytics/aqs/deploy@fc1d232]: (no justification provided) |
[production] |
| 16:24 |
<marostegui> |
Power reset db1077 from the idrac T225391 |
[production] |
| 13:18 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
| 13:18 |
<mvolz@deploy1001> |
scap-helm citoid cluster codfw completed |
[production] |
| 13:18 |
<mvolz@deploy1001> |
scap-helm citoid upgrade production -f citoid-codfw-values.yaml stable/citoid [namespace: citoid, clusters: codfw] |
[production] |
| 13:13 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
| 13:13 |
<mvolz@deploy1001> |
scap-helm citoid cluster eqiad completed |
[production] |
| 13:13 |
<mvolz@deploy1001> |
scap-helm citoid upgrade production -f citoid-eqiad-values.yaml stable/citoid [namespace: citoid, clusters: eqiad] |
[production] |
| 13:04 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
| 13:04 |
<mvolz@deploy1001> |
scap-helm citoid cluster staging completed |
[production] |