|
2019-03-15
ยง
|
| 13:50 |
<moritzm> |
rolling reboot of ores in codfw for SSBD/L1TF kernel update |
[production] |
| 13:47 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 13:47 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster staging completed |
[production] |
| 13:47 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] |
[production] |
| 11:16 |
<godog> |
reenable prometheus@k8s on prometheus2004 with mod_proxy connection limits - T217715 |
[production] |
| 10:31 |
<akosiaris> |
add a 10s bucket to cxserver prometheus-statsd exporter mappings |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster eqiad completed |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster codfw completed |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster staging completed |
[production] |
| 10:31 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] |
[production] |
| 10:30 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/citoid [namespace: cxserver, clusters: staging] |
[production] |
| 10:03 |
<akosiaris@deploy1001> |
scap-helm citoid finished |
[production] |
| 10:03 |
<akosiaris@deploy1001> |
scap-helm citoid cluster codfw completed |
[production] |
| 10:03 |
<akosiaris@deploy1001> |
scap-helm citoid upgrade -f citoid-codfw-values.yaml production stable/citoid [namespace: citoid, clusters: codfw] |
[production] |
| 10:03 |
<akosiaris@deploy1001> |
scap-helm citoid finished |
[production] |
| 10:02 |
<akosiaris@deploy1001> |
scap-helm citoid cluster eqiad completed |
[production] |
| 10:02 |
<akosiaris@deploy1001> |
scap-helm citoid upgrade -f citoid-eqiad-values.yaml production stable/citoid [namespace: citoid, clusters: eqiad] |
[production] |
| 10:02 |
<akosiaris> |
add a 10s bucket to citoid prometheus-statsd exporter mappings |
[production] |
| 10:02 |
<akosiaris> |
remove prometheus-statsd-exporter from zotero pods |
[production] |
| 10:02 |
<akosiaris@deploy1001> |
scap-helm citoid finished |
[production] |
| 10:02 |
<akosiaris@deploy1001> |
scap-helm citoid cluster staging completed |
[production] |
| 10:02 |
<akosiaris@deploy1001> |
scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] |
[production] |
| 10:01 |
<akosiaris@deploy1001> |
scap-helm citoid upgrade -f citoid-values-staging.yaml staging stable/citoid [namespace: citoid, clusters: staging] |
[production] |
| 10:00 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 10:00 |
<akosiaris@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 10:00 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade --install -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 09:58 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 09:53 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 09:53 |
<akosiaris@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 09:53 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-eqiad.yaml production stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 09:53 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 09:53 |
<akosiaris@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 09:52 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 09:42 |
<godog> |
bounce grafana-server on grafana1001 |
[production] |
| 09:32 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1103 (duration: 00m 50s) |
[production] |
| 09:28 |
<godog> |
correction, prometheus2004 |
[production] |
| 09:27 |
<godog> |
temporarily disable read queries to prometheus@k8s on prometheus2003 |
[production] |
| 09:19 |
<jiji@cumin1001> |
conftool action : set/weight=12; selector: dc=eqiad,service=cxserver,cluster=scb,name=kubernetes.* |
[production] |
| 09:18 |
<jiji@cumin1001> |
conftool action : set/weight=15; selector: dc=codfw,service=cxserver,cluster=scb,name=kubernetes.* |
[production] |
| 09:17 |
<jijiki> |
Ramp up cxserver k8s traffic to 50% - T213195 |
[production] |
| 08:57 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1103 (duration: 00m 50s) |
[production] |
| 08:52 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1084 (duration: 00m 47s) |
[production] |
| 08:22 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 49s) |
[production] |
| 07:28 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1091 (duration: 00m 49s) |
[production] |
| 07:17 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) |
[production] |