|
2020-12-08
ยง
|
| 14:06 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:06 |
<akosiaris> |
switch over all apertium traffic to kubernetes |
[production] |
| 14:05 |
<akosiaris@cumin1001> |
conftool action : set/pooled=no; selector: service=apertium,name=scb.* |
[production] |
| 13:56 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: service=apertium,name=kubernetes.* |
[production] |
| 13:54 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: service=apertium,name=kubernetes1001.* |
[production] |
| 13:53 |
<akosiaris> |
pooling of apertium kubernetes service, take #3 |
[production] |
| 13:51 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 13:51 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 13:50 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 13:50 |
<akosiaris@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 13:50 |
<akosiaris@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 13:50 |
<akosiaris@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 13:48 |
<akosiaris@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 13:48 |
<akosiaris@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 13:48 |
<akosiaris@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 13:44 |
<godog> |
bounce logstash on logstash1023 |
[production] |
| 13:44 |
<godog> |
bounce logstash on logstash102 |
[production] |
| 13:42 |
<effie> |
disable puppet on mc1034/mc2034 and reimage to buster - T213089 |
[production] |
| 13:28 |
<hnowlan@cumin1001> |
END (FAIL) - Cookbook sre.cassandra.roll-restart (exit_code=99) |
[production] |
| 13:28 |
<hnowlan@cumin1001> |
START - Cookbook sre.cassandra.roll-restart |
[production] |
| 13:19 |
<moritzm> |
installing xen security updates (client side libs only) |
[production] |
| 12:57 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 12:45 |
<akosiaris@cumin1001> |
conftool action : set/pooled=inactive; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:43 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: service=apertium,name=kubernetes1001* |
[production] |
| 12:35 |
<dcausse> |
EU B&C done |
[production] |
| 12:34 |
<dcaro@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:32 |
<dcaro@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:30 |
<jmm@cumin2001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) |
[production] |
| 12:28 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:28 |
<dcausse@deploy1001> |
Synchronized php-1.36.0-wmf.20/extensions/WikimediaEvents/: T266027: [cirrus] setup perfield builder A/B test on spaceless languages (duration: 01m 00s) |
[production] |
| 12:27 |
<akosiaris@cumin1001> |
conftool action : set/pooled=no; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:23 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:23 |
<akosiaris> |
pooling of apertium kubernetes service, take #2 |
[production] |
| 12:08 |
<akosiaris> |
rollback pooling of apertium kubernetes service. |
[production] |
| 12:08 |
<akosiaris@cumin1001> |
conftool action : set/pooled=no; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:03 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:01 |
<akosiaris@cumin1001> |
conftool action : set/weight=1; selector: service=apertium,name=kubernetes.* |
[production] |
| 12:01 |
<moritzm> |
installing jasper security updates |
[production] |
| 11:51 |
<moritzm> |
uploaded jasper 1.900.1-debian1-2.4+deb8u6+wmf1 to apt.wikimedia.org / jessie-wikimedia |
[production] |
| 11:45 |
<akosiaris@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 11:44 |
<akosiaris@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 11:43 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 11:43 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 11:42 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 11:42 |
<akosiaris> |
add a TLS enabled release for apertium |
[production] |
| 11:42 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'production' . |
[production] |
| 11:41 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 11:41 |
<akosiaris@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'plain' . |
[production] |
| 10:45 |
<ema> |
A:cp remove libvmod-tbf -- see https://gerrit.wikimedia.org/r/c/operations/puppet/+/623583/ |
[production] |
| 10:33 |
<ema> |
cp4032: restart ats-{tls,be} |
[production] |