|
2020-02-17
§
|
| 19:56 |
<cdanis> |
finish enabling TCP-MSS clamping in eqiad |
[production] |
| 19:49 |
<cdanis> |
s/no-op// |
[production] |
| 19:49 |
<cdanis> |
no-op enable TCP-MSS clamping on eqord and eqiad |
[production] |
| 19:33 |
<cdanis> |
no-op enable flowspec change on cr2-eqord and cr2-eqiad |
[production] |
| 18:53 |
<arturo> |
T168677 created DNS TXT record _psl.toolforge.org. with value `https://github.com/publicsuffix/list/pull/970` |
[tools] |
| 18:29 |
<elukey> |
reboot turnilo and superset's hosts for kernel upgrades |
[analytics] |
| 18:25 |
<elukey> |
restart kafka on kafka-jumbo1001 to pick up new openjdk updates |
[analytics] |
| 18:25 |
<elukey> |
restart kafka on kafka-jumbo1001 to pick up new openjdk updates |
[production] |
| 18:22 |
<elukey> |
restart cassandra on aqs1004 to pick up new openjdk updates |
[analytics] |
| 17:59 |
<elukey> |
restart druid daemons on druid1003 to pick up new openjdk updates |
[analytics] |
| 17:58 |
<elukey> |
restart cassandra on aqs1004 to pick up new openjdk updates |
[analytics] |
| 17:56 |
<elukey> |
restart hadoop daemons on analytics1042 to pick up new openjdk updates |
[analytics] |
| 17:25 |
<bblack> |
GRE MTU mitigations applied to esams cp hosts only - T232602 |
[production] |
| 15:55 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 15:50 |
<ayounsi@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 15:48 |
<ayounsi@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 15:48 |
<ayounsi@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 15:44 |
<cdanis> |
✔️ cdanis@icinga1001.wikimedia.org ~ 🕥☕ sudo systemctl restart ircecho |
[production] |
| 14:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1107 after 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10422 and previous config saved to /var/cache/conftool/dbconfig/20200217-143146-marostegui.json |
[production] |
| 14:17 |
<ema> |
reprepro includedeb buster-wikimedia ~ema/cadvisor_0.35.0+ds1-4_amd64.deb T183146 |
[production] |
| 13:22 |
<arturo> |
relocating tools-sgewebgrid-lighttpd-0914 to cloudvirt1012 to spread same VMs across different hypervisors |
[tools] |
| 12:34 |
<hauskatze> |
extension-Teahouse@phab: Mirror deactivated # T176349 |
[releng] |
| 12:34 |
<hauskatze> |
extension-Teahouse@github: Mirror deleted # T176349 |
[releng] |
| 12:34 |
<XioNoX> |
add test flowspec rules to cr3-knams |
[production] |
| 12:34 |
<moritzm> |
installing postgresql-9.4 security updates |
[production] |
| 12:27 |
<vgutierrez> |
reboot acmechief instances (kernel upgrade) |
[production] |
| 10:31 |
<jynus> |
dropping all databases from db1140:3313 |
[production] |
| 10:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): ' db1107 increase API weight from 10 to 15 for 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10420 and previous config saved to /var/cache/conftool/dbconfig/20200217-102218-marostegui.json |
[production] |
| 10:20 |
<vgutierrez> |
rolling restart of ats-tls and varnish-fe on ulsfo to enable KA between them - T244464 |
[production] |
| 10:08 |
<arturo> |
restart webservice, because I see in the logs `uWSGI listen queue of socket ":8000" (fd: 7) full !!! (101/100)` |
[tools.copyvios] |
| 10:00 |
<moritzm> |
installing Linux 4.9.210 kernels on stretch systems |
[production] |
| 09:10 |
<godog> |
correction, +100G |
[production] |
| 09:09 |
<godog> |
+10G to prometheus/ops fs on prometheus eqiad - T245361 |
[production] |
| 09:06 |
<godog> |
+50G to prometheus/ops fs on prometheus eqiad - T245361 |
[production] |
| 07:22 |
<marostegui> |
Stop haproxy on dbproxy1002 - T245384 |
[production] |