|
2020-05-15
ยง
|
| 17:48 |
<James_F> |
Zuul: Add BetaFeatures to the gate T249674 |
[releng] |
| 17:27 |
<XioNoX> |
renumber cr2-eqord:xe-0/1/1 to xe-0/1/3 - T221259 |
[production] |
| 17:21 |
<James_F> |
Zuul: Add CI for mediawiki/extensions/PageExchange T252473 |
[releng] |
| 17:09 |
<wm-bot> |
<bd808> Update to 0d8ed77 (D1183) |
[tools.versions] |
| 17:02 |
<ryankemper@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 17:01 |
<ryankemper@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 17:00 |
<ryankemper> |
depooled wqds1007 in preparation for impending wdqs data xfer |
[production] |
| 16:58 |
<ryankemper@cumin1001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 16:53 |
<ryankemper@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 16:52 |
<ryankemper@cumin1001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 16:49 |
<ryankemper@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 16:02 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 16:00 |
<mutante> |
- instance glampipe - replacing role::simplelamp with simplelamp2 - i note that before i touched anything this was already 502 Bad Gateway on http://glampipe.wmflabs.org/ and puppet was broken and the last time anyone besides andrew,root and myself logged in was in 2018 |
[glampipe] |
| 15:57 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:56 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 15:52 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:49 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 15:47 |
<bd808> |
Manually running wmcs-novastats-dnsleaks from cloudcontrol1003 (T252889) |
[admin] |
| 15:45 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:44 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 15:40 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:36 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 15:32 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:31 |
<gehel@cumin2001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 15:27 |
<gehel@cumin2001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 15:23 |
<bstorm_> |
killing the pods to restart the worker |
[tools.refill-api] |
| 14:32 |
<mutante> |
- instance "dannyb" - the above fixed broken puppet run due to missing mysql packages and installed mariadb instead (there was no existing DB in use and apache works just like before, it also showed the default page before my change |
[wildcat] |
| 14:29 |
<mutante> |
- instance "dannyb" - replacing role::simplelamp with role::simplelamp2 |
[wildcat] |
| 14:19 |
<cdanis> |
reverting sysctl net.ipv4.udp_mem to original on netflow3001 |
[production] |
| 14:18 |
<cdanis> |
re-enable puppet on netflow* |
[production] |
| 14:14 |
<cdanis> |
disable puppet on netflow* |
[production] |
| 14:04 |
<pt1979@cumin2001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 14:01 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:47 |
<ema> |
cp2029, cp3050: varnish-fe-restart to clear 'child restarted' alerts |
[production] |
| 13:47 |
<vgutierrez> |
downgrade ats to version 8.0.7-1wm7 on cp4032 |
[production] |
| 13:42 |
<vgutierrez> |
upgrade ats to version 8.0.7-1wm8 on cp4032 |
[production] |
| 13:37 |
<mutante> |
rsyncing gerrit git data from gerrit1001 to gerrit1002 (T200739) |
[production] |
| 13:23 |
<elukey> |
roll restart of the Druid analytics cluster to pick up new openjdk + /srv completed |
[analytics] |
| 13:15 |
<elukey> |
turnilo back to druid1001 |
[analytics] |
| 13:13 |
<cdanis> |
increase samplicator recvbuf on netflow3001 & restart samplicator |
[production] |
| 13:03 |
<elukey> |
move turnilo config to druid1002 to ease druid maintenance |
[analytics] |
| 13:01 |
<cdanis> |
increasing sysctl net.ipv4.udp_mem on netflow3001 |
[production] |
| 12:31 |
<elukey> |
move superset config to druid1002 (was druid1003) to ease maintenance |
[analytics] |
| 09:57 |
<vgutierrez> |
upload trafficserver 8.0.7-1wm7 to apt.wm.o (buster) |
[production] |
| 09:21 |
<ema> |
cp2029: attempt forced discard of stuck VCL T236754 |
[production] |
| 09:09 |
<elukey> |
restart druid brokers on druid100[4-6] - locked up due to datasources dropped - T226035 |
[production] |
| 09:08 |
<elukey> |
restart druid brokers on Analytics Public |
[analytics] |
| 08:51 |
<ema> |
cp2029: try out varnish 5.1.3-1wm15 T236754 |
[production] |
| 07:36 |
<XioNoX> |
bumps prefix limit for AS16735 in eqiad |
[production] |
| 05:35 |
<jynus> |
stop replication on pc2009, pc2010 for benchmarking T252761 |
[production] |