2020-10-15
ยง
|
16:50 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . |
[production] |
16:50 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . |
[production] |
16:48 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . |
[production] |
16:46 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . |
[production] |
16:40 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . |
[production] |
16:25 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
16:25 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . |
[production] |
16:14 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
16:14 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . |
[production] |
16:14 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'production' . |
[production] |
16:11 |
<elukey@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
16:11 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
16:11 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
15:53 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
15:53 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.13/extensions/CheckUser/includes/specials/: fd94002cf6070180a289296ec65ad224e5a0ae67: Revert "Validate username input before constructing subpage links" (T265606) (duration: 02m 48s) |
[production] |
15:50 |
<elukey@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
15:47 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
15:35 |
<elukey@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
15:29 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
15:19 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
15:09 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.druid.roll-restart-workers (exit_code=0) |
[production] |
15:07 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@500bdad]: spark: correctly parse non-partitioned partition specs (duration: 00m 59s) |
[production] |
15:06 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@500bdad]: spark: correctly parse non-partitioned partition specs |
[production] |
14:51 |
<elukey> |
roll restart druid-historical daemons on druid1004-1008 to pick up new conn pooling changes |
[production] |
14:51 |
<elukey@cumin1001> |
START - Cookbook sre.druid.roll-restart-workers |
[production] |
14:45 |
<jbond42> |
enable puppet post deploy puppetdb change blacklisting dynamic facts |
[production] |
14:41 |
<ema> |
varnish 6.0.6-1wm2 uploaded to apt.wikimedia.org component/varnish6 T264074 |
[production] |
14:38 |
<jbond42> |
disable puppet to deploy puppetdb change blacklisting dynamic facts |
[production] |
14:21 |
<ema> |
cp3050: systemctl reload varnishkafka-webrequest.service T264074 |
[production] |
14:21 |
<jayme> |
imported doxygen_1.8.19-1~deb10+wmf1 to component/ci buster-wikimedia - T265579 |
[production] |
14:12 |
<ema> |
cp3050: restart varnishkafka-webrequest w/ libvarnishapi2 6.0.6-1wm2 T264074 |
[production] |
14:11 |
<ema> |
cp3050: upgrade varnish to 6.0.6-1wm2 T264074 |
[production] |
14:10 |
<ema> |
cp3050: upgrade varnish to 6.0.6-1wm2 T26407 |
[production] |
12:58 |
<gilles@deploy1001> |
Finished deploy [performance/navtiming@dff55f8]: (no justification provided) (duration: 00m 05s) |
[production] |
12:58 |
<gilles@deploy1001> |
Started deploy [performance/navtiming@dff55f8]: (no justification provided) |
[production] |
12:12 |
<jayme@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . |
[production] |
10:47 |
<vgutierrez> |
restart ats-backend on cp3050 |
[production] |
10:00 |
<akosiaris> |
T264209. Initiate a docker pull of docker-registry.discovery.wmnet/mwcachedir:0.0.1 from all kubernetes and kubernetes staging nodes. |
[production] |
08:17 |
<godog> |
swift codfw-prod: bump object weight for ms-be2057 - T261633 |
[production] |
04:27 |
<ryankemper> |
Rolling upgrade for cirrus `codfw` complete |
[production] |
04:10 |
<ryankemper@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) |
[production] |
02:18 |
<ryankemper> |
Rolling upgrade for cirrussearch `codfw` beginning |
[production] |
02:18 |
<ryankemper@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
02:14 |
<ryankemper> |
Rolling upgrade for cirrussearch `eqiad` is complete |
[production] |
02:13 |
<ryankemper@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) |
[production] |
00:36 |
<ryankemper> |
Beginning rolling upgrade for cirrussearch `eqiad`. Cookbook will restart elasticsearch on 36 nodes total, 3 nodes at a time |
[production] |
00:36 |
<eileen> |
tools revision changed from d4e08c52de to a2a91d6c6a |
[production] |
00:35 |
<ryankemper@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
00:24 |
<twentyafterfour> |
phabricator update was uneventful |
[production] |
00:13 |
<twentyafterfour> |
updating phabricator |
[production] |