2751-2800 of 10000 results (34ms)
2020-10-15 §
15:09 <elukey@cumin1001> END (PASS) - Cookbook sre.druid.roll-restart-workers (exit_code=0) [production]
15:07 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@500bdad]: spark: correctly parse non-partitioned partition specs (duration: 00m 59s) [production]
15:06 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@500bdad]: spark: correctly parse non-partitioned partition specs [production]
14:51 <elukey> roll restart druid-historical daemons on druid1004-1008 to pick up new conn pooling changes [production]
14:51 <elukey@cumin1001> START - Cookbook sre.druid.roll-restart-workers [production]
14:45 <jbond42> enable puppet post deploy puppetdb change blacklisting dynamic facts [production]
14:41 <ema> varnish 6.0.6-1wm2 uploaded to apt.wikimedia.org component/varnish6 T264074 [production]
14:38 <jbond42> disable puppet to deploy puppetdb change blacklisting dynamic facts [production]
14:21 <ema> cp3050: systemctl reload varnishkafka-webrequest.service T264074 [production]
14:21 <jayme> imported doxygen_1.8.19-1~deb10+wmf1 to component/ci buster-wikimedia - T265579 [production]
14:12 <ema> cp3050: restart varnishkafka-webrequest w/ libvarnishapi2 6.0.6-1wm2 T264074 [production]
14:11 <ema> cp3050: upgrade varnish to 6.0.6-1wm2 T264074 [production]
14:10 <ema> cp3050: upgrade varnish to 6.0.6-1wm2 T26407 [production]
12:58 <gilles@deploy1001> Finished deploy [performance/navtiming@dff55f8]: (no justification provided) (duration: 00m 05s) [production]
12:58 <gilles@deploy1001> Started deploy [performance/navtiming@dff55f8]: (no justification provided) [production]
12:12 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . [production]
10:47 <vgutierrez> restart ats-backend on cp3050 [production]
10:00 <akosiaris> T264209. Initiate a docker pull of docker-registry.discovery.wmnet/mwcachedir:0.0.1 from all kubernetes and kubernetes staging nodes. [production]
08:17 <godog> swift codfw-prod: bump object weight for ms-be2057 - T261633 [production]
04:27 <ryankemper> Rolling upgrade for cirrus `codfw` complete [production]
04:10 <ryankemper@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) [production]
02:18 <ryankemper> Rolling upgrade for cirrussearch `codfw` beginning [production]
02:18 <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-upgrade [production]
02:14 <ryankemper> Rolling upgrade for cirrussearch `eqiad` is complete [production]
02:13 <ryankemper@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) [production]
00:36 <ryankemper> Beginning rolling upgrade for cirrussearch `eqiad`. Cookbook will restart elasticsearch on 36 nodes total, 3 nodes at a time [production]
00:36 <eileen> tools revision changed from d4e08c52de to a2a91d6c6a [production]
00:35 <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-upgrade [production]
00:24 <twentyafterfour> phabricator update was uneventful [production]
00:13 <twentyafterfour> updating phabricator [production]
2020-10-14 §
23:35 <foks> Removing one further file for legal compliance [production]
23:28 <foks> Removing nine files for legal compliance [production]
23:11 <ebernhardson> Syncronized wmf-config/InitialiseSettings.php to sync reduction of cirrus morelike query cache from 3 back to 1 day [production]
23:08 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 01m 04s) [production]
23:00 <dwisehaupt> all payments hosts in eqiad are now running the REL1_35 code. [production]
22:41 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@9ce273f]: bulk_daemon: revert of streaming gzip decompression (duration: 02m 25s) [production]
22:38 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@9ce273f]: bulk_daemon: revert of streaming gzip decompression [production]
22:13 <dduvall@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.13 (duration: 01m 03s) [production]
22:12 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.13 [production]
22:08 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@04548dd]: spark: centralize reading/writing to hive (duration: 03m 44s) [production]
22:04 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@04548dd]: spark: centralize reading/writing to hive [production]
22:01 <thcipriani@deploy1001> Synchronized php-1.36.0-wmf.13/extensions/NavigationTiming: BACON: [[gerrit:634002|Make attribution source logic more defensive]] T263599 (duration: 01m 05s) [production]
21:51 <dpifke@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enabling image preconnect in group0 (T123582) (duration: 01m 03s) [production]
21:33 <thcipriani@deploy1001> Synchronized php-1.36.0-wmf.13/skins/Vector/resources/skins.vector.styles/Menu.less: BACON: [[gerrit:634086|Stylesheet needs to be compatible with cached HTML]] T265543 (duration: 01m 07s) [production]
20:39 <marxarelli> group1 rolled back to 1.36.0-wmf.11 due to malformed html in nav. task incoming (cc: T263179) [production]
20:37 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: Revert group1 wikis to 1.36.0-wmf.11 [production]
20:32 <marxarelli> rolling back group1 due to malformed html in nav menu [production]
19:46 <marxarelli> 1.36.0-wmf.13 promoted to group1. no new or concerning errors or changes in error rates (T263179) [production]
19:39 <dduvall@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.13 (duration: 01m 03s) [production]
19:38 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.13 [production]