301-350 of 783 results (6ms)
2019-06-04 §
18:10 <herron> correction — performing rolling reboots of codfw logstash hardware hosts for MDS security updates [production]
18:10 <herron> performing rolling reboots of eqiad logstash hardware hosts for MDS security updates [production]
2019-06-03 §
07:58 <elukey> refresh field list for logstash (via kibana Management -> Index patterns -> etc..) [production]
2019-05-14 §
20:44 <herron@deploy1001> Finished deploy [logstash/plugins@7fb8843]: adding logstash-filter-truncate plugin (duration: 00m 07s) [production]
20:43 <herron@deploy1001> Started deploy [logstash/plugins@7fb8843]: adding logstash-filter-truncate plugin [production]
20:41 <herron@deploy1001> Finished deploy [logstash/plugins@7fb8843]: (no justification provided) (duration: 00m 01s) [production]
20:41 <herron@deploy1001> Started deploy [logstash/plugins@7fb8843]: (no justification provided) [production]
19:37 <herron> adding logstash filter truncate plugin to prod logstash collectors [production]
09:02 <godog> statsd_exporter 0.9 upgrade on logstash - T220709 [production]
2019-04-15 §
18:35 <shdubsh> logstash1009: disabling puppet and testing logstash config [production]
17:17 <herron> restarted logstash on logstash1007 [production]
2019-04-08 §
15:35 <herron> aborting ores to logstash kafka logging pipeline switchover for now. puppet applied only to ores2009, reverting now [production]
15:19 <herron> switching ores to logstash kafka logging pipeline (via temporary puppet disable and rolling puppet agent runs) [production]
2019-04-01 §
11:53 <moritzm> uploaded logstash/kibana/elasticsearch 5.6.15 to component thirdparty/elastic56 [production]
11:52 <moritzm> uploaded logstash/kibana/elasticsearch to component thirdparty/elastic56 [production]
2019-03-27 §
14:05 <godog> roll-restart logstash to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/498417 [production]
11:04 <mutante> re-enabled puppet on logstash1007 through 1011 - then on logstash* [production]
10:49 <mutante> disabling puppet on logstash* via cumin [production]
2019-03-22 §
14:33 <gehel> upgrading to elasticsearch-curator 5.6.0 on all elasticsearch nodes (including logstash) - T218991 [production]
2019-03-13 §
20:03 <herron> increased index.mapping.total_fields.limit to 1350 on index logstash-2019.03.13 [production]
19:26 <herron> performing rolling restart of eqiad logstash instances [production]
2019-03-07 §
17:55 <gehel> rolling upgrade of kibana on logstash clusters completed - T216052 [production]
17:48 <gehel> rolling upgrade of kibana on logstash clusters - T216052 [production]
17:43 <gehel> rolling upgrade of logstash on logstash clusters completed - T216052 [production]
17:36 <gehel> rolling upgrade of logstash on logstash clusters - T216052 [production]
17:34 <gehel@deploy1001> Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 07s) [production]
17:34 <gehel@deploy1001> Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 [production]
17:34 <gehel@deploy1001> Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 08s) [production]
17:33 <gehel@deploy1001> Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 [production]
17:16 <gehel> rolling upgrade of elasticsearch on logstash clusters completed - T216052 [production]
15:26 <gehel> rolling upgrade of elasticsearch on logstash clusters - T216052 [production]
2019-03-05 §
16:54 <moritzm> imported logstash 1:5.6.14-1 to thirdparty/elastic56 [production]
2019-02-28 §
21:09 <herron> disabling logstash persisted queue [production]
20:52 <herron> cleared logstash persistent queue on logstash100[7-9] [production]
2019-02-27 §
11:17 <godog> roll-restart pybal after removing logstash log4j service [production]
2019-02-21 §
15:07 <herron> migrating ES shards away from logstash100[456] with "cluster.routing.allocation.exclude._name" : "logstash1004-production-logstash-eqiad,logstash1005-production-logstash-eqiad,logstash1006-production-logstash-eqiad” T214608 [production]
2019-02-20 §
16:49 <herron> migrating es shards away from logstash100[56] with "cluster.routing.allocation.exclude._name" : "logstash1005-production-logstash-eqiad,logstash1006-production-logstash-eqiad” T214608 [production]
2019-02-19 §
17:55 <herron> temporarily increased eqiad logstash elasticsearch low disk watermark to 87% (will restore to 85% when eqiad expansion hosts are fully online) [production]
2019-02-06 §
00:24 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Demystify Logstash debug level behavior (duration: 00m 51s) [production]
00:23 <niharika29@deploy1001> Synchronized wmf-config/logging.php: Demystify Logstash debug level behavior (duration: 00m 46s) [production]
2019-02-05 §
15:15 <godog> force curator action 'replicas' to set older logstash indices to 1 replica - T213078 [production]
2019-01-22 §
13:55 <godog> bump logstash kafka consumer threads - T214309 [production]
2019-01-15 §
17:26 <godog> roll-restart logstash in eqiad - T213081 [production]
17:21 <godog> depool logstash1007 before restarting logstash - T213081 [production]
2018-12-26 §
16:37 <godog> clear logstash persistent queue /var/lib/logstash on logstash100[789] [production]
15:47 <godog> roll-restart logstash on logstash100[789] [production]
2018-12-17 §
18:34 <herron@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=logstash,service=kibana,name=logstash2006.codfw.wmnet [production]
18:34 <herron@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=logstash,service=kibana,name=logstash2005.codfw.wmnet [production]
18:04 <herron@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=logstash,service=kibana,name=logstash2004.codfw.wmnet [production]
2018-12-14 §
08:47 <elukey> disabled kafkatee-webrequest logstash output on oxygen (prep step before weblog1001) [production]