2015-08-11
§
|
18:21 |
<bd808> |
logstash log event volume back to normal levels following elasticsearch upgrade |
[production] |
18:06 |
<bd808> |
logstash cluster recovered after upgrade of elasticsearch on logstash1006 |
[production] |
18:03 |
<bd808> |
upgraded elasticsearch to 1.7.1 on logstash1006; logstash-2015.08.11 shard recovering |
[production] |
18:01 |
<bd808> |
logstash cluster recovered after upgrade of elasticsearch on logstash1005 |
[production] |
17:43 |
<bd808> |
log event volume in logstash dropped dramatically again; seems to correlate with final recovery of logstash-2015.08.11 shard |
[production] |
17:29 |
<bd808> |
upgraded elasticsearch to 1.7.1 on logstash1005; logstash-2015.08.11 shard recovering |
[production] |
17:27 |
<bd808> |
logstash event volume recovered after restarting all 3 logstash services |
[production] |
17:14 |
<bd808> |
log event volume in logstash dropped dramatically at 16:49; investigating |
[production] |
17:13 |
<bd808> |
logstash cluster recovered after upgrade of elasticsearch on logstash1004 |
[production] |
16:42 |
<bd808> |
upgraded elasticsearch to 1.7.1 on logstash1004; logstash-2015.08.11 shard recovering |
[production] |
16:23 |
<bd808> |
logstash upgrade on logstash1003 complete |
[production] |
16:20 |
<bd808> |
logstash upgrade on logstash1002 complete |
[production] |
16:16 |
<bd808> |
logstash upgrade on logstash1001 complete |
[production] |
15:49 |
<bd808> |
upgrading logstash on logstash1001 |
[production] |
15:47 |
<bd808> |
Trebuchet deploy of logstash/plugins: Add logstash-filter-prune 0.1.5 (36144b2) |
[production] |
15:31 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (actually rebased this time) (duration: 00m 11s) |
[production] |
15:30 |
<bd808@tin> |
Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (actually rebased this time) (duration: 00m 11s) |
[production] |
15:12 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (duration: 00m 12s) |
[production] |
15:11 |
<bd808@tin> |
Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (duration: 00m 12s) |
[production] |