Low latency: SPARK STREAMING
“Delivering low latency, high throughput, and stability
simultaneously:* Right now, our own tests indicate you
can get at most two of these characteristics out of Spark
Streaming at the same time.”
From https://goo.gl/wGCrtE!
“How to choose right DStream batch interval”
From https://goo.gl/6UX0FW!
“Getting the best performance out of a Spark Streaming application on
a cluster requires a bit of tuning…Reducing the processing time of each
batch of data by efficiently using cluster resources. Setting the right batch
size such that the batches of data can be processed as fast as they are
received….” From spark.apache.org/docs/latest/streaming-programming-guide!
