2021-08-14

Fun project using batch and stream processing

Sharing fun project using several scenarios would be useful for whom interested in Apache Spark usages in real projects. Actually it depends on the projects main aim, in some cases it is used for various processes such as ETL/ELT , anomaly detection, ML, graph analysis, stream processing etc.

Batch and stream processing

 

In our project I have used Spark for both stream and batch processing in Scala within 5 separate cases.