Apache Spark for Azure HDInsight Features

Collects, stores, and organizes massive, unstructured data in real time

Facilitates the disseminating of collected big data throughout parallel computing clusters

Creates a repository to collect and store raw data from sensors, devices, machines, files, etc.

Aligns processing and distribution workflows on top of Apache Hadoop

Aligns processing and distribution workflows on top of Apache Hadoop

Moves big data collection and processing to the cloud

Processes batch, real-time, and streaming data workloads in singular, multi-tenant, or cloud systems

Facilitates solution to run on and scale to a large number of machines and systems

Curates collected data for big data analytics solutions to analyze, manipulate, and model

Aligns processing and distribution workflows on top of Apache Hadoop