G2

Amrita C.

Business Analyst

Information Technology and Services

Mid-Market (51-1000 emp.)

Originally submitted 1/31/2019

"Great for Big Data"

3.5/5

What do you like best about Apache Spark for Azure HDInsight?

Sparks fast computing capability allows for a more interactive experience. One of the other capabilities of Spark on HDInsight I love involves the Jupiter notebooks which allows for the extensive exploration of data using SQL, Python or Scala. This allows for quick querying and the running of machine learning algorithms.The cons for me using this software are that Spark MLIB covers basic machine learning such as regression or clustering however it doesn't have the capabilities for modeling and training data in natural networks. I also find it hard to run large volumes of data at one time. I wish there were a way to process large amounts of data without having to restart from scratch once it crashes. Review collected by and hosted on G2.com.

What do you dislike about Apache Spark for Azure HDInsight?

The cons for me using this software are that Spark MLIB covers basic machine learning such as regression or clustering however it doesn't have the capabilities for modeling and training data in natural networks. I also find it hard to run large volumes of data at one time. I wish there were a way to process large amounts of data without having to restart from scratch once it crashes. Review collected by and hosted on G2.com.

Recommendations to others considering Apache Spark for Azure HDInsight:

Would definitely use this for big data analysis and using basic models for machine learning specifically regression analysis, clustering and filtering. Review collected by and hosted on G2.com.

What problems is Apache Spark for Azure HDInsight solving and how is that benefiting you?

Some use cases involve data modeling and training sets for predicting future customer purchases and other machine learning data modeling. Review collected by and hosted on G2.com.