It's been two months since this profile received a new review

Spark SQL Reviews & Product Details

Value at a Glance

Averages based on real user reviews.

Perceived Cost

$$$$$

View More Pricing Information

Top-Rated Alternatives

View All Alternatives

Spark SQL Reviews (45)

G2 reviews are authentic and verified.

Here's how.

Manjunath K.

Machine Learning Intern

Enterprise (> 1000 emp.)

3/28/2024

"When the data is huge, sparksql is the answer"

5/5

What do you like best about Spark SQL?

querying data from both in RDDs and external sources at ease. And able to query historical data with only Spark engine reducing the dependency of different engine. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

limitations in real time processing of the data. Review collected by and hosted on G2.com.

Kumar A.

Data Engineer

Enterprise (> 1000 emp.)

11/18/2023

"Spark SQL revolutionized data processing with seamless SQL for efficient, scalable analytics."

4.5/5

What do you like best about Spark SQL?

I appreciate Spark SQL's robust query optimization and unified data processing capabilities, providing a streamlined and high-performance solution for complex analytics tasks." Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

While Spark SQL impresses with robust query optimization and unified data processing, occasional challenges in resource management and the absence of some conventional SQL functions may require careful consideration in specific analytics scenarios. Review collected by and hosted on G2.com.

What problems is Spark SQL solving and how is that benefiting you?

Spark SQL plays a pivotal role in solving business problems by offering a unified platform for efficient data processing and analytics. Its unique strengths in handling diverse data sources, executing complex queries, and providing high-performance processing contribute significantly to accelerating decision-making, fostering data-driven insights, and ultimately enhancing business performance and agility. Review collected by and hosted on G2.com.

ROSHAN S.

Small-Business (50 or fewer emp.)

1/17/2024

"Excellent"

4.5/5

What do you like best about Spark SQL?

The ability to manipulate the spark data frame using SQL queries. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

The syntax can seem a bit different at the start. Review collected by and hosted on G2.com.

Sneh H.

Software Engineer

Small-Business (50 or fewer emp.)

6/5/2023

"Spark SQL is a module which can run on both dataframes and SQL queries."

5/5

What do you like best about Spark SQL?

It can run on dataframe as well as act as a distributed query engine.

Unlike the normal SQL, it is a module which is used for structured databases.

It allows Hadoop Hive queries to run like 100 times faster on existing deployment of data and therefore allowing big data to be handled efficiently. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

There is no file management system of it's own and so it needs to be connected with one.

There are no automatuc file optimisation techniques and we have to optimise our codes manylually.

There is no support for real time processing and also there are issues with small files while working with hadoop. Review collected by and hosted on G2.com.

What problems is Spark SQL solving and how is that benefiting you?

It quickly performs processing tasks on big data sets and can also distrubute data processing tasks on multiple platforms.

In my last organisation, I was working on a project which needed large datasets such parquet files containg million records and on querring it on Microsoft SQL server it took much time and my seniors were also not able to help me in real time. But Spark SQL solved this problem. Review collected by and hosted on G2.com.

Nitish K.

Big Data Engineer

Computer Software

Small-Business (50 or fewer emp.)

10/3/2023

"Faster SQL processing"

5/5

What do you like best about Spark SQL?

It allows all types of SQL commands like mysql,mssql,posgresql and many with faster processing Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

There isn't anything i disliked about Spark SQL Review collected by and hosted on G2.com.

Atul P.

Data Engineer

Enterprise (> 1000 emp.)

6/5/2023

"4 yrs of experience in Pyspark, Python, SQL, GCP. Worked for Telecom and Entertainment Industry"

5/5

What do you like best about Spark SQL?

Partitioning and The way to use Memory as well as Disk.

Cache is one of the best features of Spark SQL.

And use of temporary table. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

Limitated support for transaction.

Performance impact with small Dataset.lack of native support of all SQL functions like proprietary extension. Review collected by and hosted on G2.com.

What problems is Spark SQL solving and how is that benefiting you?

The use UDF in SQL queries. It helps me to write some python functions and use the same in Spark SQL.

Scalability: Spark SQL scales horizontally, allowing you to process large datasets that do not fit into memory on a single machine. It automatically partitions and distributes data across a cluster, enabling parallel processing. Review collected by and hosted on G2.com.

Verified User in Computer Software

Enterprise (> 1000 emp.)

6/5/2023

"Integrated Spark SQL with other Spark components for real-time processing & machine learning tasks."

4/5

What do you like best about Spark SQL?

What I love about Spark SQL is its seamless integration with the Spark ecosystem, enabling me to leverage distributed computing capabilities and work with structured data using SQL syntax. The optimiser and query planner, Catalyst, ensures efficient execution. At the same time, its wide range of data source support and integration with other Spark components make it a powerful tool for end-to-end data processing. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

What I dislike are :

Debugging complexity: Challenging to debug complex queries and optimize query plans.

Performance tuning: Fine-tuning query performance requires in-depth knowledge and experimentation.

Compatibility limitations: Not fully compatible with all SQL dialects and databases.

Limited support for complex analytics: Some advanced SQL features may be unsupported or require custom implementations.

Despite these challenges, I think Spark SQL is a powerful tool for distributed data processing with efficient and scalable capabilities. Review collected by and hosted on G2.com.

What problems is Spark SQL solving and how is that benefiting you?

Spark SQL is solving several problems and benefiting me in multiple ways.It solves the problem of querying and analyzing large-scale structured and semi-structured data using SQL syntax. It benefits me by eliminating the need to learn new languages, seamlessly integrating with other Spark components, optimizing query performance, and supporting multiple programming languages. This allows for efficient data processing, faster insights, and improved productivity in my work. Review collected by and hosted on G2.com.

Tanmay A.

Data Engineer

Enterprise (> 1000 emp.)

4/23/2023

"Describe spark sql capabilities"

5/5

What do you like best about Spark SQL?

Easy to understand and using spark power via easy sqlskils ,this terminology easy to learn and any one who have the basic sql skills can easily work ,only some of the things from sql is different but most of the things are same Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

In terms of downside spark sql , the thing which I don't like is that if I want to use some custom function either I need to use udf or udaf which is a little hectic think and it need good coding knowledge Review collected by and hosted on G2.com.

Harish K.

Senior Software Engineer

Enterprise (> 1000 emp.)

6/19/2023

"Simplified interface for querying structured data"

4.5/5

What do you like best about Spark SQL?

Allowing users to seamlessly switch between different data processing and works with structured and semi structured data efficiently.

Uses catalyst engine to enable spark sql to deliver fast and efficient query processing across large datasets. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

Error messages during the query execution provided by Spark sql can be challenging to interpret.

Users who are not familiar with databases and sql concepts require some time and effort to grasp. Review collected by and hosted on G2.com.

Verified User in Telecommunications

Small-Business (50 or fewer emp.)

6/15/2023

"Powering Efficient Data Analysis and Querying"

5/5

What do you like best about Spark SQL?

I have been using Spark SQL for quite some time now, and I must say it has completely revolutionized the way I analyze and query large-scale datasets. With its impressive capabilities and seamless integration with Apache Spark, Spark SQL has become an essential tool in my data processing toolkit. Review collected by and hosted on G2.com.

What do you dislike about Spark SQL?

One area where Spark SQL can be challenging is its learning curve. Review collected by and hosted on G2.com.