IT

Verified User in Telecommunications

Mid-Market (51-1000 emp.)

7/17/2018

"Best option to transfer data between storage devices"

4/5

What do you like best about AWS Data Pipeline?

User friendly, reliable as it retries in case of any failure. Review collected by and hosted on G2.com.

What do you dislike about AWS Data Pipeline?

Space consuming, difficult to setup and lags on slow in internet. Review collected by and hosted on G2.com.

UC

Verified User in Computer Software

Small-Business (50 or fewer emp.)

7/28/2018

"A good DB alternative"

3.5/5

What do you like best about AWS Data Pipeline?

Simplicity compared to software like SQL Review collected by and hosted on G2.com.

What do you dislike about AWS Data Pipeline?

Integration with something other than AWS could be stronger. Review collected by and hosted on G2.com.

UI

Verified User in Internet

Mid-Market (51-1000 emp.)

11/19/2017

"Json blob is a horrible way to organize jobs"

0.5/5

What do you like best about AWS Data Pipeline?

The only thing I can appreciate is once it is setup then it is fine. Review collected by and hosted on G2.com.

What do you dislike about AWS Data Pipeline?

It really should be redesigned as a json blob is a terrible way to organize SQL jobs. Why can't things be scheduled like a calendar or meeting request? Review collected by and hosted on G2.com.

SA

Sheehan A.

Software Engineering Manager, Pro Team Services

Sports

Mid-Market (51-1000 emp.)

10/23/2016

"Powerful, but needs better GUI Tools"

3/5

What do you like best about AWS Data Pipeline?

AWS Data Pipeline makes it very easy to get started and move data between various sources. If you're already using AWS services such as S3 or Redshift, Data Pipeline heavily reduces the lines of code / applications required to move data between AWS data sources.

You can simply run data pipeline on a schedule, specify where you want to move data between, and tell it to run processing in a series of steps if you need to filter your data. It is a good and simple way to do basic data movement.

Pipeline retries, gives you errors, and has a dashboard that shows you all of the jobs that are in queue. Review collected by and hosted on G2.com.

What do you dislike about AWS Data Pipeline?

Data Pipeline can be a black box at times. Error messages are not good, and it is difficult to understand what exactly failed since it is an amazon service. The scheduler doesn't give timely notifications at times, so it is hard to determine the true state of the data pipeline Review collected by and hosted on G2.com.

Recommendations to others considering AWS Data Pipeline:

If you are a small company and don't want to spend resources building your own pipeline, use AWS. It is out of the box, gets the job done, and you can learn to work around some of its deficiencies. It provides a great way to schedule the movement of data. Review collected by and hosted on G2.com.

What problems is AWS Data Pipeline solving and how is that benefiting you?

We have various ETL jobs that run on data pipeline. We move data between various sources into a data warehouse for final reporting. Data pipeline is used to move all data into a single data lake, and then run pre-processing steps before loading into a warehouse. Review collected by and hosted on G2.com.