AWS Data Pipeline Reviews & Product Details

Easy to run a spark job as a step in the pipeline. AWS console has drag and drop UI to build the pipeline schema, and ir works very well. Review collected by and hosted on G2.com.

There are some missing features. I was unable to run a job on demand, than a schedule. Does not support multiple versions of the same pipeline Review collected by and hosted on G2.com.

A pretty straightforward way to run batch jobs, whether that's ETLs, or some sort of other CRON based job. The tool is quite customizable with what can be done (arbitrary shell scripts) and integrates well with S3 and EC2 Review collected by and hosted on G2.com.

There are times when something that should just work is very difficult. For example, the default EC2 instance AMI was very very old and thus, the tools installed on it have to all be upgraded before being used (like the AWS CLI). Everything can be customized, however, including the image, but this takes a little bit of time to get working and can be confusing when just getting started. This particular example has been resolved, but there are other that are similar. Review collected by and hosted on G2.com.

managed service by amazon to move data from one source to another source very fast and in automated way with high availability in reliable way. we can modify or set at what time we need to run this and only charged when we use this, very good and managed service by amazon, very reliable flexible and low cost to use. Review collected by and hosted on G2.com.

sometime pipeline stuck with waiting on dependencies other wise all things are very good in this service provided by aws. Review collected by and hosted on G2.com.

I like the way AWS easily createS complex data processing workloads that are fault tolerant, repeatable, and highly available. You don’t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos. Review collected by and hosted on G2.com.

Data Pipeline is sometimes difficult to utilize.The most difficult part of the AWS Data Pipeline uses are the Error messages which occur very easily. I do not like the fact that there are no time notifications which makes it difficult to fully utilize some of the features. Sometimes, it's impossible to understand exactly what the issues are in this program. and it is difficult to understand what exactly failed since it is an amazon service. Review collected by and hosted on G2.com.

Its a very good and managed service provided by amazon to move the data from one source to another with high availability and reliable process. We can set it on data sources and can be modified at what time of interval we need to run this, it automatically works and send the data.It is very simple, easy to use, flexible, reliable services and having low cost. Review collected by and hosted on G2.com.

it has all advantages but sometime pipeline stuck with waiting on dependency component. Otherwise it is very useful and very good service. Review collected by and hosted on G2.com.

ease of usuage with the UI and the drag and drops Review collected by and hosted on G2.com.

Customized ETL hard to manage and involved a lots of dragging and dropping Review collected by and hosted on G2.com.

Data Pipeline integrates really well with EMR, and it's easy to deploy pipelines via cloudformation making automation possible. We use it to manage complex map-reduce workflows and it usually works pretty smoothly. Review collected by and hosted on G2.com.

The fact that it is in maintenance mode means that bugs and feature requests aren't addressed in a timely manner. Review collected by and hosted on G2.com.

aws data pipeline is very good managed and reliable service which helps us to solve data service from one source to another source and helping to solve data filterring issues, we are using data source problems and very usefull service. Review collected by and hosted on G2.com.

Its main dislike is cost and sometime data stucks in pipeline. Review collected by and hosted on G2.com.

amazon web service data pipeline is an amazing feature of the AWS. it is great aminity to be haven for a data scientist. Review collected by and hosted on G2.com.

I would say there is nothing about the amazon web service data pipeline that I dislike. It is an amazing tool to be used Review collected by and hosted on G2.com.

AWS Data Pipeline has GUI based designing tool which makes it very easy to understand the workflow and configure some of the complex workflow easily Review collected by and hosted on G2.com.

Resource take bit more time to setup from data pipeline that directly. In my case i use Amazon EMR cluster in join with a Lambda function. Lambda runs quickly but EMR takes a lot of time to setup, even after the resources are provisioned and cluster is read to accept jobs the first job arrive to cluster very late. almost 9-10 min late. Review collected by and hosted on G2.com.