Apache Flume Reviews & Product Details

Apache Flume Overview

What is Apache Flume?

Apache Flume is a service designed to efficiently collect, aggregate, and move large amounts of log data.

Apache Flume Details
Product Description

Apache Flume is a service designed to efficiently collect, aggregate, and move large amounts of log data.


Seller Details
Seller
The Apache Software Foundation
Company Website
Year Founded
1999
HQ Location
Wakefield, MA
Twitter
@TheASF
59,419 Twitter followers
LinkedIn® Page
www.linkedin.com
1,954 employees on LinkedIn®
Description

Community-led development since 1999. FoundationProjectsPeopleGet InvolvedDownloadSupport ApacheHome. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.

Show More
Answer a few questions to help the Apache Flume community
Have you used Apache Flume before?
Yes

Apache Flume Reviews

Write a Review
Filter reviews
LinkedIn®
Connections
Popular Mentions
Showing 20 Apache Flume reviews
Popular Mentions
Showing 20 reviews
Filter Reviews
Filter Reviews
Sort by
Ratings
Company Size
User Role
All Industries
Region
Already have Apache Flume?
Write a Review
BigData Developer
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It was one of the key component in Big data era, and best fit for both batch and stream processing applications. On a personal note it was good fit for simple transformations on data while streaming from source to sink and truly high reliable component. Review collected by and hosted on G2.com.

What do you dislike?

How ever it has the issues with Scalability Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Metrics Review collected by and hosted on G2.com.

Show More
Show Less
Application Development Team Lead
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

Quick configuration to ingest data which comes handy Review collected by and hosted on G2.com.

What do you dislike?

Not much, but I think it need to evolve more to include new features periodically, which comes in paid softwares Review collected by and hosted on G2.com.

Recommendations to others considering the product:

Analyze whether Flume suits your business case. Tools are objects, which has to be chosen properly only by architect/developer. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Even though it need to be evolved and not competitive to paid softwares, this is free. Review collected by and hosted on G2.com.

Show More
Show Less
CC
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It can collect large volumes of data from many applications and systems and delivers it to the destination system through high availability using interceptors and channels and fault tolerant using load balancing and fail-over. Review collected by and hosted on G2.com.

What do you dislike?

It has complex topology.

Flume does not support for data replication. Review collected by and hosted on G2.com.

Recommendations to others considering the product:

A great mechanism for moving the large volumes of data into any other destination and it is open sourced. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

My Goal was to collect data from different sources and ingest the data to different destinations.

As flume can take data from several sources using Kafka, HTTP -server, NetCat and files etc and can deliver data to several destinations include Kafka, Cassandra, Couch base, MySQL and logger. Review collected by and hosted on G2.com.

Show More
Show Less
Big Data Consultant
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It is scalable, reliable and fault tolerance. Review collected by and hosted on G2.com.

What do you dislike?

Duplicacy. In many cases Apache flume doesnot guarantee unquie message recieved at consumer end. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

We are using Apache flume as a connector to bring near realtime data from Pharmaceutical Machine data directly to HDFS for further processing using, raw, cleanse layer and push the output to ERP team. Review collected by and hosted on G2.com.

Show More
Show Less
Big Data Engineer
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

Scaleability and easy to use. I really like how user friendly it really is. Review collected by and hosted on G2.com.

What do you dislike?

it's not real time, so most of the time you will have to use other ecosystems to reach full potential. Review collected by and hosted on G2.com.

Recommendations to others considering the product:

Keep forward thinking approach Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Different problems that arise in enterprise data warehousing. Review collected by and hosted on G2.com.

Show More
Show Less
UB
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

The option to get the data into pipeline. Although we have used for a small amount of data. For bigger we have kafka thing.

It can be much better if we do a upgrades Review collected by and hosted on G2.com.

What do you dislike?

The scale of data as per the demand.. it can be better if we can do something with the upgrade Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

The stream pipeline instead of running again n again we just implemented it auto insert the data Review collected by and hosted on G2.com.

Show More
Show Less
EN
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

Central Server managing hosts make it easy to monitor Review collected by and hosted on G2.com.

What do you dislike?

Big Footprint.... too many lines of java Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Collecting, aggregating, and moving large amounts of log data. Review collected by and hosted on G2.com.

Show More
Show Less
IC
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It's a great tool to collect all streaming data into your data warehouse. Especially useful if you have large amount of streaming data which is important for analysis and business Review collected by and hosted on G2.com.

What do you dislike?

Not much.. there is a bit of learning curve Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Streaming etl Review collected by and hosted on G2.com.

Show More
Show Less
AC
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

its reliable distributed, supports aggregation of data. can be considered as an alternative to kafka. Review collected by and hosted on G2.com.

What do you dislike?

not scalable like kafka.for adding more consumers needs to change topology. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

moving large data Review collected by and hosted on G2.com.

Show More
Show Less
UA
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

flexibility and integration with other used open source tools Review collected by and hosted on G2.com.

What do you dislike?

not greate integration with azure cloud stack Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

log processing Review collected by and hosted on G2.com.

Show More
Show Less
Software engineer
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

Apache Flume can be configured as a topology of pluggable components which can perform simple transformations on the data in transit. Review collected by and hosted on G2.com.

What do you dislike?

The failover strategies are not as efficient as other streaming applications like Kafka or NiFi and as a result, It is quite easy to lose the data in transit. Review collected by and hosted on G2.com.

Recommendations to others considering the product:

Apache Flume might be a good fit when simple transformations on the data are only that's required while streaming from source to sink. It is also highly scalable but comes with at the price of being less reliable, and it is also easy to lose data if proper fault-tolerant strategies are not in place. If the data being streamed is highly sensitive and needs to be replicated to ensure fault tolerance and persistence, consider other streaming application configurations like Apache Kafka, Splunk, or Apache NiFi. These alternatives offer better control on the persistence of data with replay and resume from a previous section in the stream of data. They also support multiple consumers reading from the same stream of data independent of each other. This is particularly important and useful if your one or many of the nodes in your configuration go down in the middle of streaming activity. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Apache Flume can be used to stream logs generated from an online transaction processing application and sent to other consumer applications for analytical purposes. One of the benefits of using Flume is that it is highly scalable and the components can be plugged in as required. Review collected by and hosted on G2.com.

Show More
Show Less
Software Engineer
Computer Software
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

The best tool for moving large amount of log data. Efficiency and helps to create new sources and destinations. Review collected by and hosted on G2.com.

What do you dislike?

It has some compatibility issues. But it is not a big problem we can do our work with Apache Flume. Review collected by and hosted on G2.com.

Recommendations to others considering the product:

It is best tool for filtering and transforming data. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

It is good for real time projects. Data transforming feature is very important to moving data from one location to another location with local processing. Review collected by and hosted on G2.com.

Show More
Show Less
Principal Software Engineer
Information Technology and Services
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

High reliability and redundancy ability to perform log shipping via web service sockets etc. Ability to provide TLS/SSL support, Kafka client, Hbase 2 support Review collected by and hosted on G2.com.

What do you dislike?

As with many Apache products it is a bear to setup and requires a high level of operational understanding. Review collected by and hosted on G2.com.

Recommendations to others considering the product:

High learning curve. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

I was in an environment that required end-to-end logging. Review collected by and hosted on G2.com.

Show More
Show Less
UC
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It’s quick to execute and run. Good for smaller batches of information. Very precise! Review collected by and hosted on G2.com.

What do you dislike?

It’s not quite as good and streamlined when you have larger data sets. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Positively integrated it in log acquisition solutions (mainly PaaS and Docker) where application log is difficult access. Review collected by and hosted on G2.com.

Show More
Show Less
UC
Enterprise(> 1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It’s reliable and efficient to collect and move data to different systems

Used in conjunction with Hadoop file system

Simple yet robust architecture Review collected by and hosted on G2.com.

What do you dislike?

Still needs to evolve the way I look at it interms of integrating with a robust system like Hadoop Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Handling and managing larger complex data transfers to Hadoop using HDFS which was previously difficult to achieve. Review collected by and hosted on G2.com.

Show More
Show Less
UA
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from the seller
Business partner of the seller or seller's competitor, not included in G2 scores.
What do you like best?

Easy to configure, uses configuration file where we define our source, channel and sink. Can be used for etl Review collected by and hosted on G2.com.

What do you dislike?

Might not work well with Solr and Hbase. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Fast ETL Review collected by and hosted on G2.com.

Show More
Show Less
UA
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from the seller
What do you like best?

I like how intuitive the design is. The UI flow is very natural, and they consistently work to improve the product. Review collected by and hosted on G2.com.

What do you dislike?

I dislike how much red is everywhere. Whenever I go to use a new ticket, all I see is red red red!! Can we some blue or green please? Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

We mostly use it for distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flow. Review collected by and hosted on G2.com.

Show More
Show Less
IT
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It Is beat tool for efficiently collect data and move large amount of log files. Review collected by and hosted on G2.com.

What do you dislike?

It is a little time taking to setup and and freezes if it gets low connectivity. Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

We use it collect data for analytics of our new products coming in market. Review collected by and hosted on G2.com.

Show More
Show Less
IT
Small-Business(50 or fewer emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

It directly fetches data to our storage in encrypted form from HDFS. Review collected by and hosted on G2.com.

What do you dislike?

Installation and setup is not that user friendly Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Download data and use it for marketing Review collected by and hosted on G2.com.

Show More
Show Less
IT
Mid-Market(51-1000 emp.)
Validated Reviewer
Review source: Invitation from G2
What do you like best?

Flume helped me to fetch data from Twitter to HDFS so that I can analyze my data. Review collected by and hosted on G2.com.

What do you dislike?

Needs High-speed internet and not working on AWS Review collected by and hosted on G2.com.

What problems are you solving with the product? What benefits have you realized?

Helps in making marketing strategies. Review collected by and hosted on G2.com.

Show More
Show Less