Course Details

About Apache Flume

Apache Flume is a distributed and reliable system for efficiently collecting, aggregating, and moving large amounts of log or event data from many sources to a centralized data store like MapR Data Platform.

Flume agents ingest incoming streaming data from one or more sources, including avro, thrift, exec, JMS, netcat, and syslog. Data ingested by a Flume agent is passed to a sink, which is most commonly a distributed file system like Hadoop. Multiple Flume agents can be connected together for more complex workflows by configuring the source of one agent to be the sink of another.

Apache Flume Training Curriculum

Introduction 

Overview, , Architecture, , Data flow mode, , Reliability and Recoverability

Setting up an agent

Configuring individual components, Wiring the pieces together, Data ingestion

Executing commands

Network streams

Setting multi-agent flow

Consolidation, Multiplexing the flow, Configuration, Defining the flow, Configuring individual components, Adding multiple flows in an agent

Configuring a multi agent flow 

Fan out flow, Flume Sources, Avro Source, Exec Source, NetCat Source, Sequence Generator Source, Syslog Sources, Syslog TCP Source, Syslog UDP Source, Legacy Sources, Avro Legacy Source, Thrift Legacy Source, Custom Source

Flume Sinks

HDFS Sink, Logger Sink, Avro Sink, IRC Sink, File Roll Sink, Null Sink, HbaseSinks, HbaseSink, AsyncHBaseSink, Custom Sink

Flume Channels

Memory Channel , JDBC Channel , Recoverable Memory Channel , File Channel , Pseudo Transaction Channel , Custom Channel , Flume Channel Selectors , Replicating Channel Selector , Multiplexing Channel Selector , Custom Channel Selector

Flume Sink Processors

Default Sink Processor , Failover Sink Processor, Load balancing Sink Processor , Custom Sink Processor

Flume Interceptors

Timestamp Interceptor ,  Host Interceptor , Flume Properties , Property

Security

Monitoring , Troubleshooting, Handling agent failures, Compatibility, HDFS, AVRO

Salary Trends

Average Apache Flume Salary in USA is increasing and is much better than other products.

Ref: Indeed.com