flume.git
7 years agoFLUME-2595. Add option to checkpoint on file channel shutdown
Hari Shreedharan [Mon, 13 Apr 2015 22:57:30 +0000 (15:57 -0700)] 
FLUME-2595. Add option to checkpoint on file channel shutdown

(Roshan Naik via Hari)

7 years agoFLUME-2645. ipFilter.rules property name is wrong
Hari Shreedharan [Fri, 10 Apr 2015 19:35:11 +0000 (12:35 -0700)] 
FLUME-2645. ipFilter.rules property name is wrong

(Johny Rufus via Hari)

7 years agoFLUME-2635. Documentation for zookeeper dynamic configuration in flume
Hari Shreedharan [Fri, 10 Apr 2015 19:24:57 +0000 (12:24 -0700)] 
FLUME-2635. Documentation for zookeeper dynamic configuration in flume

(Ashish Paliwal via Hari)

7 years agoFLUME-2664. Site profile fails due to dependency issues
Hari Shreedharan [Fri, 10 Apr 2015 19:04:43 +0000 (12:04 -0700)] 
FLUME-2664. Site profile fails due to dependency issues

(Johny Rufus via Hari)

7 years agoFLUME-2649. Elasticsearch sink doesn't handle JSON fields correctly
Hari Shreedharan [Fri, 10 Apr 2015 18:48:20 +0000 (11:48 -0700)] 
FLUME-2649. Elasticsearch sink doesn't handle JSON fields correctly

(Benjamin Fiorini via Hari)

7 years agoFLUME-2613. Add support in FileChannelIntegrityTool to remove invalid events from...
Hari Shreedharan [Tue, 7 Apr 2015 21:46:10 +0000 (14:46 -0700)] 
FLUME-2613. Add support in FileChannelIntegrityTool to remove invalid events from the channel.

(Ashish Paliwal via Hari)

7 years agoFLUME-2654. Clarify error message in MemoryChannel when byte capacity is reached.
Hari Shreedharan [Tue, 7 Apr 2015 20:18:32 +0000 (13:18 -0700)] 
FLUME-2654. Clarify error message in MemoryChannel when byte capacity is reached.

(Johny Rufus via Hari)

7 years agoFLUME-1934. Spooling Directory Source dies on encountering zero-byte files.
Hari Shreedharan [Tue, 7 Apr 2015 01:14:04 +0000 (18:14 -0700)] 
FLUME-1934. Spooling Directory Source dies on encountering zero-byte files.

(Grant Henke via Hari)

7 years agoFLUME-2657: Upgrade to Hive 1.0
Roshan Naik [Tue, 7 Apr 2015 00:23:15 +0000 (17:23 -0700)] 
FLUME-2657: Upgrade to Hive 1.0

(Hari Shreedharan via Roshan Naik)

7 years agoFLUME-2624 : Improve Hive Sink performance
Roshan Naik [Wed, 1 Apr 2015 20:26:40 +0000 (13:26 -0700)] 
FLUME-2624 : Improve Hive Sink performance

(Deepesh Khandelwal via Roshan Naik)

7 years agoFLUME-2630: Update documentation for Thrift SRc/Sink SSL support
Jarek Jarcec Cecho [Sat, 14 Mar 2015 20:31:03 +0000 (13:31 -0700)] 
FLUME-2630: Update documentation for Thrift SRc/Sink SSL support

(Johny Rufus via Jarek Jarcec Cecho)

7 years agoFLUME-2626. Remove trustmanager-type from Thrift RPC client and Thrift Source.
Hari Shreedharan [Fri, 13 Mar 2015 01:02:47 +0000 (18:02 -0700)] 
FLUME-2626. Remove trustmanager-type from Thrift RPC client and Thrift Source.

(Johny Rufus via Hari)

7 years agoFLUME-2642. Limit the number of calls to UGI.checkTGTAndRelogin method.
Hari Shreedharan [Wed, 11 Mar 2015 04:53:31 +0000 (21:53 -0700)] 
FLUME-2642. Limit the number of calls to UGI.checkTGTAndRelogin method.

(Johny Rufus via Hari)

7 years agoFLUME-2639. SecureThriftRpcClient client privileged calls throw IllegalAccessError
Hari Shreedharan [Tue, 10 Mar 2015 20:17:15 +0000 (13:17 -0700)] 
FLUME-2639. SecureThriftRpcClient client privileged calls throw IllegalAccessError

(Johny Rufus via Hari)

7 years agoFLUME-2631. End to End authentication in Flume
Hari Shreedharan [Fri, 6 Mar 2015 07:19:13 +0000 (23:19 -0800)] 
FLUME-2631. End to End authentication in Flume

(Johny Rufus via Hari)

7 years agoFLUME-2570. Add option to not pad date fields.
Hari Shreedharan [Thu, 26 Feb 2015 05:54:34 +0000 (21:54 -0800)] 
FLUME-2570. Add option to not pad date fields.

(Peter Leckie via Hari)

7 years agoFLUME-2633: Update Kite dependency to 1.0.0
Jarek Jarcec Cecho [Wed, 25 Feb 2015 17:51:59 +0000 (09:51 -0800)] 
FLUME-2633: Update Kite dependency to 1.0.0

(Tom White via Jarek Jarcec Cecho)

7 years agoFLUME-2214. File Channel Integrity Toll documentation.
Hari Shreedharan [Thu, 19 Feb 2015 22:20:28 +0000 (14:20 -0800)] 
FLUME-2214. File Channel Integrity Toll documentation.

(Ashish Paliwal via Hari)

7 years agoFLUME-2574. SSL support for Thrift RPC.
Hari Shreedharan [Thu, 19 Feb 2015 05:10:56 +0000 (21:10 -0800)] 
FLUME-2574. SSL support for Thrift RPC.

(Johny Rufus via Hari)

7 years agoFLUME-2592. Fix help message in File Channel Integrity Tool.
Hari Shreedharan [Thu, 12 Feb 2015 02:03:52 +0000 (18:03 -0800)] 
FLUME-2592. Fix help message in File Channel Integrity Tool.

(Ashish Paliwal via Hari)

7 years agoFLUME-1734. Add a Hive Sink based on Hive Streaming support.
Hari Shreedharan [Tue, 10 Feb 2015 07:15:02 +0000 (23:15 -0800)] 
FLUME-1734. Add a Hive Sink based on Hive Streaming support.

(Roshan Naik via Hari Shreedharan)

7 years agoFLUME-2443: org.apache.hadoop.fs.FSDataOutputStream.sync() is deprecated in hadoop 2.4
Jarek Jarcec Cecho [Tue, 3 Feb 2015 21:32:28 +0000 (13:32 -0800)] 
FLUME-2443: org.apache.hadoop.fs.FSDataOutputStream.sync() is deprecated in hadoop 2.4

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-1334. Windows startup scripts.
Hari Shreedharan [Sat, 31 Jan 2015 00:55:47 +0000 (16:55 -0800)] 
FLUME-1334. Windows startup scripts.

(Roshan Naik via Hari)

7 years agoFLUME-2591. DatasetSink 2.0
Hari Shreedharan [Thu, 29 Jan 2015 01:41:51 +0000 (17:41 -0800)] 
FLUME-2591. DatasetSink 2.0

(Joey Echeverria via Hari)

7 years agoFLUME-2586. HDFS Sink must try to rename files even if close fails.
Hari Shreedharan [Wed, 28 Jan 2015 21:02:50 +0000 (13:02 -0800)] 
FLUME-2586. HDFS Sink must try to rename files even if close fails.

(Johny Rufus via Hari)

7 years agoFLUME-2594: Close Async HBase Client if there are large number of consecutive timeouts
Jarek Jarcec Cecho [Wed, 21 Jan 2015 21:49:41 +0000 (13:49 -0800)] 
FLUME-2594: Close Async HBase Client if there are large number of consecutive timeouts

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2568. Additional fix for TestReliableSpoolingFileEventReader
Hari Shreedharan [Sat, 17 Jan 2015 00:56:48 +0000 (16:56 -0800)] 
FLUME-2568. Additional fix for TestReliableSpoolingFileEventReader

(Johny Rufus via Hari)

7 years agoFLUME-2562. Add metrics for Kafka Source, Kafka Sink and Kafka Channel.
Hari Shreedharan [Sat, 17 Jan 2015 00:24:24 +0000 (16:24 -0800)] 
FLUME-2562. Add metrics for Kafka Source, Kafka Sink and Kafka Channel.

(Gwen Shapira via Hari)

7 years agoFLUME-2578. Kafka source throws NPE if Kafka record has null key
Hari Shreedharan [Tue, 30 Dec 2014 19:42:47 +0000 (11:42 -0800)] 
FLUME-2578. Kafka source throws NPE if Kafka record has null key

(Gwen Shapira via Hari)

7 years agoFLUME-2556. BucketWriter DateFormat test fails intermittently.
Hari Shreedharan [Thu, 18 Dec 2014 21:28:20 +0000 (13:28 -0800)] 
FLUME-2556. BucketWriter DateFormat test fails intermittently.

(Johny Rufus via Hari)

7 years agoFLUME-2373. Support TBinaryProtocol in Thrift RPC.
Hari Shreedharan [Thu, 18 Dec 2014 20:13:19 +0000 (12:13 -0800)] 
FLUME-2373. Support TBinaryProtocol in Thrift RPC.

(Stefan Krawczyk via Hari)

7 years agoFLUME-2558. Update javadoc for StressSource
Roshan Naik [Wed, 26 Nov 2014 05:00:11 +0000 (21:00 -0800)] 
FLUME-2558. Update javadoc for StressSource

(Ashish Paliwal via Roshan Naik)

7 years agoFLUME-2488: TestElasticSearchRestClient fails on Oracle JDK 8
Jarek Jarcec Cecho [Sat, 22 Nov 2014 01:28:37 +0000 (17:28 -0800)] 
FLUME-2488: TestElasticSearchRestClient fails on Oracle JDK 8

(Johny Rufus via Jarek Jarcec Cecho)

7 years agoFLUME-2557. Make DatasetSink work with Kerberos
Mike Percy [Fri, 21 Nov 2014 04:39:23 +0000 (20:39 -0800)] 
FLUME-2557. Make DatasetSink work with Kerberos

(Joey Echeverria via Mike Percy)

7 years agoFLUME-2560. Add Kafka Channel to dist tarballs.
Hari Shreedharan [Fri, 21 Nov 2014 01:04:14 +0000 (17:04 -0800)] 
FLUME-2560. Add Kafka Channel to dist tarballs.

(Johny Rufus via Hari)

7 years agoFLUME-2246. Make event data size configurable for logger sinker
Roshan Naik [Thu, 20 Nov 2014 04:28:23 +0000 (20:28 -0800)] 
FLUME-2246. Make event data size configurable for logger sinker

(Ashish Paliwal via Roshan Naik)

7 years agoFLUME-2480. Typo in file channel exception: "Usable space exhaused"
Roshan Naik [Thu, 20 Nov 2014 04:14:11 +0000 (20:14 -0800)] 
FLUME-2480. Typo in file channel exception: "Usable space exhaused"

(Santiago M. Mola via Roshan Naik)

7 years agoFLUME-2487. SyslogParser has rounding errors in timestamp parsing
Roshan Naik [Thu, 20 Nov 2014 03:58:31 +0000 (19:58 -0800)] 
FLUME-2487. SyslogParser has rounding errors in timestamp parsing

(Santiago M. Mola via Roshan Naik)

7 years agoFLUME-1521. Document the StressSource
Roshan Naik [Thu, 20 Nov 2014 03:24:48 +0000 (19:24 -0800)] 
FLUME-1521. Document the StressSource

(Ashish Paliwal via Roshan Naik)

7 years agoFLUME-1594. Document JMX options
Roshan Naik [Thu, 20 Nov 2014 02:39:43 +0000 (18:39 -0800)] 
FLUME-1594. Document JMX options

(Ashish Paliwal via Roshan Naik)

7 years agoFLUME-2509. Add description for properties in Failover Sink Processor
Roshan Naik [Thu, 20 Nov 2014 02:25:00 +0000 (18:25 -0800)] 
FLUME-2509.  Add description for properties in Failover Sink Processor

(Ashish Paliwal via Roshan Naik)

7 years agoFLUME-2538. TestResettableFileInputStream fails on JDK 8.
Hari Shreedharan [Thu, 13 Nov 2014 23:23:37 +0000 (15:23 -0800)] 
FLUME-2538. TestResettableFileInputStream fails on JDK 8.

(Johny Rufus via Hari)

7 years agoUpdate CHANGELOG for 1.5.2
Hari Shreedharan [Wed, 12 Nov 2014 20:00:53 +0000 (12:00 -0800)] 
Update CHANGELOG for 1.5.2

7 years agoUpdate RELEASE-NOTES for 1.5.2
Hari Shreedharan [Wed, 12 Nov 2014 19:56:22 +0000 (11:56 -0800)] 
Update RELEASE-NOTES for 1.5.2

7 years agoFLUME-2551. Add dev-support directory to source tarball.
Hari Shreedharan [Wed, 12 Nov 2014 19:48:34 +0000 (11:48 -0800)] 
FLUME-2551. Add dev-support directory to source tarball.

7 years agoFLUME-2549: Enable SSLv2Hello for HttpSource
Jarek Jarcec Cecho [Wed, 12 Nov 2014 15:35:06 +0000 (07:35 -0800)] 
FLUME-2549: Enable SSLv2Hello for HttpSource

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2548: Enable SSLv2Hello for Avro Source and NettyAvroRpcClient
Jarek Jarcec Cecho [Wed, 12 Nov 2014 14:16:47 +0000 (06:16 -0800)] 
FLUME-2548: Enable SSLv2Hello for Avro Source and NettyAvroRpcClient

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2385. Remove incorrect log message at INFO level in Spool Directory Source.
Hari Shreedharan [Tue, 11 Nov 2014 06:38:46 +0000 (22:38 -0800)] 
FLUME-2385. Remove incorrect log message at INFO level in Spool Directory Source.

(Phil Scala via Hari Shreedharan)

7 years agoFLUME-2497. Support fractional seconds in Syslog timestamps
Mike Percy [Tue, 11 Nov 2014 02:57:20 +0000 (18:57 -0800)] 
FLUME-2497. Support fractional seconds in Syslog timestamps

This fixes a bug in the SyslogTcpSource and SyslogUdpSource where
fractional timestamps fail to parse.

(Johny Rufus via Mike Percy)

7 years agoFLUME-2505: Test added in FLUME-2502 is flaky
Jarek Jarcec Cecho [Sat, 8 Nov 2014 20:09:49 +0000 (12:09 -0800)] 
FLUME-2505: Test added in FLUME-2502 is flaky

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoPreparing for Flume-1.5.1 Release
Hari Shreedharan [Thu, 6 Nov 2014 19:39:28 +0000 (11:39 -0800)] 
Preparing for Flume-1.5.1 Release

7 years agoUpdating CHANGELOG for 1.5.1 release
Hari Shreedharan [Thu, 6 Nov 2014 21:26:02 +0000 (13:26 -0800)] 
Updating CHANGELOG for 1.5.1 release

7 years agoFLUME-2525. Handle a zero byte .flumespool-main.meta file for the spooldir source.
Hari Shreedharan [Thu, 6 Nov 2014 19:31:35 +0000 (11:31 -0800)] 
FLUME-2525. Handle a zero byte .flumespool-main.meta file for the spooldir source.

(Johny Rufus via Hari)

7 years agoFLUME-2533: HTTPS tests fail on Java 6
Jarek Jarcec Cecho [Thu, 6 Nov 2014 00:53:13 +0000 (16:53 -0800)] 
FLUME-2533: HTTPS tests fail on Java 6

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2523. Document Kafka channel
Hari Shreedharan [Fri, 31 Oct 2014 21:27:21 +0000 (14:27 -0700)] 
FLUME-2523. Document Kafka channel

(Gwen Shapira via Hari)

7 years agoFLUME-2500: Add a channel that uses Kafka
Jarek Jarcec Cecho [Tue, 28 Oct 2014 21:59:23 +0000 (14:59 -0700)] 
FLUME-2500: Add a channel that uses Kafka

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2520: HTTP Source should be able to block a prefixed set of protocols.
Jarek Jarcec Cecho [Mon, 27 Oct 2014 23:27:00 +0000 (16:27 -0700)] 
FLUME-2520: HTTP Source should be able to block a prefixed set of protocols.

(Hari Shreedharan via Jarek Jarcec Cecho)

7 years agoFLUME-2517. Cache SimpleDataFormat objects in bucketwriter for better performance.
Hari Shreedharan [Mon, 27 Oct 2014 20:41:25 +0000 (13:41 -0700)] 
FLUME-2517. Cache SimpleDataFormat objects in bucketwriter for better performance.

(Pal Konyves via Hari)

7 years agoFLUME-2511. Allow configuration of enabled protocols in Avro source and RpcClient.
Hari Shreedharan [Thu, 23 Oct 2014 01:27:36 +0000 (18:27 -0700)] 
FLUME-2511. Allow configuration of enabled protocols in Avro source and RpcClient.

(Tom White via Hari)

7 years agoFLUME-2486. TestExecSource fails on some environments
Hari Shreedharan [Thu, 16 Oct 2014 06:16:15 +0000 (23:16 -0700)] 
FLUME-2486. TestExecSource fails on some environments

(Santiago M. Mola via Hari)

7 years agoFLUME-2499. Include Kafka Message Key in Event Headers.
Hari Shreedharan [Thu, 16 Oct 2014 05:20:34 +0000 (22:20 -0700)] 
FLUME-2499. Include Kafka Message Key in Event Headers.

(Ricky Saltzer via Hari)

7 years agoFLUME-2502. Improve Spool Directory Source's performance by not listing files each...
Hari Shreedharan [Thu, 16 Oct 2014 04:29:46 +0000 (21:29 -0700)] 
FLUME-2502. Improve Spool Directory Source's performance by not listing files each time.

(Prateek Rungta via Hari)

7 years agoFLUME-2482. File Channel tests must disable scheduled checkpoint to avoid a race...
Hari Shreedharan [Wed, 15 Oct 2014 01:17:34 +0000 (18:17 -0700)] 
FLUME-2482. File Channel tests must disable scheduled checkpoint to avoid a race condition with forced checkpoint.

(Johny Rufus via Hari)

7 years agoFLUME-1710. JSONEvent.getBody should not return null
Hari Shreedharan [Wed, 15 Oct 2014 01:08:52 +0000 (18:08 -0700)] 
FLUME-1710. JSONEvent.getBody should not return null

(Ashish Paliwal via Hari)

7 years agoFLUME-2126. Problem in elasticsearch sink when the event body is a complex field
Hari Shreedharan [Wed, 15 Oct 2014 00:28:25 +0000 (17:28 -0700)] 
FLUME-2126. Problem in elasticsearch sink when the event body is a complex field

(Ashish Paliwal via Hari)

7 years agoFLUME-2237. Example config in User Guide to use same notation for Agent name
Jarek Jarcec Cecho [Sat, 11 Oct 2014 20:05:13 +0000 (13:05 -0700)] 
FLUME-2237. Example config in User Guide to use same notation for Agent name

(Ashish Paliwal via Jarek Jarcec Cecho)

7 years agoFLUME-2475. toLowerCase/toUpperCase must specify Locale.
Hari Shreedharan [Fri, 10 Oct 2014 17:43:58 +0000 (10:43 -0700)] 
FLUME-2475. toLowerCase/toUpperCase must specify Locale.

(Santiago M. Mola via Hari)

7 years agoFLUME-2489. Upgrade Apache Curator to 2.6.0
Hari Shreedharan [Fri, 10 Oct 2014 07:11:21 +0000 (00:11 -0700)] 
FLUME-2489. Upgrade Apache Curator to 2.6.0

(Santiago M. Mola via Hari)

7 years agoFLUME-2472. SyslogUtils fails when system locale is not English
Hari Shreedharan [Fri, 10 Oct 2014 06:17:30 +0000 (23:17 -0700)] 
FLUME-2472. SyslogUtils fails when system locale is not English

(Santiago M. Mola via Hari)

7 years agoFLUME-2346. idLogFileMap in Log can lose track of file ids.
Hari Shreedharan [Thu, 9 Oct 2014 23:10:10 +0000 (16:10 -0700)] 
FLUME-2346. idLogFileMap in Log can lose track of file ids.

(Johny Rufus via Hari)

7 years agoFLUME-2466. Embedded agent name cannot contain spaces
Hari Shreedharan [Thu, 9 Oct 2014 03:21:25 +0000 (20:21 -0700)] 
FLUME-2466. Embedded agent name cannot contain spaces

(Johny Rufus via Hari)

7 years agoFLUME-2495. Kafka Source may miss events when channel is not available
Hari Shreedharan [Tue, 7 Oct 2014 21:12:02 +0000 (14:12 -0700)] 
FLUME-2495. Kafka Source may miss events when channel is not available

(Gwen Shapira via Hari)

7 years agoFLUME-2479. Adding new test files.
Hari Shreedharan [Fri, 3 Oct 2014 18:56:15 +0000 (11:56 -0700)] 
FLUME-2479. Adding new test files.

(Gwen Shapira via Hari)

7 years agoFLUME-2479. Kafka property auto.commit.enable is incorrect for KafkaSource.
Hari Shreedharan [Fri, 3 Oct 2014 18:52:13 +0000 (11:52 -0700)] 
FLUME-2479. Kafka property auto.commit.enable is incorrect for KafkaSource.

(Gwen Shapira via Hari)

7 years agoFLUME-2492. Flume's Kafka Source doesn't account time correctly
Hari Shreedharan [Fri, 3 Oct 2014 18:24:24 +0000 (11:24 -0700)] 
FLUME-2492. Flume's Kafka Source doesn't account time correctly

(Gwen Shapira via Hari)

8 years agoFLUME-2481. TestFileChannelEncryption fails with System locale other than en_US
Hari Shreedharan [Thu, 2 Oct 2014 05:23:15 +0000 (22:23 -0700)] 
FLUME-2481. TestFileChannelEncryption fails with System locale other than en_US

(Santiago M. Mola via Hari)

8 years agoFLUME-1501. Flume Scribe Source needs unit tests.
Hari Shreedharan [Tue, 30 Sep 2014 19:21:55 +0000 (12:21 -0700)] 
FLUME-1501. Flume Scribe Source needs unit tests.

(Ashish Paliwal via Hari)

8 years agoFLUME-2463. Add Hive and HBase dataset support in DatasetSink.
Hari Shreedharan [Fri, 26 Sep 2014 18:45:54 +0000 (11:45 -0700)] 
FLUME-2463. Add Hive and HBase dataset support in DatasetSink.

(Ryan Blue via Hari)

8 years agoFLUME-2469. DatasetSink should load dataset when needed, not at startup.
Hari Shreedharan [Thu, 25 Sep 2014 06:58:50 +0000 (23:58 -0700)] 
FLUME-2469. DatasetSink should load dataset when needed, not at startup.

(Ryan Blue via Hari)

8 years agoFLUME-2470. Kafka Sink and Source config updates. Missed a couple files in the last...
Hari Shreedharan [Wed, 24 Sep 2014 06:17:40 +0000 (23:17 -0700)] 
FLUME-2470. Kafka Sink and Source config updates. Missed a couple files in the last commit, adding them.

(Gwen Shapira via Hari)

8 years agoFLUME-2470. Kafka Sink and Source must use camel case for all configs.
Hari Shreedharan [Wed, 24 Sep 2014 06:10:25 +0000 (23:10 -0700)] 
FLUME-2470. Kafka Sink and Source must use camel case for all configs.

(Gwen Shapira via Hari)

8 years agoFLUME-2455. Kafka Sink Documentation.
Hari Shreedharan [Wed, 24 Sep 2014 05:33:55 +0000 (22:33 -0700)] 
FLUME-2455. Kafka Sink Documentation.

(Thilina Buddika, Gwen Shapira via Hari)

8 years agoFLUME-2250. Kafka Source.
Hari Shreedharan [Wed, 17 Sep 2014 04:24:37 +0000 (21:24 -0700)] 
FLUME-2250. Kafka Source.

(Frank Yao, Ashish Paliwal, Gwen Shapira via Hari)

8 years agoFLUME-2251. Kafka Sink.
Hari Shreedharan [Mon, 15 Sep 2014 21:26:19 +0000 (14:26 -0700)] 
FLUME-2251. Kafka Sink.

(Thilina Buddhika, Gwen Shapira via Hari)

8 years agoFLUME-2462. Remove use of deprecated methods in DatasetSink
Hari Shreedharan [Sat, 13 Sep 2014 21:59:37 +0000 (14:59 -0700)] 
FLUME-2462. Remove use of deprecated methods in DatasetSink

(Ryan Blue via Hari)

8 years agoFLUME-2337. export JAVA_HOME in flume-env.sh.template and increase heap size
Hari Shreedharan [Fri, 12 Sep 2014 20:23:16 +0000 (13:23 -0700)] 
FLUME-2337. export JAVA_HOME in flume-env.sh.template and increase heap size

(Roshan Naik via Hari)

8 years agoFLUME-1491. Support fetching configuration from Zookeeper.
Hari Shreedharan [Fri, 12 Sep 2014 20:16:13 +0000 (13:16 -0700)] 
FLUME-1491. Support fetching configuration from Zookeeper.

(Ashish Paliwal via Hari)

8 years agoFLUME-2426. Support interceptors in the Embedded Agent
Hari Shreedharan [Fri, 12 Sep 2014 18:50:57 +0000 (11:50 -0700)] 
FLUME-2426. Support interceptors in the Embedded Agent

(Johny Rufus via Hari)

8 years agoFLUME-2420. HDFS Bucketwriter must access sfWriters map only within synchronized...
Hari Shreedharan [Fri, 12 Sep 2014 18:21:26 +0000 (11:21 -0700)] 
FLUME-2420. HDFS Bucketwriter must access sfWriters map only within synchronized blocks.

(chenshangan via Hari)

8 years agoFLUME-2450 - Improve replay index insertion speed. (Hari via Brock)
Brock Noland [Fri, 29 Aug 2014 19:01:03 +0000 (12:01 -0700)] 
FLUME-2450 - Improve replay index insertion speed. (Hari via Brock)

8 years agoFLUME-2425 - FileChannel should trim data and checkpoint directories (Johny Rufus...
Brock Noland [Fri, 22 Aug 2014 19:11:20 +0000 (12:11 -0700)] 
FLUME-2425 - FileChannel should trim data and checkpoint directories (Johny Rufus via Brock Noland)

8 years agoFLUME-2438. Make Syslog source message body configurable
Mike Percy [Thu, 14 Aug 2014 20:42:12 +0000 (16:42 -0400)] 
FLUME-2438. Make Syslog source message body configurable

Allow for specifying particular fields to keep in the body of the event
or drop, representing them only in Flume event headers.

(Abraham Elmahrek via Mike Percy)

8 years agoFLUME-2439. Upgrade Dataset sink to use Kite 1.5.0
Hari Shreedharan [Tue, 12 Aug 2014 23:13:24 +0000 (16:13 -0700)] 
FLUME-2439. Upgrade Dataset sink to use Kite 1.5.0

(Ryan Blue via Hari)

8 years agoFLUME-1920. Remove Hadoop dependency from integration tests
Mike Percy [Wed, 6 Aug 2014 18:55:19 +0000 (11:55 -0700)] 
FLUME-1920. Remove Hadoop dependency from integration tests

The file channel no longer actually depends on Hadoop, and this test was
exhibiting failures when Flume is built from paths containing the string
"hadoop". Since hadoop is not required for any of these tests, the
straightforward thing to do was to remove the now unnecessary Hadoop JAR
detection code completely.

(Li Xiang via Mike Percy)

8 years agoFLUME-2441. HTTP Source Unit tests fail on IBM JDK 7
Hari Shreedharan [Tue, 5 Aug 2014 20:54:07 +0000 (13:54 -0700)] 
FLUME-2441. HTTP Source Unit tests fail on IBM JDK 7

(Li Xiang via Hari)

8 years agoFLUME-2432. Update Kite dependency to 0.15.0.
Hari Shreedharan [Mon, 28 Jul 2014 16:45:16 +0000 (09:45 -0700)] 
FLUME-2432. Update Kite dependency to 0.15.0.

(Joey Echeverria via Hari)

8 years agoFLUME-2431. Add simple regex search-and-replace interceptor
Hari Shreedharan [Wed, 23 Jul 2014 03:00:48 +0000 (20:00 -0700)] 
FLUME-2431. Add simple regex search-and-replace interceptor

(Mike Percy via Hari)

8 years agoFLUME-1793. Unit test TestElasticSearchLogStashEventSerializer fails with IBM JDK
Hari Shreedharan [Fri, 18 Jul 2014 00:33:26 +0000 (17:33 -0700)] 
FLUME-1793. Unit test TestElasticSearchLogStashEventSerializer fails with IBM JDK

(Li Xiang via Hari Shreedharan. Reviewed by Edward Sargisson)

8 years agoFLUME-2401. Optionally compress backup checkpoint.
Hari Shreedharan [Wed, 9 Jul 2014 00:20:36 +0000 (17:20 -0700)] 
FLUME-2401. Optionally compress backup checkpoint.

(Abraham Fine via Hari Shreedharan)

8 years agoFLUME-2404. Make ScribeSource read buffer and max frame size configurable
Mike Percy [Fri, 4 Jul 2014 22:41:43 +0000 (15:41 -0700)] 
FLUME-2404. Make ScribeSource read buffer and max frame size configurable

Scribe default Thrift service maxReadBufferBytes and frame size varies
across Thrift versions. In some cases, these values are set to INT_MAX,
in other cases this is set to 16MB. To avoid OOM in certain cases and
incompatibilities in other cases, set the default to 16MB and also make
the parameters configurable.

(chenshangan and Marimuthu Ponnambalam via Mike Percy)