tez.git
4 weeks agoTEZ-4027. DagAwareYarnTaskScheduler can miscompute blocked vertices and cause a hang master
Kuhu Shukla [Tue, 18 Dec 2018 15:14:45 +0000 (09:14 -0600)] 
TEZ-4027. DagAwareYarnTaskScheduler can miscompute blocked vertices and cause a hang

Signed-off-by: Jason Lowe <jlowe@apache.org>
5 weeks agoTEZ-3957: Report TASK_DURATION_MILLIS as a Counter for completed tasks (Sergey Sheluk...
Sergey Shelukhin [Tue, 11 Dec 2018 19:45:58 +0000 (11:45 -0800)] 
TEZ-3957: Report TASK_DURATION_MILLIS as a Counter for completed tasks (Sergey Shelukhin, reviewed by Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
7 weeks agoTEZ-4021. API incompatibility wro4j-maven-plugin
Jonathan Eagles [Tue, 27 Nov 2018 21:23:48 +0000 (15:23 -0600)] 
TEZ-4021. API incompatibility wro4j-maven-plugin

Signed-off-by: Jason Lowe <jlowe@apache.org>
7 weeks agoTEZ-4022. Upgrade Maven Surefire plugin to 3.0.0-M1
Jonathan Eagles [Tue, 27 Nov 2018 17:20:43 +0000 (11:20 -0600)] 
TEZ-4022. Upgrade Maven Surefire plugin to 3.0.0-M1

Signed-off-by: Jason Lowe <jlowe@apache.org>
8 weeks agoTEZ-3998. Allow CONCURRENT edge property in DAG construction and introduce Concurrent...
Jonathan Eagles [Tue, 20 Nov 2018 22:48:59 +0000 (16:48 -0600)] 
TEZ-3998. Allow CONCURRENT edge property in DAG construction and introduce ConcurrentSchedulingType (Yingda Chen via jeagles)

2 months agoTEZ-4004. Update jetty9 to align with Hadoop and Hive (Jonathan Eagles via kshukla)
Kuhu Shukla [Tue, 30 Oct 2018 13:51:02 +0000 (08:51 -0500)] 
TEZ-4004. Update jetty9 to align with Hadoop and Hive (Jonathan Eagles via kshukla)

2 months agoTEZ-4012. Add docker support for Tez. (Jonathan Eagles via kshukla)
Kuhu Shukla [Fri, 26 Oct 2018 19:42:06 +0000 (14:42 -0500)] 
TEZ-4012. Add docker support for Tez. (Jonathan Eagles via kshukla)

2 months agoTEZ-3976: Batch ShuffleManager error report events (Jaume Marhuenda, reviewed by...
Jaume Marhuenda [Tue, 23 Oct 2018 22:30:13 +0000 (15:30 -0700)] 
TEZ-3976: Batch ShuffleManager error report events (Jaume Marhuenda, reviewed by Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
3 months agoTEZ-3961. Tez UI web.xml tries to reach out to java.sun.com for validation after...
Jonathan Eagles [Wed, 10 Oct 2018 21:59:04 +0000 (16:59 -0500)] 
TEZ-3961. Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9 (Kuhu Shukla via jeagles)

3 months agoTEZ-3990. The number of shuffle penalties for a host/inputAttemptIdentifier should...
Jonathan Eagles [Wed, 10 Oct 2018 21:21:21 +0000 (16:21 -0500)] 
TEZ-3990. The number of shuffle penalties for a host/inputAttemptIdentifier should be capped (Kuhu Shukla via jeagles)

3 months agoTEZ-4003. Add gopalv@apache.org to KEYS file (Gopal V via jeagles)
Gopal V [Tue, 9 Oct 2018 22:02:35 +0000 (17:02 -0500)] 
TEZ-4003. Add gopalv@apache.org to KEYS file (Gopal V via jeagles)

3 months agoTEZ-3995. Fix dot files produced by tests to prevent ASF license warnings in yetus...
Jaume Marhuenda [Tue, 9 Oct 2018 18:31:58 +0000 (13:31 -0500)] 
TEZ-3995. Fix dot files produced by tests to prevent ASF license warnings in yetus (Jaume Marhuenda via jegales)

3 months agoTEZ-3969. TaskAttemptImpl: static fields initialized in instance ctor (Jaume Marhuend...
Jaume Marhuenda [Tue, 9 Oct 2018 18:12:17 +0000 (13:12 -0500)] 
TEZ-3969. TaskAttemptImpl: static fields initialized in instance ctor (Jaume Marhuenda via jegales)

3 months agoTEZ-3994. Upgrade maven-surefire-plugin to 0.21.0 to support yetus
Jonathan Eagles [Fri, 28 Sep 2018 15:15:24 +0000 (10:15 -0500)] 
TEZ-3994. Upgrade maven-surefire-plugin to 0.21.0 to support yetus

Signed-off-by: Jason Lowe <jlowe@apache.org>
3 months agoTEZ-3975. Add OWASP Dependency Check to the build
Jonathan Eagles [Wed, 26 Sep 2018 20:48:48 +0000 (13:48 -0700)] 
TEZ-3975. Add OWASP Dependency Check to the build

Signed-off-by: Jason Lowe <jlowe@apache.org>
3 months agoTEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negativ...
Jaume M [Mon, 24 Sep 2018 23:13:24 +0000 (16:13 -0700)] 
TEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory (Jaume M via jeagles)

3 months agoTEZ-3982. DAGAppMaster and tasks should not report negative or invalid progress ...
Jonathan Eagles [Thu, 20 Sep 2018 15:26:42 +0000 (10:26 -0500)] 
TEZ-3982. DAGAppMaster and tasks should not report negative or invalid progress (Kuhu Shukla via jeagles)

4 months agoTEZ-3972. Tez DAG can hang when a single task fails to fetch (Kuhu Shukla via jeagles)
Jonathan Eagles [Tue, 18 Sep 2018 22:14:44 +0000 (17:14 -0500)] 
TEZ-3972. Tez DAG can hang when a single task fails to fetch (Kuhu Shukla via jeagles)

4 months agoTEZ-3988. Update snapshot version in master to 0.10.1-SNAPSHOT
Eric Wohlstadter [Fri, 14 Sep 2018 15:51:58 +0000 (10:51 -0500)] 
TEZ-3988. Update snapshot version in master to 0.10.1-SNAPSHOT

Signed-off-by: Jason Lowe <jlowe@apache.org>
4 months agoTEZ-3989. Fix by-laws related to emeritus clause.
Hitesh Shah [Tue, 11 Sep 2018 16:34:19 +0000 (09:34 -0700)] 
TEZ-3989. Fix by-laws related to emeritus clause.

Signed-off-by: Jason Lowe <jlowe@apache.org>
4 months agoTEZ-3984: Shuffle: Out of Band DME event sending causes errors (Jaume Marhuenda,...
Jaume Marhuenda [Mon, 10 Sep 2018 19:50:00 +0000 (12:50 -0700)] 
TEZ-3984: Shuffle: Out of Band DME event sending causes errors (Jaume Marhuenda, reviewed by Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
4 months agoTEZ-3973. Add Kuhu Shukla's (kshukla) public key to KEYS (Kuhu Shukla via jeagles)
Jonathan Eagles [Thu, 6 Sep 2018 16:24:12 +0000 (11:24 -0500)] 
TEZ-3973. Add Kuhu Shukla's (kshukla) public key to KEYS (Kuhu Shukla via jeagles)

4 months agoTEZ-3980: ShuffleRunner: the wake loop needs to check for shutdown (Gopal V, reviewed...
Gopal V [Tue, 28 Aug 2018 03:37:27 +0000 (20:37 -0700)] 
TEZ-3980: ShuffleRunner: the wake loop needs to check for shutdown (Gopal V, reviewed by Gunther Hagleitner)

4 months agoTEZ-3958: Add internal vertex priority information into the tez dag.dot debug informa...
Jaume Marhuenda [Tue, 28 Aug 2018 03:34:41 +0000 (20:34 -0700)] 
TEZ-3958: Add internal vertex priority information into the tez dag.dot debug information (Jaume Marhuenda via Gopal V)

4 months agoTEZ-3977. Add Eric Wohlstadter's public key to KEYS (Eric Wohlstadter via jeagles)
Jonathan Eagles [Thu, 23 Aug 2018 20:33:06 +0000 (15:33 -0500)] 
TEZ-3977. Add Eric Wohlstadter's public key to KEYS (Eric Wohlstadter via jeagles)

5 months agoTEZ-3978. DAGClientServer Socket exception when localhost name lookup failures (Jonat...
Jonathan Eagles [Thu, 16 Aug 2018 18:07:36 +0000 (13:07 -0500)] 
TEZ-3978. DAGClientServer Socket exception when localhost name lookup failures (Jonathan Eagles via jlowe)

Signed-off-by: Jason Lowe <jlowe@apache.org>
5 months agoTEZ-3974: Correctness regression of TEZ-955 in TEZ-2937 (Jaume Marhuenda, reviewed...
Jaume Marhuenda [Thu, 9 Aug 2018 21:39:56 +0000 (14:39 -0700)] 
TEZ-3974: Correctness regression of TEZ-955 in TEZ-2937 (Jaume Marhuenda, reviewed by Gopal V)

5 months agoTEZ-3934. LegacySpeculator sometime issues wrong number of speculative attempts ...
Jonathan Eagles [Fri, 27 Jul 2018 14:56:10 +0000 (09:56 -0500)] 
TEZ-3934. LegacySpeculator sometime issues wrong number of speculative attempts (Nishant Dash via jeagles)

5 months agoTEZ-3942. RPC getTask writable optimization invalid in hadoop 2.8+
Nishant Dash [Tue, 24 Jul 2018 15:14:53 +0000 (10:14 -0500)] 
TEZ-3942. RPC getTask writable optimization invalid in hadoop 2.8+

Signed-off-by: Jason Lowe <jlowe@apache.org>
6 months agoTEZ-3965: TestMROutput: Fix the hard-coded /tmp/output paths (Jaume Marhuenda, review...
Jaume Marhuenda [Fri, 13 Jul 2018 05:39:09 +0000 (22:39 -0700)] 
TEZ-3965: TestMROutput: Fix the hard-coded /tmp/output paths (Jaume Marhuenda, reviewed by Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
6 months agoTEZ-3916: Add hadoop-azure-datalake jar to azure profile (Eric Wohlstadter via Gopal V)
Eric Wohlstadter [Thu, 12 Jul 2018 22:03:16 +0000 (15:03 -0700)] 
TEZ-3916: Add hadoop-azure-datalake jar to azure profile (Eric Wohlstadter via Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
6 months agoTEZ-3970. NullPointerException in Tez ShuffleHandler Ranged Fetch (Jonathan Eagles...
Kuhu Shukla [Thu, 12 Jul 2018 22:44:19 +0000 (17:44 -0500)] 
TEZ-3970. NullPointerException in Tez ShuffleHandler Ranged Fetch (Jonathan Eagles via kshukla)

6 months agoTEZ-3964. Inflater not closed in some places (Jaume M via jlowe)
Jason Lowe [Thu, 12 Jul 2018 15:48:07 +0000 (10:48 -0500)] 
TEZ-3964. Inflater not closed in some places (Jaume M via jlowe)

6 months agoTEZ-3955. Upgrade hadoop dependency to 3.0.3 (Jonathan Eagles via jlowe)
Jason Lowe [Wed, 11 Jul 2018 16:04:50 +0000 (11:04 -0500)] 
TEZ-3955. Upgrade hadoop dependency to 3.0.3 (Jonathan Eagles via jlowe)

6 months agoTEZ-3912. Fetchers should be more robust to corrupted inputs (Kuhu Shukla via jeagles)
Jonathan Eagles [Mon, 9 Jul 2018 15:44:06 +0000 (10:44 -0500)] 
TEZ-3912. Fetchers should be more robust to corrupted inputs (Kuhu Shukla via jeagles)

6 months agoTEZ-3963. Possible InflaterInputStream leaked in TezCommonUtils and related classes...
Jason Lowe [Fri, 6 Jul 2018 21:53:57 +0000 (16:53 -0500)] 
TEZ-3963. Possible InflaterInputStream leaked in TezCommonUtils and related classes (Jaume M via jlowe)

6 months agoTEZ-3954. Reduce Tez Shuffle Handler Memory needs for holding TezIndexRecords (Jonath...
Kuhu Shukla [Fri, 6 Jul 2018 14:16:44 +0000 (09:16 -0500)] 
TEZ-3954. Reduce Tez Shuffle Handler Memory needs for holding TezIndexRecords (Jonathan Eagles via kshukla)

6 months agoTEZ-3960. Better error handling in proto history logger and add doAs support. (harishjp)
Harish JP [Fri, 29 Jun 2018 17:01:15 +0000 (22:31 +0530)] 
TEZ-3960. Better error handling in proto history logger and add doAs support. (harishjp)

6 months agoTEZ-3962. Configuration decode leaks an Inflater object (Eric Wohlstadter via jlowe)
Jason Lowe [Thu, 28 Jun 2018 21:13:02 +0000 (16:13 -0500)] 
TEZ-3962. Configuration decode leaks an Inflater object (Eric Wohlstadter via jlowe)

6 months agoTEZ-3959. HTTP 502 for bower install (Harish Jaiprakash via Sree)
Sreenath [Wed, 27 Jun 2018 10:02:03 +0000 (15:32 +0530)] 
TEZ-3959. HTTP 502 for bower install (Harish Jaiprakash via Sree)

7 months agoTEZ-3953: Restore ABI-compat for DAGClient for TEZ-3951 (Sergey Shelukhin via Gopal V)
Sergey Shelukhin [Mon, 11 Jun 2018 23:17:06 +0000 (16:17 -0700)] 
TEZ-3953: Restore ABI-compat for DAGClient for TEZ-3951 (Sergey Shelukhin via Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
7 months agoTEZ-3951. TezClient wait too long for the DAGClient for prewarm; tries to shut down...
Harish JP [Mon, 11 Jun 2018 13:27:22 +0000 (18:57 +0530)] 
TEZ-3951. TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG (Sergey Shelukhin via Harish Jaiprakash)

7 months agoTEZ-3944. TestTaskScheduler times-out on Hadoop3 (Jonathan Eagles viak kshukla)
Kuhu Shukla [Thu, 7 Jun 2018 16:42:49 +0000 (11:42 -0500)] 
TEZ-3944. TestTaskScheduler times-out on Hadoop3 (Jonathan Eagles viak kshukla)

7 months agoTEZ-3938. Task attempts failing due to not making progress (Kuhu Shukla via jeagles)
Jonathan Eagles [Tue, 5 Jun 2018 21:24:58 +0000 (16:24 -0500)] 
TEZ-3938. Task attempts failing due to not making progress (Kuhu Shukla via jeagles)

7 months agoTEZ-3949. TestATSHistoryV15 is failing with hadoop3+ (Jonathan Eagles via kshukla)
Kuhu Shukla [Tue, 5 Jun 2018 20:29:48 +0000 (15:29 -0500)] 
TEZ-3949. TestATSHistoryV15 is failing with hadoop3+ (Jonathan Eagles via kshukla)

7 months agoTEZ-3946. NoClassDefFoundError, org.apache.hadoop.mapred.ShuffleHandler. (Multiple...
Jonathan Eagles [Mon, 4 Jun 2018 18:43:27 +0000 (13:43 -0500)] 
TEZ-3946. NoClassDefFoundError, org.apache.hadoop.mapred.ShuffleHandler. (Multiple tests with Hadoop3) (Eric Wohlstadter via jeagles)

7 months agoTEZ-3948. Tez distribution broken with hadoop3 (Jonathan Eagles via kshukla)
Kuhu Shukla [Mon, 4 Jun 2018 15:58:34 +0000 (10:58 -0500)] 
TEZ-3948. Tez distribution broken with hadoop3 (Jonathan Eagles via kshukla)

7 months agoTEZ-3929. Upgrade Jersey to 1.19 (Eric Wohlstadter via jeagles)
Jonathan Eagles [Fri, 1 Jun 2018 23:54:10 +0000 (18:54 -0500)] 
TEZ-3929. Upgrade Jersey to 1.19 (Eric Wohlstadter via jeagles)

7 months agoTEZ-3947. TestATSHistoryWithACLs fails with Hadoop3 and Jersey 1.19 (Eric Wohlstadter...
Jonathan Eagles [Fri, 1 Jun 2018 23:42:24 +0000 (18:42 -0500)] 
TEZ-3947. TestATSHistoryWithACLs fails with Hadoop3 and Jersey 1.19 (Eric Wohlstadter via jeagles)

7 months agoTEZ-3923. Move master to Hadoop 3+ and create separate 0.9.x line (Jonathan Eagles...
Kuhu Shukla [Fri, 1 Jun 2018 20:49:44 +0000 (15:49 -0500)] 
TEZ-3923. Move master to Hadoop 3+ and create separate 0.9.x line (Jonathan Eagles via kshukla)

7 months agoTEZ-3943. TezClient leaks DAGClient for prewarm (Sergey Shelukhin via jlowe)
Jason Lowe [Tue, 29 May 2018 19:23:03 +0000 (14:23 -0500)] 
TEZ-3943. TezClient leaks DAGClient for prewarm (Sergey Shelukhin via jlowe)

7 months agoTEZ-3939. Remove performance hit of precondition check in AM for register running...
Jason Lowe [Thu, 24 May 2018 14:09:36 +0000 (09:09 -0500)] 
TEZ-3939. Remove performance hit of precondition check in AM for register running task attempt (Jonathan Eagles via jlowe)

7 months agoTEZ-3940. Reduce time to convert TaskFinishedEvent to string (Jonathan Eagles via...
Jason Lowe [Thu, 24 May 2018 13:44:03 +0000 (08:44 -0500)] 
TEZ-3940. Reduce time to convert TaskFinishedEvent to string (Jonathan Eagles via jlowe)

7 months agoTEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via jeagles)
Jonathan Eagles [Tue, 22 May 2018 22:03:55 +0000 (17:03 -0500)] 
TEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via jeagles)

7 months agoTEZ-3935. DAG aware scheduler should release unassigned new containers rather than...
Jonathan Eagles [Tue, 22 May 2018 18:28:55 +0000 (13:28 -0500)] 
TEZ-3935. DAG aware scheduler should release unassigned new containers rather than hold them (Jason Lowe via jeagles)

7 months agoTEZ-3937. Empty partition BitSet to byte[] conversion creates one extra byte in round...
Jason Lowe [Mon, 21 May 2018 14:32:08 +0000 (09:32 -0500)] 
TEZ-3937. Empty partition BitSet to byte[] conversion creates one extra byte in rounding error (Jonathan Eagles via jlowe)

8 months agoTEZ-3824. MRCombiner creates new JobConf copy per spill (Jonathan Eagles via jlowe)
Jason Lowe [Mon, 14 May 2018 18:17:43 +0000 (13:17 -0500)] 
TEZ-3824. MRCombiner creates new JobConf copy per spill (Jonathan Eagles via jlowe)

8 months agoTEZ-3933. Remove sleep from test TestExceptionPropagation (Jonathan Eagles via kshukla)
Kuhu Shukla [Thu, 10 May 2018 21:38:16 +0000 (16:38 -0500)] 
TEZ-3933. Remove sleep from test TestExceptionPropagation (Jonathan Eagles via kshukla)

8 months agoTEZ-3911: Optional min/max/avg aggr. task counters reported to HistoryLoggingService...
Vineet Garg [Wed, 9 May 2018 19:02:15 +0000 (12:02 -0700)] 
TEZ-3911: Optional min/max/avg aggr. task counters reported to HistoryLoggingService at final counter aggr (Vineet Garg, via Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
8 months agoTEZ-3932. TaskSchedulerManager can throw NullPointerException during DAGAppMaster...
Jason Lowe [Wed, 9 May 2018 15:25:32 +0000 (10:25 -0500)] 
TEZ-3932. TaskSchedulerManager can throw NullPointerException during DAGAppMaster container cleanup race (Jonathan Eagles via jlowe)

8 months agoTEZ-3931. TestExternalTezServices fails on Hadoop3 (Jonathan Eagles via kshukla)
Kuhu Shukla [Tue, 8 May 2018 16:03:38 +0000 (11:03 -0500)] 
TEZ-3931. TestExternalTezServices fails on Hadoop3 (Jonathan Eagles via kshukla)

8 months agoTEZ-3930. TestDagAwareYarnTaskScheduler fails on Hadoop 3 (Jason Lowe via jeagles)
Jonathan Eagles [Tue, 8 May 2018 14:17:44 +0000 (09:17 -0500)] 
TEZ-3930. TestDagAwareYarnTaskScheduler fails on Hadoop 3 (Jason Lowe via jeagles)

8 months agoTEZ-3927. TestReduceProcessor fails on Hadoop 3.x (Jonathan Eagles via kshukla)
Kuhu Shukla [Fri, 4 May 2018 21:09:39 +0000 (16:09 -0500)] 
TEZ-3927. TestReduceProcessor fails on Hadoop 3.x (Jonathan Eagles via kshukla)

8 months agoTEZ-3924. TestDefaultSorter fails intermittently due random keys and interaction...
Kuhu Shukla [Fri, 4 May 2018 20:47:41 +0000 (15:47 -0500)] 
TEZ-3924. TestDefaultSorter fails intermittently due random keys and interaction with RLE and partition collisions (Jonathan Eagles via kshukla)

8 months agoTEZ-3926. Changes to master for 0.10.x line and 0.9 release branch (jeagles)
Jonathan Eagles [Wed, 2 May 2018 17:46:12 +0000 (12:46 -0500)] 
TEZ-3926. Changes to master for 0.10.x line and 0.9 release branch (jeagles)

8 months agoTEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagles via...
Jason Lowe [Mon, 30 Apr 2018 19:09:23 +0000 (14:09 -0500)] 
TEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagles via jlowe)

8 months agoRevert "TEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagle...
Jonathan Eagles [Fri, 27 Apr 2018 19:14:40 +0000 (14:14 -0500)] 
Revert "TEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagles via jlowe)"

This reverts commit ebc9f4f6dee1badeca39cac26c00818be3e4d77d.

8 months agoTEZ-3873. A maven enforcer plugin dependency error in pom.xml (Jinjiang Ling via...
Jonathan Eagles [Fri, 27 Apr 2018 18:14:36 +0000 (13:14 -0500)] 
TEZ-3873. A maven enforcer plugin dependency error in pom.xml (Jinjiang Ling via jeagles)

8 months agoTEZ-3887. Tez Shuffle Handler should support Index Cache configuration (Jonathan...
Kuhu Shukla [Fri, 27 Apr 2018 16:25:01 +0000 (11:25 -0500)] 
TEZ-3887. Tez Shuffle Handler should support Index Cache configuration (Jonathan Eagles via kshukla)

8 months agoTEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagles via...
Jason Lowe [Fri, 27 Apr 2018 16:29:08 +0000 (11:29 -0500)] 
TEZ-3914. Recovering a large DAG fails to size limit exceeded (Jonathan Eagles via jlowe)

8 months agoTEZ-3817. DAGs can hang after more than one uncaught Exception during doTransition...
Kuhu Shukla [Mon, 23 Apr 2018 21:52:55 +0000 (16:52 -0500)] 
TEZ-3817. DAGs can hang after more than one uncaught Exception during doTransition. (kshukla)

8 months agoTEZ-3915. Create protobuf based history event logger. (Harish Jaiprakash, reviewed...
Harish JP [Fri, 20 Apr 2018 08:11:37 +0000 (13:41 +0530)] 
TEZ-3915. Create protobuf based history event logger. (Harish Jaiprakash, reviewed by Gunther Hagleitner)

9 months agoTEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)
Jonathan Eagles [Mon, 9 Apr 2018 21:42:29 +0000 (16:42 -0500)] 
TEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)

9 months agoRevert "TEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)"
Jason Lowe [Mon, 9 Apr 2018 21:36:53 +0000 (16:36 -0500)] 
Revert "TEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)"

This reverts commit 9b3f8c73d4268bfa04c2a1dc5cd5c027af888a06.

9 months agoTEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)
Jonathan Eagles [Mon, 9 Apr 2018 19:44:11 +0000 (14:44 -0500)] 
TEZ-3913. Precommit build fails to post to JIRA (Jason Lowe via jeagles)

9 months agoRevert "TEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via kshukla)"
Kuhu Shukla [Thu, 5 Apr 2018 18:21:12 +0000 (13:21 -0500)] 
Revert "TEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via kshukla)"

This reverts commit 55a6b9d5cbf7062ab1f440e9d03ffedfda017170.

9 months agoTEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via kshukla)
Kuhu Shukla [Wed, 4 Apr 2018 13:56:01 +0000 (08:56 -0500)] 
TEZ-3902. Upgrade to netty-3.10.5.Final.jar (Jason Lowe via kshukla)

9 months agoTEZ-3909. DAG can hang if vertex with no tasks is killed (Jason Lowe via jeagles)
Jonathan Eagles [Tue, 3 Apr 2018 17:45:20 +0000 (12:45 -0500)] 
TEZ-3909. DAG can hang if vertex with no tasks is killed (Jason Lowe via jeagles)

9 months agoTEZ-3907. Improve log message to include the location the writers decide to spill...
Jason Lowe [Mon, 26 Mar 2018 19:49:12 +0000 (14:49 -0500)] 
TEZ-3907. Improve log message to include the location the writers decide to spill output (Kuhu Shukla via jlowe)

10 months agoTEZ-3905: Change BUILDING.TXT to minimum JDK 1.8 (Eric Wohlstadter via Gopal V)
Eric Wohlstadter [Thu, 15 Mar 2018 05:27:22 +0000 (22:27 -0700)] 
TEZ-3905: Change BUILDING.TXT to minimum JDK 1.8 (Eric Wohlstadter via Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
10 months agoTEZ-3874. NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present...
Jason Lowe [Fri, 9 Mar 2018 16:00:21 +0000 (10:00 -0600)] 
TEZ-3874. NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration. (Eric Wohlstadter via jlowe)

10 months agoTEZ-3892: getClient API for TezClient (Eric Wohlstadter via Gopal V)
Eric Wohlstadter [Wed, 7 Mar 2018 23:50:45 +0000 (15:50 -0800)] 
TEZ-3892: getClient API for TezClient (Eric Wohlstadter via Gopal V)

Signed-off-by: Gopal V <gopalv@apache.org>
10 months agoTEZ-3897. Tez Local Mode hang for vertices with broadcast input. (Jonathan Eagles...
Jason Lowe [Mon, 5 Mar 2018 15:53:11 +0000 (09:53 -0600)] 
TEZ-3897. Tez Local Mode hang for vertices with broadcast input. (Jonathan Eagles via jlowe)

10 months agoTEZ-3888: Update Jetty to org.eclipse.jetty 9.x (Eric Wohlstadter, reviewed by Rohini...
Eric Wohlstadter [Thu, 22 Feb 2018 21:24:16 +0000 (13:24 -0800)] 
TEZ-3888: Update Jetty to org.eclipse.jetty 9.x (Eric Wohlstadter, reviewed by Rohini Palaniswamy)

Signed-off-by: Gopal V <gopalv@apache.org>
10 months agoTEZ-3898. TestTezCommonUtils fails when compiled against hadoop version >= 2.8 (Jason...
Jonathan Eagles [Mon, 19 Feb 2018 16:09:48 +0000 (10:09 -0600)] 
TEZ-3898. TestTezCommonUtils fails when compiled against hadoop version >= 2.8 (Jason Lowe via jeagles)

11 months agoTEZ-3896. TestATSV15HistoryLoggingService#testNonSessionDomains is failing (Jason...
Jonathan Eagles [Fri, 16 Feb 2018 19:57:42 +0000 (13:57 -0600)] 
TEZ-3896. TestATSV15HistoryLoggingService#testNonSessionDomains is failing (Jason Lowe via jeagles)

11 months agoTEZ-3893. Tez Local Mode can hang for cases. (Jonathan Eagles via jlowe)
Jason Lowe [Wed, 14 Feb 2018 16:14:34 +0000 (10:14 -0600)] 
TEZ-3893. Tez Local Mode can hang for cases. (Jonathan Eagles via jlowe)

11 months agoTEZ-3894. Tez intermediate outputs implicitly rely on permissive umask for shuffle...
Kuhu Shukla [Fri, 9 Feb 2018 19:54:11 +0000 (13:54 -0600)] 
TEZ-3894. Tez intermediate outputs implicitly rely on permissive umask for shuffle (Jason Lowe via kshukla)

11 months agoTEZ-3895. Missing name for local mode task scheduler service async request handler...
Kuhu Shukla [Tue, 6 Feb 2018 16:36:46 +0000 (10:36 -0600)] 
TEZ-3895. Missing name for local mode task scheduler service async request handler thread (Jonathan Eagles via kshukla)

11 months agoTEZ-3770. DAG-aware YARN task scheduler (jlowe)
Jason Lowe [Thu, 25 Jan 2018 15:35:33 +0000 (09:35 -0600)] 
TEZ-3770. DAG-aware YARN task scheduler (jlowe)

12 months agoTEZ-3880: Do not count rejected tasks as killed in vertex progress (Sergey Shelukhin...
Sergey Shelukhin [Tue, 16 Jan 2018 21:56:46 +0000 (13:56 -0800)] 
TEZ-3880: Do not count rejected tasks as killed in vertex progress (Sergey Shelukhin, reviewed by Gunther Hagleitner)

Signed-off-by: Gopal V <gopalv@apache.org>
12 months agoTEZ-3877. Delete unordered spill files once merge is done (Jason Lowe via jeagles)
Jonathan Eagles [Tue, 16 Jan 2018 17:22:10 +0000 (11:22 -0600)] 
TEZ-3877. Delete unordered spill files once merge is done (Jason Lowe via jeagles)

12 months agoTEZ-3883. Update version in master to 0.9.2 (zhiyuany)
Zhiyuan Yang [Thu, 4 Jan 2018 23:23:34 +0000 (15:23 -0800)] 
TEZ-3883. Update version in master to 0.9.2 (zhiyuany)

12 months agoTEZ-3882. Changes for 0.9.1 release (zhiyuany)
Zhiyuan Yang [Thu, 4 Jan 2018 22:46:56 +0000 (14:46 -0800)] 
TEZ-3882. Changes for 0.9.1 release (zhiyuany)

13 months agoTEZ-3876. Bug in local mode distributed cache files (Jacob Tolar via jeagles)
Jonathan Eagles [Mon, 11 Dec 2017 20:40:04 +0000 (14:40 -0600)] 
TEZ-3876. Bug in local mode distributed cache files (Jacob Tolar via jeagles)

13 months agoTEZ-3869. Analyzer: Fix VertexInfo::getLastTaskToFinish comparison (rbalamohan)
Rajesh Balamohan [Sun, 3 Dec 2017 22:04:32 +0000 (03:34 +0530)] 
TEZ-3869. Analyzer: Fix VertexInfo::getLastTaskToFinish comparison (rbalamohan)

13 months agoTEZ-3868. Update website to factor in the TEZ trademark registration.
Siddharth Seth [Fri, 1 Dec 2017 21:27:56 +0000 (13:27 -0800)] 
TEZ-3868. Update website to factor in the TEZ trademark registration.

13 months agoTEZ-3867. testSendCustomProcessorEvent try to get array out of read only ByteBuffer...
Kuhu Shukla [Wed, 29 Nov 2017 12:57:46 +0000 (06:57 -0600)] 
TEZ-3867. testSendCustomProcessorEvent try to get array out of read only ByteBuffer (Zhiyuan Yang via kshukla)

14 months agoTEZ-3855 addendum. Allow vertex manager to send event to processor (zhiyuany)
Zhiyuan Yang [Wed, 15 Nov 2017 21:48:43 +0000 (13:48 -0800)] 
TEZ-3855 addendum. Allow vertex manager to send event to processor (zhiyuany)

14 months agoTEZ-3855. Allow vertex manager to send event to processor (zhiyuany)
Zhiyuan Yang [Sat, 11 Nov 2017 00:44:29 +0000 (16:44 -0800)] 
TEZ-3855. Allow vertex manager to send event to processor (zhiyuany)