hadoop.git
90 min agoYARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist... trunk
Weiwei Yang [Fri, 22 Feb 2019 12:58:33 +0000 (20:58 +0800)] 
YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie.

11 hours agoYARN-9156. Improve debug message in device plugin method compatibility check of Resou...
Weiwei Yang [Fri, 22 Feb 2019 03:27:17 +0000 (11:27 +0800)] 
YARN-9156. Improve debug message in device plugin method compatibility check of ResourcePluginManager. Contributed by Zhankun Tang.

16 hours agoHDDS-1161. Disable failing test which are tracked by a separated jira. Contributed...
Elek, Márton [Thu, 21 Feb 2019 21:57:05 +0000 (22:57 +0100)] 
HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton.

16 hours agoHDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
Bharat Viswanadham [Thu, 21 Feb 2019 21:29:10 +0000 (13:29 -0800)] 
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.

* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.

* fix test failures in TestOzoneConfigurationFields

19 hours agoYARN-9319. Fix compilation issue of handling typedef an existing name by gcc compiler...
Wangda Tan [Thu, 21 Feb 2019 19:17:32 +0000 (11:17 -0800)] 
YARN-9319. Fix compilation issue of handling typedef an existing name by gcc compiler. (Zhankun Tang via wangda)

Change-Id: Ie8293cc5b710ff355fb6a1ea7201be53ed0385bf

22 hours agoYARN-9258. Support to specify allocation tags without constraint in distributed shell...
Weiwei Yang [Thu, 21 Feb 2019 16:18:07 +0000 (00:18 +0800)] 
YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph.

22 hours agoHDDS-1126. Datanode is trying to qausi-close a container which is already closed.
Nanda kumar [Thu, 21 Feb 2019 16:07:08 +0000 (21:37 +0530)] 
HDDS-1126. Datanode is trying to qausi-close a container which is already closed.

Signed-off-by: Nanda kumar <nanda@apache.org>
22 hours agoHADOOP-16035. Jenkinsfile for Hadoop
Allen Wittenauer [Sat, 5 Jan 2019 20:14:50 +0000 (12:14 -0800)] 
HADOOP-16035. Jenkinsfile for Hadoop

Signed-off-by: Steve Loughran <stevel@apache.org>
23 hours agoHDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie.
Surendra Singh Lilhore [Thu, 21 Feb 2019 15:06:34 +0000 (20:36 +0530)] 
HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie.

24 hours agoHADOOP-16105. WASB in secure mode does not set connectingUsingSAS.
Steve Loughran [Thu, 21 Feb 2019 13:31:20 +0000 (13:31 +0000)] 
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.

Contributed by Steve Loughran.

25 hours agoHDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton.
Márton Elek [Mon, 18 Feb 2019 17:39:57 +0000 (18:39 +0100)] 
HDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton.

29 hours agoYARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu...
Weiwei Yang [Thu, 21 Feb 2019 09:21:21 +0000 (17:21 +0800)] 
YARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu Joseph.

30 hours agoYARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contri...
bibinchundatt [Thu, 21 Feb 2019 07:59:01 +0000 (13:29 +0530)] 
YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph.

36 hours agoHADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.
Daryn Sharp [Thu, 21 Feb 2019 02:13:53 +0000 (18:13 -0800)] 
HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
38 hours agoHDFS-14273. Fix checkstyle issues in BlockLocation's method javadoc
Shweta Yakkali [Wed, 20 Feb 2019 23:36:14 +0000 (15:36 -0800)] 
HDFS-14273. Fix checkstyle issues in BlockLocation's method javadoc
(Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I546aa4a0fe7f83b53735acd9925f366b2f1a00e2

39 hours agoHDDS-1109. Setup Failover Proxy Provider for OM client.
Hanisha Koneru [Wed, 20 Feb 2019 22:49:59 +0000 (14:49 -0800)] 
HDDS-1109. Setup Failover Proxy Provider for OM client.

40 hours agoHDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta...
Shweta Yakkali [Wed, 20 Feb 2019 22:28:37 +0000 (14:28 -0800)] 
HDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta Yakkali.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
40 hours agoHDFS-14302. Refactor NameNodeWebHdfsMethods#generateDelegationToken() to allow better...
Inigo Goiri [Wed, 20 Feb 2019 21:55:13 +0000 (13:55 -0800)] 
HDFS-14302. Refactor NameNodeWebHdfsMethods#generateDelegationToken() to allow better extensibility. Contributed by CR Hota.

41 hours agoHDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan.
Arpit Agarwal [Wed, 20 Feb 2019 20:57:49 +0000 (12:57 -0800)] 
HDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan.

42 hours agoHDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examp...
Sahil Takiar [Wed, 20 Feb 2019 19:36:37 +0000 (11:36 -0800)] 
HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
42 hours agoHDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar.
Xiaoyu Yao [Wed, 20 Feb 2019 19:11:36 +0000 (11:11 -0800)] 
HDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar.

2 days agoHADOOP-16104. Wasb tests to downgrade to skip when test a/c is namespace enabled...
Masatake Iwasaki [Wed, 20 Feb 2019 13:00:57 +0000 (22:00 +0900)] 
HADOOP-16104. Wasb tests to downgrade to skip when test a/c is namespace enabled. Contributed by Masatake Iwasaki.

2 days agoHDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDete...
Surendra Singh Lilhore [Wed, 20 Feb 2019 11:26:10 +0000 (16:56 +0530)] 
HDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDetectionDaemon. Contributed by Ranith Sardar.

2 days agoHDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh...
Márton Elek [Wed, 20 Feb 2019 11:08:24 +0000 (12:08 +0100)] 
HDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh Chitlangia.

2 days agoHDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain.
Yiqun Lin [Wed, 20 Feb 2019 02:45:51 +0000 (10:45 +0800)] 
HDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain.

2 days agoLogging stale datanode information. Contributed by Karthik Palanisamy.
Bharat Viswanadham [Wed, 20 Feb 2019 01:01:07 +0000 (17:01 -0800)] 
Logging stale datanode information. Contributed by  Karthik Palanisamy.

2 days agoHDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.
avijayanhwx [Wed, 20 Feb 2019 00:32:47 +0000 (16:32 -0800)] 
HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.

2 days agoHADOOP-15967. KMS Benchmark Tool. Contributed by George Huang.
George Huang [Tue, 19 Feb 2019 23:23:42 +0000 (15:23 -0800)] 
HADOOP-15967. KMS Benchmark Tool. Contributed by George Huang.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2 days agoHDFS-14188. Make hdfs ec -verifyClusterSetup command accept an erasure coding policy...
Kitti Nanasi [Tue, 19 Feb 2019 20:04:56 +0000 (12:04 -0800)] 
HDFS-14188. Make hdfs ec -verifyClusterSetup command accept an erasure coding policy as a parameter. Contributed by Kitti Nanasi.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2 days agoYARN-9286. [Timeline Server] Sorting based on FinalStatus shows pop-up message. Contr...
bibinchundatt [Tue, 19 Feb 2019 19:49:20 +0000 (01:19 +0530)] 
YARN-9286. [Timeline Server] Sorting based on FinalStatus shows pop-up message. Contributed by Bilwa S T.

2 days agoHDDS-1121. Key read failure when data is written parallel in to Ozone.
Anu Engineer [Tue, 19 Feb 2019 18:55:33 +0000 (10:55 -0800)] 
HDDS-1121. Key read failure when data is written parallel in to Ozone.
Contributed by Bharat Viswanadham.

2 days agoYARN-9309. Improve graph text in SLS to avoid overlapping. Contributed by Bilwa S T.
bibinchundatt [Tue, 19 Feb 2019 19:06:57 +0000 (00:36 +0530)] 
YARN-9309. Improve graph text in SLS to avoid overlapping. Contributed by Bilwa S T.

2 days agoHDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by...
Xiaoyu Yao [Tue, 19 Feb 2019 18:42:56 +0000 (10:42 -0800)] 
HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer.

3 days agoHADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not...
Adam Antal [Tue, 19 Feb 2019 11:33:02 +0000 (11:33 +0000)] 
HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not-found.

Contributed by Adam Antal.

(Revised patch applied after stevel committed the wrong one; that has been reverted)

3 days agoHDDS-1085. Create an OM API to serve snapshots to Recon server.
Anu Engineer [Tue, 19 Feb 2019 06:35:36 +0000 (22:35 -0800)] 
HDDS-1085. Create an OM API to serve snapshots to Recon server.
Contributed by Aravindan Vijayan.

3 days agoHDDS-1122. Fix TestOzoneManagerRatisServer#testSubmitRatisRequest unit test failure...
Yiqun Lin [Tue, 19 Feb 2019 03:29:52 +0000 (11:29 +0800)] 
HDDS-1122. Fix TestOzoneManagerRatisServer#testSubmitRatisRequest unit test failure. Contributed by Yiqun Lin.

3 days agoHDFS-14296. Prefer ArrayList over LinkedList in VolumeScanner. Contributed by BELUGA...
Inigo Goiri [Tue, 19 Feb 2019 01:55:43 +0000 (17:55 -0800)] 
HDFS-14296. Prefer ArrayList over LinkedList in VolumeScanner. Contributed by BELUGA BEHR.

3 days agoHDFS-9596. Remove Shuffle Method From DFSUtil. Contributed by BELUGA BEHR.
Inigo Goiri [Mon, 18 Feb 2019 23:30:38 +0000 (15:30 -0800)] 
HDFS-9596. Remove Shuffle Method From DFSUtil. Contributed by BELUGA BEHR.

3 days agoHDFS-14287. DataXceiverServer May Double-Close PeerServer. Contributed by BELUGA...
Inigo Goiri [Mon, 18 Feb 2019 19:00:04 +0000 (11:00 -0800)] 
HDFS-14287. DataXceiverServer May Double-Close PeerServer. Contributed by BELUGA BEHR.

3 days agoRevert "HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucke...
Steve Loughran [Mon, 18 Feb 2019 14:57:22 +0000 (14:57 +0000)] 
Revert "HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not-found."

This reverts commit c4a00d1ad3d3cfc02a6a4e1e04353678f2d588e1.

3 days agoHDDS-1106. Introduce queryMap in PipelineManager. Contributed by Lokesh Jain.
Yiqun Lin [Mon, 18 Feb 2019 14:35:23 +0000 (22:35 +0800)] 
HDDS-1106. Introduce queryMap in PipelineManager. Contributed by Lokesh Jain.

4 days agoYARN-9060. [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU...
Sunil G [Mon, 18 Feb 2019 10:27:11 +0000 (15:57 +0530)] 
YARN-9060. [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example. Contributed by Zhankun Tang.

4 days agoHADOOP-16116. Fix Spelling Mistakes - DECOMISSIONED. Contributed by BELUGA BEHR.
Akira Ajisaka [Mon, 18 Feb 2019 06:21:46 +0000 (15:21 +0900)] 
HADOOP-16116. Fix Spelling Mistakes - DECOMISSIONED. Contributed by BELUGA BEHR.

4 days agoYARN-9213. RM Web UI v1 does not show custom resource allocations for containers...
Sunil G [Sun, 17 Feb 2019 14:38:20 +0000 (20:08 +0530)] 
YARN-9213. RM Web UI v1 does not show custom resource allocations for containers page. Contributed by Szilard Nemeth.

4 days agoSUBMARINE-1. Move code base of submarine from yarn-applications to top directory...
Sunil G [Sun, 17 Feb 2019 14:33:56 +0000 (20:03 +0530)] 
SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan.

5 days agoHDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Anu Engineer [Sat, 16 Feb 2019 18:23:10 +0000 (10:23 -0800)] 
HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Contributed by Xiaoyu Yao.

6 days agoHDFS-14258. Introduce Java Concurrent Package To DataXceiverServer Class. Contributed...
Inigo Goiri [Sat, 16 Feb 2019 00:32:27 +0000 (16:32 -0800)] 
HDFS-14258. Introduce Java Concurrent Package To DataXceiverServer Class. Contributed by BELUGA BEHR.

6 days agoHDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton...
Elek, Márton [Fri, 15 Feb 2019 19:49:52 +0000 (20:49 +0100)] 
HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek.

6 days agoHDDS-1116.Add java profiler servlet to the Ozone web servers.
Anu Engineer [Fri, 15 Feb 2019 19:32:06 +0000 (11:32 -0800)] 
HDDS-1116.Add java profiler servlet to the Ozone web servers.
Contributed by Elek, Marton.

6 days agoHDDS-1092. Use Java 11 JRE to run Ozone in containers.
Elek, Márton [Fri, 15 Feb 2019 16:26:56 +0000 (17:26 +0100)] 
HDDS-1092. Use Java 11 JRE to run Ozone in containers.

6 days agoYARN-8927. Added support for top level Dockerhub images to trusted registry using...
Eric Yang [Fri, 15 Feb 2019 16:18:07 +0000 (11:18 -0500)] 
YARN-8927. Added support for top level Dockerhub images to trusted registry using library keyword.
           Contributed by Zhankun Tang

6 days agoHDDS-1076. TestSCMNodeManager crashed the jvm. Contributed by Lokesh Jain.
Shashikant Banerjee [Fri, 15 Feb 2019 15:43:30 +0000 (21:13 +0530)] 
HDDS-1076. TestSCMNodeManager crashed the jvm. Contributed by Lokesh Jain.

6 days agoHDDS-1110. OzoneManager need to login during init when security is enabled. Contribut...
Márton Elek [Fri, 15 Feb 2019 15:09:37 +0000 (16:09 +0100)] 
HDDS-1110. OzoneManager need to login during init when security is enabled. Contributed by Xiaoyu Yao.

6 days agoHDDS-1082. OutOfMemoryError because of memory leak in KeyInputStream. Contributed...
Mukul Kumar Singh [Fri, 15 Feb 2019 14:39:15 +0000 (20:09 +0530)] 
HDDS-1082. OutOfMemoryError because of memory leak in KeyInputStream. Contributed by Supratim Deka.

7 days agoYARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong...
Adam Antal [Fri, 15 Feb 2019 08:17:32 +0000 (09:17 +0100)] 
YARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong property name as reference

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
7 days agoHDDS-1028. Improve logging in SCMPipelineManager. Contributed by Lokesh Jain.
Shashikant Banerjee [Fri, 15 Feb 2019 09:08:38 +0000 (14:38 +0530)] 
HDDS-1028. Improve logging in SCMPipelineManager. Contributed by Lokesh Jain.

7 days agoHDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Anu Engineer [Fri, 15 Feb 2019 07:33:25 +0000 (23:33 -0800)] 
HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.

7 days agoHDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
Anu Engineer [Fri, 15 Feb 2019 07:24:58 +0000 (23:24 -0800)] 
HDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
Contributed by Lokesh Jain.

7 days agoHDDS-905. Create informative landing page for Ozone S3 gateway.
Anu Engineer [Fri, 15 Feb 2019 07:16:23 +0000 (23:16 -0800)] 
HDDS-905. Create informative landing page for Ozone S3 gateway.
Contributed by Elek, Marton.

7 days agoYARN-8295. [UI2] Improve Resource Usage tab error message when there are no data...
Sunil G [Fri, 15 Feb 2019 07:12:21 +0000 (12:42 +0530)] 
YARN-8295. [UI2] Improve Resource Usage tab error message when there are no data available. Contributed by Charan Hebri.

7 days agoHDDS-1068. Improve the error propagation for ozone sh.
Anu Engineer [Fri, 15 Feb 2019 06:51:46 +0000 (22:51 -0800)] 
HDDS-1068. Improve the error propagation for ozone sh.
Contributed by Elek, Marton.

7 days agoYARN-9284. Fix the unit of yarn.service.am-resource.memory in the document. Contribut...
Akira Ajisaka [Fri, 15 Feb 2019 06:41:53 +0000 (15:41 +0900)] 
YARN-9284. Fix the unit of yarn.service.am-resource.memory in the document. Contributed by Masahiro Tanaka.

7 days agoHDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat...
Yiqun Lin [Fri, 15 Feb 2019 06:23:34 +0000 (14:23 +0800)] 
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.

7 days agoRevert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by...
Yiqun Lin [Fri, 15 Feb 2019 06:21:29 +0000 (14:21 +0800)] 
Revert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham."

This reverts commit 5656409327db5a590cc29b846d291dad005bf8d0.

7 days agoHDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat...
Yiqun Lin [Fri, 15 Feb 2019 06:07:15 +0000 (14:07 +0800)] 
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.

7 days agoYARN-9308. fairscheduler-statedump.log gets generated regardless of service again...
Akira Ajisaka [Fri, 15 Feb 2019 05:49:49 +0000 (14:49 +0900)] 
YARN-9308. fairscheduler-statedump.log gets generated regardless of service again after the merge of HDFS-7240. Contributed by Wilfred Spiegelenburg.

7 days agoHDDS-1108. Check s3bucket exists or not before MPU operations.
Anu Engineer [Fri, 15 Feb 2019 02:10:18 +0000 (18:10 -0800)] 
HDDS-1108. Check s3bucket exists or not before MPU operations.
Contributed by Bharat Viswanadham.

7 days agoHDDS-1100. fix asf license errors in newly added files by HDDS-936.
Anu Engineer [Fri, 15 Feb 2019 01:42:59 +0000 (17:42 -0800)] 
HDDS-1100. fix asf license errors in newly added files by HDDS-936.
Contributed by  Dinesh Chitlangia.

7 days agoHDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyComb...
Erik Krogen [Fri, 21 Dec 2018 01:49:22 +0000 (17:49 -0800)] 
HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.

7 days agoYARN-9295. [UI2] Fix label typo in Cluster Overview page. Contributed by Charan Hebri.
bibinchundatt [Thu, 14 Feb 2019 17:38:19 +0000 (23:08 +0530)] 
YARN-9295. [UI2] Fix label typo in Cluster Overview page. Contributed by Charan Hebri.

7 days agoYARN-9293. Optimize MockAMLauncher event handling. Contributed by Bibin A Chundatt.
bibinchundatt [Thu, 14 Feb 2019 17:26:52 +0000 (22:56 +0530)] 
YARN-9293. Optimize MockAMLauncher event handling. Contributed by Bibin A Chundatt.

7 days agoHDFS-13209. DistributedFileSystem.create should allow an option to provide StoragePol...
Surendra Singh Lilhore [Thu, 14 Feb 2019 16:43:14 +0000 (22:13 +0530)] 
HDFS-13209. DistributedFileSystem.create should allow an option to provide StoragePolicy. Contributed by Ayush Saxena.

7 days agoHDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative...
Shweta Yakkali [Thu, 14 Feb 2019 08:22:13 +0000 (00:22 -0800)] 
HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali.

8 days agoHDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is...
Márton Elek [Thu, 14 Feb 2019 13:02:16 +0000 (14:02 +0100)] 
HDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is not defined. Contributed by Hanisha Koneru.

8 days agoYARN-7824. [UI2] Yarn Component Instance page should include link to container logs...
Sunil G [Thu, 14 Feb 2019 10:12:19 +0000 (15:42 +0530)] 
YARN-7824. [UI2] Yarn Component Instance page should include link to container logs. Contributed by Akhil PB.

8 days agoHDFS-14241. Provide feedback on successful renameSnapshot and deleteSnapshot. Contrib...
Siyao Meng [Thu, 14 Feb 2019 03:48:02 +0000 (19:48 -0800)] 
HDFS-14241. Provide feedback on successful renameSnapshot and deleteSnapshot. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
8 days agoHDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla
Jitendra Pandey [Wed, 13 Feb 2019 23:43:14 +0000 (15:43 -0800)] 
HDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla

8 days agoHDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by...
Chen Liang [Wed, 13 Feb 2019 20:40:31 +0000 (12:40 -0800)] 
HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang

8 days agoHDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInp...
Surendra Singh Lilhore [Wed, 13 Feb 2019 18:11:27 +0000 (23:41 +0530)] 
HDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream(). Contributed by Surendra Singh Lilhore

8 days agoHDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication...
Surendra Singh Lilhore [Wed, 13 Feb 2019 17:36:46 +0000 (23:06 +0530)] 
HDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication Policy. Contributed by Ayush Saxena.

9 days agoHADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To...
Vinayakumar B [Wed, 13 Feb 2019 03:59:37 +0000 (09:29 +0530)] 
HADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To Save Unnecessary RPC's. Contributed by Ayush Saxena.

9 days agoHDDS-1034. TestOzoneRpcClient and TestOzoneRpcClientWithRatis failure. Contributed...
Bharat Viswanadham [Wed, 13 Feb 2019 06:23:48 +0000 (22:23 -0800)] 
HDDS-1034. TestOzoneRpcClient and TestOzoneRpcClientWithRatis failure. Contributed by Mukul Kumar Singh.

9 days agoHDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.
Bharat Viswanadham [Wed, 13 Feb 2019 06:07:27 +0000 (22:07 -0800)] 
HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.

9 days agoHADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik...
Yiqun Lin [Wed, 13 Feb 2019 03:16:04 +0000 (11:16 +0800)] 
HADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik Krogen.

9 days agoHDDS-1047. Fix TestRatisPipelineProvider#testCreatePipelineWithFactor. Contributed...
Yiqun Lin [Wed, 13 Feb 2019 02:50:57 +0000 (10:50 +0800)] 
HDDS-1047. Fix TestRatisPipelineProvider#testCreatePipelineWithFactor. Contributed by Nilotpal Nandi.

9 days agoYARN-9184. Add a system flag to allow update to latest docker images.
Eric Yang [Tue, 12 Feb 2019 21:16:35 +0000 (16:16 -0500)] 
YARN-9184. Add a system flag to allow update to latest docker images.
           Contributed by Zhaohui Xin

9 days agoHDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available...
Vinayakumar B [Tue, 12 Feb 2019 16:27:57 +0000 (21:57 +0530)] 
HDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available. Contributed by Ayush Saxena.

10 days agoHDDS-1050. TestSCMRestart#testPipelineWithScmRestart is failing. Contributed by Supra...
Mukul Kumar Singh [Tue, 12 Feb 2019 11:03:14 +0000 (16:33 +0530)] 
HDDS-1050. TestSCMRestart#testPipelineWithScmRestart is failing. Contributed by Supratim Deka.

10 days agoHDDS-1080. Ozonefs Isolated class loader should support FsStorageStatistics.
Nanda kumar [Tue, 12 Feb 2019 09:19:51 +0000 (14:49 +0530)] 
HDDS-1080. Ozonefs Isolated class loader should support FsStorageStatistics.
Contributed by Elek, Marton.

10 days agoHDDS-1081. CLOSING state containers should not be added to pipeline on SCM start.
Nanda kumar [Tue, 12 Feb 2019 09:09:08 +0000 (14:39 +0530)] 
HDDS-1081. CLOSING state containers should not be added to pipeline on SCM start.
Contributed by Lokesh Jain.

10 days agoHDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Nanda kumar [Tue, 12 Feb 2019 08:55:14 +0000 (14:25 +0530)] 
HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Contributed by Anu Engineer.

10 days agoHDDS-1074. Remove dead variable from KeyOutputStream#addKeyLocationInfo. Contributed...
Yiqun Lin [Tue, 12 Feb 2019 08:28:50 +0000 (16:28 +0800)] 
HDDS-1074. Remove dead variable from KeyOutputStream#addKeyLocationInfo. Contributed by Siddharth Wagle.

10 days agoHDDS-1012. Add Default CertificateClient implementation. Contributed by Ajay Kumar
Ajay Kumar [Tue, 12 Feb 2019 02:59:47 +0000 (18:59 -0800)] 
HDDS-1012. Add Default CertificateClient implementation. Contributed by Ajay Kumar

10 days agoYARN-996. REST API support for node resource configuration. Contributed by Inigo...
Giovanni Matteo Fumarola [Mon, 11 Feb 2019 23:27:43 +0000 (15:27 -0800)] 
YARN-996. REST API support for node resource configuration. Contributed by Inigo Goiri.

10 days agoYARN-9229. Document docker registry deployment with NFS Gateway. Contributed by Eric...
Suma Shivaprasad [Mon, 11 Feb 2019 22:54:17 +0000 (14:54 -0800)] 
YARN-9229. Document docker registry deployment with NFS Gateway. Contributed by Eric Yang.

10 days agoHADOOP-16098. Fix javadoc warnings in hadoop-aws. Contributed by Masatake Iwasaki.
Masatake Iwasaki [Mon, 11 Feb 2019 21:07:47 +0000 (06:07 +0900)] 
HADOOP-16098. Fix javadoc warnings in hadoop-aws. Contributed by Masatake Iwasaki.

10 days agoHDDS-1075. Fix CertificateUtil#parseRSAPublicKey charsetName. Contributed by Siddhart...
Xiaoyu Yao [Mon, 11 Feb 2019 20:00:36 +0000 (12:00 -0800)] 
HDDS-1075. Fix CertificateUtil#parseRSAPublicKey charsetName. Contributed by Siddharth Wagle.

10 days agoHDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng.
Siyao Meng [Mon, 11 Feb 2019 19:02:32 +0000 (11:02 -0800)] 
HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
10 days agoHDFS-14260. Replace synchronized method in BlockReceiver with atomic value. Contribut...
Inigo Goiri [Mon, 11 Feb 2019 18:09:44 +0000 (10:09 -0800)] 
HDFS-14260. Replace synchronized method in BlockReceiver with atomic value. Contributed by BELUGA BEHR.

10 days agoHDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi.
Mukul Kumar Singh [Mon, 11 Feb 2019 14:38:25 +0000 (20:08 +0530)] 
HDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi.