Weiwei Yang [Fri, 22 Feb 2019 12:58:33 +0000 (20:58 +0800)] 
YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie.
Weiwei Yang [Fri, 22 Feb 2019 03:27:17 +0000 (11:27 +0800)]
YARN-9156. Improve debug message in device plugin method compatibility check of ResourcePluginManager. Contributed by Zhankun Tang.
Elek, Márton [Thu, 21 Feb 2019 21:57:05 +0000 (22:57 +0100)] 
HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton.
Bharat Viswanadham [Thu, 21 Feb 2019 21:29:10 +0000 (13:29 -0800)] 
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.
* fix test failures in TestOzoneConfigurationFields
Wangda Tan [Thu, 21 Feb 2019 19:17:32 +0000 (11:17 -0800)] 
YARN-9319. Fix compilation issue of handling typedef an existing name by gcc compiler. (Zhankun Tang via wangda)
Change-Id: Ie8293cc5b710ff355fb6a1ea7201be53ed0385bf
Weiwei Yang [Thu, 21 Feb 2019 16:18:07 +0000 (00:18 +0800)]
YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph.
Nanda kumar [Thu, 21 Feb 2019 16:07:08 +0000 (21:37 +0530)] 
HDDS-1126. Datanode is trying to qausi-close a container which is already closed.
Signed-off-by: Nanda kumar <nanda@apache.org>
Allen Wittenauer [Sat, 5 Jan 2019 20:14:50 +0000 (12:14 -0800)] 
HADOOP-16035. Jenkinsfile for Hadoop
Signed-off-by: Steve Loughran <stevel@apache.org>
Surendra Singh Lilhore [Thu, 21 Feb 2019 15:06:34 +0000 (20:36 +0530)] 
HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie.
Steve Loughran [Thu, 21 Feb 2019 13:31:20 +0000 (13:31 +0000)] 
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.
Contributed by Steve Loughran.
Márton Elek [Mon, 18 Feb 2019 17:39:57 +0000 (18:39 +0100)] 
HDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton.
Weiwei Yang [Thu, 21 Feb 2019 09:21:21 +0000 (17:21 +0800)]
YARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu Joseph.
bibinchundatt [Thu, 21 Feb 2019 07:59:01 +0000 (13:29 +0530)] 
YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph.
Daryn Sharp [Thu, 21 Feb 2019 02:13:53 +0000 (18:13 -0800)] 
HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Shweta Yakkali [Wed, 20 Feb 2019 23:36:14 +0000 (15:36 -0800)] 
HDFS-14273. Fix checkstyle issues in BlockLocation's method javadoc
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I546aa4a0fe7f83b53735acd9925f366b2f1a00e2
Hanisha Koneru [Wed, 20 Feb 2019 22:49:59 +0000 (14:49 -0800)] 
HDDS-1109. Setup Failover Proxy Provider for OM client.
Shweta Yakkali [Wed, 20 Feb 2019 22:28:37 +0000 (14:28 -0800)]
HDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta Yakkali.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Inigo Goiri [Wed, 20 Feb 2019 21:55:13 +0000 (13:55 -0800)] 
HDFS-14302. Refactor NameNodeWebHdfsMethods#generateDelegationToken() to allow better extensibility. Contributed by CR Hota.
Arpit Agarwal [Wed, 20 Feb 2019 20:57:49 +0000 (12:57 -0800)] 
HDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan.
Sahil Takiar [Wed, 20 Feb 2019 19:36:37 +0000 (11:36 -0800)] 
HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Xiaoyu Yao [Wed, 20 Feb 2019 19:11:36 +0000 (11:11 -0800)] 
HDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar.
Masatake Iwasaki [Wed, 20 Feb 2019 13:00:57 +0000 (22:00 +0900)] 
HADOOP-16104. Wasb tests to downgrade to skip when test a/c is namespace enabled. Contributed by Masatake Iwasaki.
Surendra Singh Lilhore [Wed, 20 Feb 2019 11:26:10 +0000 (16:56 +0530)]
HDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDetectionDaemon. Contributed by Ranith Sardar.
Márton Elek [Wed, 20 Feb 2019 11:08:24 +0000 (12:08 +0100)]
HDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh Chitlangia.
Yiqun Lin [Wed, 20 Feb 2019 02:45:51 +0000 (10:45 +0800)] 
HDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain.
Bharat Viswanadham [Wed, 20 Feb 2019 01:01:07 +0000 (17:01 -0800)]
Logging stale datanode information. Contributed by Karthik Palanisamy.
avijayanhwx [Wed, 20 Feb 2019 00:32:47 +0000 (16:32 -0800)] 
HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.
George Huang [Tue, 19 Feb 2019 23:23:42 +0000 (15:23 -0800)] 
HADOOP-15967. KMS Benchmark Tool. Contributed by George Huang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Kitti Nanasi [Tue, 19 Feb 2019 20:04:56 +0000 (12:04 -0800)] 
HDFS-14188. Make hdfs ec -verifyClusterSetup command accept an erasure coding policy as a parameter. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
bibinchundatt [Tue, 19 Feb 2019 19:49:20 +0000 (01:19 +0530)]
YARN-9286. [Timeline Server] Sorting based on FinalStatus shows pop-up message. Contributed by Bilwa S T.
Anu Engineer [Tue, 19 Feb 2019 18:55:33 +0000 (10:55 -0800)] 
HDDS-1121. Key read failure when data is written parallel in to Ozone.
Contributed by Bharat Viswanadham.
bibinchundatt [Tue, 19 Feb 2019 19:06:57 +0000 (00:36 +0530)]
YARN-9309. Improve graph text in SLS to avoid overlapping. Contributed by Bilwa S T.
Xiaoyu Yao [Tue, 19 Feb 2019 18:42:56 +0000 (10:42 -0800)]
HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer.
Adam Antal [Tue, 19 Feb 2019 11:33:02 +0000 (11:33 +0000)] 
HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not-found.
Contributed by Adam Antal.
(Revised patch applied after stevel committed the wrong one; that has been reverted)
Anu Engineer [Tue, 19 Feb 2019 06:35:36 +0000 (22:35 -0800)]
HDDS-1085. Create an OM API to serve snapshots to Recon server.
Contributed by Aravindan Vijayan.
Yiqun Lin [Tue, 19 Feb 2019 03:29:52 +0000 (11:29 +0800)]
HDDS-1122. Fix TestOzoneManagerRatisServer#testSubmitRatisRequest unit test failure. Contributed by Yiqun Lin.
Inigo Goiri [Tue, 19 Feb 2019 01:55:43 +0000 (17:55 -0800)]
HDFS-14296. Prefer ArrayList over LinkedList in VolumeScanner. Contributed by BELUGA BEHR.
Inigo Goiri [Mon, 18 Feb 2019 23:30:38 +0000 (15:30 -0800)]
HDFS-9596. Remove Shuffle Method From DFSUtil. Contributed by BELUGA BEHR.
Inigo Goiri [Mon, 18 Feb 2019 19:00:04 +0000 (11:00 -0800)]
HDFS-14287. DataXceiverServer May Double-Close PeerServer. Contributed by BELUGA BEHR.
Steve Loughran [Mon, 18 Feb 2019 14:57:22 +0000 (14:57 +0000)]
Revert "HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not-found."
This reverts commit
c4a00d1ad3d3cfc02a6a4e1e04353678f2d588e1.
Yiqun Lin [Mon, 18 Feb 2019 14:35:23 +0000 (22:35 +0800)]
HDDS-1106. Introduce queryMap in PipelineManager. Contributed by Lokesh Jain.
Sunil G [Mon, 18 Feb 2019 10:27:11 +0000 (15:57 +0530)] 
YARN-9060. [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example. Contributed by Zhankun Tang.
Akira Ajisaka [Mon, 18 Feb 2019 06:21:46 +0000 (15:21 +0900)] 
HADOOP-16116. Fix Spelling Mistakes - DECOMISSIONED. Contributed by BELUGA BEHR.
Sunil G [Sun, 17 Feb 2019 14:38:20 +0000 (20:08 +0530)]
YARN-9213. RM Web UI v1 does not show custom resource allocations for containers page. Contributed by Szilard Nemeth.
Sunil G [Sun, 17 Feb 2019 14:33:56 +0000 (20:03 +0530)]
SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan.
Anu Engineer [Sat, 16 Feb 2019 18:23:10 +0000 (10:23 -0800)]
HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Contributed by Xiaoyu Yao.
Inigo Goiri [Sat, 16 Feb 2019 00:32:27 +0000 (16:32 -0800)]
HDFS-14258. Introduce Java Concurrent Package To DataXceiverServer Class. Contributed by BELUGA BEHR.
Elek, Márton [Fri, 15 Feb 2019 19:49:52 +0000 (20:49 +0100)]
HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek.
Anu Engineer [Fri, 15 Feb 2019 19:32:06 +0000 (11:32 -0800)]
HDDS-1116.Add java profiler servlet to the Ozone web servers.
Contributed by Elek, Marton.
Elek, Márton [Fri, 15 Feb 2019 16:26:56 +0000 (17:26 +0100)]
HDDS-1092. Use Java 11 JRE to run Ozone in containers.
Eric Yang [Fri, 15 Feb 2019 16:18:07 +0000 (11:18 -0500)] 
YARN-8927. Added support for top level Dockerhub images to trusted registry using library keyword.
Contributed by Zhankun Tang
Shashikant Banerjee [Fri, 15 Feb 2019 15:43:30 +0000 (21:13 +0530)] 
HDDS-1076. TestSCMNodeManager crashed the jvm. Contributed by Lokesh Jain.
Márton Elek [Fri, 15 Feb 2019 15:09:37 +0000 (16:09 +0100)]
HDDS-1110. OzoneManager need to login during init when security is enabled. Contributed by Xiaoyu Yao.
Mukul Kumar Singh [Fri, 15 Feb 2019 14:39:15 +0000 (20:09 +0530)] 
HDDS-1082. OutOfMemoryError because of memory leak in KeyInputStream. Contributed by Supratim Deka.
Adam Antal [Fri, 15 Feb 2019 08:17:32 +0000 (09:17 +0100)]
YARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong property name as reference
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Shashikant Banerjee [Fri, 15 Feb 2019 09:08:38 +0000 (14:38 +0530)]
HDDS-1028. Improve logging in SCMPipelineManager. Contributed by Lokesh Jain.
Anu Engineer [Fri, 15 Feb 2019 07:33:25 +0000 (23:33 -0800)]
HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
Anu Engineer [Fri, 15 Feb 2019 07:24:58 +0000 (23:24 -0800)]
HDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
Contributed by Lokesh Jain.
Anu Engineer [Fri, 15 Feb 2019 07:16:23 +0000 (23:16 -0800)]
HDDS-905. Create informative landing page for Ozone S3 gateway.
Contributed by Elek, Marton.
Sunil G [Fri, 15 Feb 2019 07:12:21 +0000 (12:42 +0530)]
YARN-8295. [UI2] Improve Resource Usage tab error message when there are no data available. Contributed by Charan Hebri.
Anu Engineer [Fri, 15 Feb 2019 06:51:46 +0000 (22:51 -0800)]
HDDS-1068. Improve the error propagation for ozone sh.
Contributed by Elek, Marton.
Akira Ajisaka [Fri, 15 Feb 2019 06:41:53 +0000 (15:41 +0900)]
YARN-9284. Fix the unit of yarn.service.am-resource.memory in the document. Contributed by Masahiro Tanaka.
Yiqun Lin [Fri, 15 Feb 2019 06:23:34 +0000 (14:23 +0800)]
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.
Yiqun Lin [Fri, 15 Feb 2019 06:21:29 +0000 (14:21 +0800)]
Revert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham."
This reverts commit
5656409327db5a590cc29b846d291dad005bf8d0.
Yiqun Lin [Fri, 15 Feb 2019 06:07:15 +0000 (14:07 +0800)]
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.
Akira Ajisaka [Fri, 15 Feb 2019 05:49:49 +0000 (14:49 +0900)]
YARN-9308. fairscheduler-statedump.log gets generated regardless of service again after the merge of HDFS-7240. Contributed by Wilfred Spiegelenburg.
Anu Engineer [Fri, 15 Feb 2019 02:10:18 +0000 (18:10 -0800)]
HDDS-1108. Check s3bucket exists or not before MPU operations.
Contributed by Bharat Viswanadham.
Anu Engineer [Fri, 15 Feb 2019 01:42:59 +0000 (17:42 -0800)]
HDDS-1100. fix asf license errors in newly added files by HDDS-936.
Contributed by Dinesh Chitlangia.
Erik Krogen [Fri, 21 Dec 2018 01:49:22 +0000 (17:49 -0800)] 
HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.
bibinchundatt [Thu, 14 Feb 2019 17:38:19 +0000 (23:08 +0530)]
YARN-9295. [UI2] Fix label typo in Cluster Overview page. Contributed by Charan Hebri.
bibinchundatt [Thu, 14 Feb 2019 17:26:52 +0000 (22:56 +0530)]
YARN-9293. Optimize MockAMLauncher event handling. Contributed by Bibin A Chundatt.
Surendra Singh Lilhore [Thu, 14 Feb 2019 16:43:14 +0000 (22:13 +0530)]
HDFS-13209. DistributedFileSystem.create should allow an option to provide StoragePolicy. Contributed by Ayush Saxena.
Shweta Yakkali [Thu, 14 Feb 2019 08:22:13 +0000 (00:22 -0800)]
HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali.
Márton Elek [Thu, 14 Feb 2019 13:02:16 +0000 (14:02 +0100)]
HDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is not defined. Contributed by Hanisha Koneru.
Sunil G [Thu, 14 Feb 2019 10:12:19 +0000 (15:42 +0530)]
YARN-7824. [UI2] Yarn Component Instance page should include link to container logs. Contributed by Akhil PB.
Siyao Meng [Thu, 14 Feb 2019 03:48:02 +0000 (19:48 -0800)] 
HDFS-14241. Provide feedback on successful renameSnapshot and deleteSnapshot. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Jitendra Pandey [Wed, 13 Feb 2019 23:43:14 +0000 (15:43 -0800)] 
HDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla
Chen Liang [Wed, 13 Feb 2019 20:40:31 +0000 (12:40 -0800)] 
HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang
Surendra Singh Lilhore [Wed, 13 Feb 2019 18:11:27 +0000 (23:41 +0530)]
HDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream(). Contributed by Surendra Singh Lilhore
Surendra Singh Lilhore [Wed, 13 Feb 2019 17:36:46 +0000 (23:06 +0530)]
HDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication Policy. Contributed by Ayush Saxena.
Vinayakumar B [Wed, 13 Feb 2019 03:59:37 +0000 (09:29 +0530)] 
HADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To Save Unnecessary RPC's. Contributed by Ayush Saxena.
Bharat Viswanadham [Wed, 13 Feb 2019 06:23:48 +0000 (22:23 -0800)]
HDDS-1034. TestOzoneRpcClient and TestOzoneRpcClientWithRatis failure. Contributed by Mukul Kumar Singh.
Bharat Viswanadham [Wed, 13 Feb 2019 06:07:27 +0000 (22:07 -0800)]
HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.
Yiqun Lin [Wed, 13 Feb 2019 03:16:04 +0000 (11:16 +0800)]
HADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik Krogen.
Yiqun Lin [Wed, 13 Feb 2019 02:50:57 +0000 (10:50 +0800)]
HDDS-1047. Fix TestRatisPipelineProvider#testCreatePipelineWithFactor. Contributed by Nilotpal Nandi.
Eric Yang [Tue, 12 Feb 2019 21:16:35 +0000 (16:16 -0500)]
YARN-9184. Add a system flag to allow update to latest docker images.
Contributed by Zhaohui Xin
Vinayakumar B [Tue, 12 Feb 2019 16:27:57 +0000 (21:57 +0530)]
HDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available. Contributed by Ayush Saxena.
Mukul Kumar Singh [Tue, 12 Feb 2019 11:03:14 +0000 (16:33 +0530)]
HDDS-1050. TestSCMRestart#testPipelineWithScmRestart is failing. Contributed by Supratim Deka.
Nanda kumar [Tue, 12 Feb 2019 09:19:51 +0000 (14:49 +0530)]
HDDS-1080. Ozonefs Isolated class loader should support FsStorageStatistics.
Contributed by Elek, Marton.
Nanda kumar [Tue, 12 Feb 2019 09:09:08 +0000 (14:39 +0530)]
HDDS-1081. CLOSING state containers should not be added to pipeline on SCM start.
Contributed by Lokesh Jain.
Nanda kumar [Tue, 12 Feb 2019 08:55:14 +0000 (14:25 +0530)]
HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Contributed by Anu Engineer.
Yiqun Lin [Tue, 12 Feb 2019 08:28:50 +0000 (16:28 +0800)]
HDDS-1074. Remove dead variable from KeyOutputStream#addKeyLocationInfo. Contributed by Siddharth Wagle.
Ajay Kumar [Tue, 12 Feb 2019 02:59:47 +0000 (18:59 -0800)] 
HDDS-1012. Add Default CertificateClient implementation. Contributed by Ajay Kumar
Giovanni Matteo Fumarola [Mon, 11 Feb 2019 23:27:43 +0000 (15:27 -0800)] 
YARN-996. REST API support for node resource configuration. Contributed by Inigo Goiri.
Suma Shivaprasad [Mon, 11 Feb 2019 22:54:17 +0000 (14:54 -0800)] 
YARN-9229. Document docker registry deployment with NFS Gateway. Contributed by Eric Yang.
Masatake Iwasaki [Mon, 11 Feb 2019 21:07:47 +0000 (06:07 +0900)]
HADOOP-16098. Fix javadoc warnings in hadoop-aws. Contributed by Masatake Iwasaki.
Xiaoyu Yao [Mon, 11 Feb 2019 20:00:36 +0000 (12:00 -0800)]
HDDS-1075. Fix CertificateUtil#parseRSAPublicKey charsetName. Contributed by Siddharth Wagle.
Siyao Meng [Mon, 11 Feb 2019 19:02:32 +0000 (11:02 -0800)]
HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Inigo Goiri [Mon, 11 Feb 2019 18:09:44 +0000 (10:09 -0800)]
HDFS-14260. Replace synchronized method in BlockReceiver with atomic value. Contributed by BELUGA BEHR.
Mukul Kumar Singh [Mon, 11 Feb 2019 14:38:25 +0000 (20:08 +0530)]
HDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi.
projects / hadoop.git / log
