hadoop.git
3 hours agoYARN-9203. Fix typos in yarn-default.xml. trunk
rahul3 [Fri, 9 Nov 2018 02:27:06 +0000 (21:27 -0500)] 
YARN-9203. Fix typos in yarn-default.xml.

This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
9 hours agoHDDS-971. ContainerDataConstructor throws exception on QUASI_CLOSED and UNHEALTHY...
Bharat Viswanadham [Thu, 17 Jan 2019 01:43:30 +0000 (17:43 -0800)] 
HDDS-971. ContainerDataConstructor throws exception on QUASI_CLOSED and UNHEALTHY container state. Contributed by Lokesh Jain.

9 hours agoHDDS-898. Continue token should contain the previous dir in Ozone s3g object list...
Bharat Viswanadham [Thu, 17 Jan 2019 01:32:59 +0000 (17:32 -0800)] 
HDDS-898. Continue token should contain the previous dir in Ozone s3g object list. Contributed by Elek Marton.

16 hours agoHDFS-14192. Track missing DFS operations in Statistics and StorageStatistics. Contrib...
Inigo Goiri [Wed, 16 Jan 2019 18:14:22 +0000 (10:14 -0800)] 
HDFS-14192. Track missing DFS operations in Statistics and StorageStatistics. Contributed by Ayush Saxena.

29 hours agoYARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone...
Akira Ajisaka [Wed, 16 Jan 2019 05:35:07 +0000 (14:35 +0900)] 
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma.

29 hours agoYARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema...
Vrushali C [Wed, 16 Jan 2019 05:28:10 +0000 (21:28 -0800)] 
YARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2. Contributed by Sushil Ks

29 hours agoYARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema...
Vrushali C [Wed, 16 Jan 2019 05:25:37 +0000 (21:25 -0800)] 
YARN-9150 Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2. Contributed by Sushil Ks

33 hours agoHADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma.
Akira Ajisaka [Wed, 16 Jan 2019 01:28:08 +0000 (10:28 +0900)] 
HADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma.

35 hours agoHDDS-978. Fix typo in doc : Client > S3 section. Contributed by Dinesh Chitlangia.
Bharat Viswanadham [Tue, 15 Jan 2019 23:11:16 +0000 (15:11 -0800)] 
HDDS-978. Fix typo in doc : Client > S3 section. Contributed by  Dinesh Chitlangia.

45 hours agoHADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured...
luhuachao [Tue, 15 Jan 2019 13:15:18 +0000 (13:15 +0000)] 
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.

Contributed by luhuachao.

2 days agoYARN-9179. Fix NPE in AbstractYarnScheduler#updateNewContainerInfo.
Akira Ajisaka [Tue, 15 Jan 2019 03:59:59 +0000 (12:59 +0900)] 
YARN-9179. Fix NPE in AbstractYarnScheduler#updateNewContainerInfo.

2 days agoHDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check. Contributed by...
Márton Elek [Fri, 11 Jan 2019 09:33:29 +0000 (10:33 +0100)] 
HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check. Contributed by Elek, Marton.

2 days agoHADOOP-16044. ABFS: Better exception handling of DNS errors followup 185/head
Da Zhou [Mon, 14 Jan 2019 19:32:56 +0000 (19:32 +0000)] 
HADOOP-16044. ABFS: Better exception handling of DNS errors followup

Contributed by Da Zhou.

2 days agoHADOOP-14556. S3A to support Delegation Tokens.
Steve Loughran [Mon, 14 Jan 2019 17:59:27 +0000 (17:59 +0000)] 
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran and Daryn Sharp.

2 days agoHADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not...
Adam Antal [Mon, 14 Jan 2019 17:27:00 +0000 (17:27 +0000)] 
HADOOP-15843. s3guard bucket-info command to not print a stack trace on bucket-not-found.

Contributed by Adam Antal.

2 days agoHADOOP-16043. NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is...
Gabor Bota [Mon, 14 Jan 2019 13:12:05 +0000 (13:12 +0000)] 
HADOOP-16043. NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set.

Contributed by Gabor Bota.

5 days agoHADOOP-15994. Upgrade Jackson2 to 2.9.8. Contributed by lqjacklee.
Akira Ajisaka [Sat, 12 Jan 2019 06:23:49 +0000 (15:23 +0900)] 
HADOOP-15994. Upgrade Jackson2 to 2.9.8. Contributed by lqjacklee.

5 days agoHADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.
Inigo Goiri [Sat, 12 Jan 2019 02:07:19 +0000 (18:07 -0800)] 
HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.

5 days agoHADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.
Chen Liang [Fri, 11 Jan 2019 22:01:23 +0000 (14:01 -0800)] 
HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.

5 days agoHADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed...
Chen Liang [Fri, 11 Jan 2019 20:51:07 +0000 (12:51 -0800)] 
HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.

5 days agoHADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush...
Giovanni Matteo Fumarola [Fri, 11 Jan 2019 18:54:49 +0000 (10:54 -0800)] 
HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena.

5 days agoHDDS-947. Implement OzoneManager State Machine.
Hanisha Koneru [Fri, 11 Jan 2019 18:06:05 +0000 (10:06 -0800)] 
HDDS-947. Implement OzoneManager State Machine.

5 days agoHADOOP-15975. ABFS: remove timeout check for DELETE and RENAME.
Da Zhou [Fri, 11 Jan 2019 11:13:41 +0000 (11:13 +0000)] 
HADOOP-15975. ABFS: remove timeout check for DELETE and RENAME.

Contributed by Da Zhou.

(cherry picked from commit 8b5fbe7a125f9d08cbb9f5e5ae28dc984e0d73d8)

6 days agoHDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contrib...
Surendra Singh Lilhore [Fri, 11 Jan 2019 09:06:55 +0000 (14:36 +0530)] 
HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena.

6 days agoHADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
Akira Ajisaka [Mon, 7 Jan 2019 02:58:20 +0000 (11:58 +0900)] 
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper

6 days agoHADOOP-15909. KeyProvider class should implement Closeable. Contributed
Kihwal Lee [Thu, 10 Jan 2019 19:21:37 +0000 (13:21 -0600)] 
HADOOP-15909. KeyProvider class should implement Closeable. Contributed
by Kuhu Shukla.

6 days agoHADOOP-16036. WASB: Disable jetty logging configuration announcement.
Da Zhou [Thu, 10 Jan 2019 12:07:09 +0000 (12:07 +0000)] 
HADOOP-16036. WASB: Disable jetty logging configuration announcement.

Contributed by Da Zhou.

6 days agoHADOOP-15662. Better exception handling of DNS errors.
Da Zhou [Thu, 10 Jan 2019 12:02:58 +0000 (12:02 +0000)] 
HADOOP-15662. Better exception handling of DNS errors.

Contributed by Da Zhou.

6 days agoHADOOP-16040. ABFS: Bug fix for tolerateOobAppends configuration.
Da Zhou [Thu, 10 Jan 2019 11:58:39 +0000 (11:58 +0000)] 
HADOOP-16040. ABFS: Bug fix for tolerateOobAppends configuration.

Contributed by Da Zhou.

7 days agoHDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to...
Bharat Viswanadham [Thu, 10 Jan 2019 04:02:36 +0000 (20:02 -0800)] 
HDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to BlockInputStream. Contributed by  Shashikant Banerjee.

7 days agoRevert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
Jason Lowe [Wed, 9 Jan 2019 23:24:58 +0000 (17:24 -0600)] 
Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."

This reverts commit ecdeaa7e6ad43555031aed032e6ba7a14a17d7bc.

7 days agoRevert "HDDS-947. Implement OzoneManager State Machine."
Hanisha Koneru [Wed, 9 Jan 2019 19:20:57 +0000 (11:20 -0800)] 
Revert "HDDS-947. Implement OzoneManager State Machine."

This reverts commit 8dd11a15777ec206dbb3889d12bc1e196415f8d6.

7 days agoHDDS-947. Implement OzoneManager State Machine.
Hanisha Koneru [Wed, 9 Jan 2019 18:57:24 +0000 (10:57 -0800)] 
HDDS-947. Implement OzoneManager State Machine.

7 days agoHADOOP-16027. [DOC] Effective use of FS instances during S3A integration tests. Contr...
Sean Mackrory [Wed, 9 Jan 2019 17:57:58 +0000 (10:57 -0700)] 
HADOOP-16027. [DOC] Effective use of FS instances during S3A integration tests. Contributed by Gabor Bota.

8 days agoHADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible.
Takanobu Asanuma [Wed, 9 Jan 2019 04:55:25 +0000 (13:55 +0900)] 
HADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible.

8 days agoHDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or...
shwetayakkali@cloudera.com [Wed, 9 Jan 2019 01:04:10 +0000 (17:04 -0800)] 
HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped
(Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8

8 days agoYARN-6523. Optimize system credentials sent in node heartbeat responses. Contributed...
Jason Lowe [Tue, 8 Jan 2019 22:51:06 +0000 (16:51 -0600)] 
YARN-6523. Optimize system credentials sent in node heartbeat responses. Contributed by Manikandan R

8 days agoHDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by...
Márton Elek [Tue, 8 Jan 2019 20:53:37 +0000 (21:53 +0100)] 
HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton.

8 days agoHDFS-14189. Fix intermittent failure of TestNameNodeMetrics. Contributed by Ayush...
Giovanni Matteo Fumarola [Tue, 8 Jan 2019 18:38:06 +0000 (10:38 -0800)] 
HDFS-14189. Fix intermittent failure of TestNameNodeMetrics. Contributed by Ayush Saxena.

8 days agoHDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bhara...
Márton Elek [Tue, 8 Jan 2019 14:48:48 +0000 (15:48 +0100)] 
HDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bharat Viswanadham.

8 days agoHDDS-969. Fix TestOzoneManagerRatisServer test failure. Contributed by Bharat Viswana...
Márton Elek [Tue, 8 Jan 2019 14:12:08 +0000 (15:12 +0100)] 
HDDS-969. Fix TestOzoneManagerRatisServer test failure. Contributed by Bharat Viswanadham.

8 days agoHDDS-968. Fix TestObjectPut failures. Contributed by Bharat Viswanadham.
Márton Elek [Tue, 8 Jan 2019 13:54:38 +0000 (14:54 +0100)] 
HDDS-968. Fix TestObjectPut failures. Contributed by Bharat Viswanadham.

8 days agoHADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.
Kai Xie [Tue, 8 Jan 2019 11:56:48 +0000 (11:56 +0000)] 
HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.

Contributed by Kai Xie.

9 days agoYARN-9037. [CSI] Ignore volume resource in resource calculators based on tags. Contri...
Weiwei Yang [Tue, 8 Jan 2019 06:30:53 +0000 (14:30 +0800)] 
YARN-9037. [CSI] Ignore volume resource in resource calculators based on tags. Contributed by Sunil Govindan.

9 days agoHDDS-926. Use Timeout rule for the the test methods in TestOzoneManager. Contributed...
Bharat Viswanadham [Tue, 8 Jan 2019 06:04:06 +0000 (22:04 -0800)] 
HDDS-926. Use Timeout rule for the the test methods in TestOzoneManager. Contributed by Dinesh Chitlangia.

9 days agoRevert "HADOOP-14556. S3A to support Delegation Tokens."
Akira Ajisaka [Tue, 8 Jan 2019 05:51:30 +0000 (14:51 +0900)] 
Revert "HADOOP-14556. S3A to support Delegation Tokens."

This reverts commit d7152332b32a575c3a92e3f4c44b95e58462528d.

9 days agoYARN-9169. Add metrics for queued opportunistic and guaranteed containers. Contribute...
Giovanni Matteo Fumarola [Mon, 7 Jan 2019 23:16:55 +0000 (15:16 -0800)] 
YARN-9169. Add metrics for queued opportunistic and guaranteed containers. Contributed by Abhishek Modi.

9 days agoHDDS-931. Add documentation for ozone shell command providing ozone mapping for a...
Anu Engineer [Mon, 7 Jan 2019 21:06:45 +0000 (13:06 -0800)] 
HDDS-931. Add documentation for ozone shell command providing ozone mapping for a S3Bucket.
Contributed by Bharat Viswanadham.

9 days agoYARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda)
Wangda Tan [Mon, 7 Jan 2019 20:07:26 +0000 (12:07 -0800)] 
YARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda)

Change-Id: Id8af27134d3286a7a10d85eda9be25df9689d0e7

9 days agoHDDS-946. AuditParser - insert audit to database in batches.
Anu Engineer [Mon, 7 Jan 2019 19:19:42 +0000 (11:19 -0800)] 
HDDS-946. AuditParser - insert audit to database in batches.
contributed by Dinesh Chitlangia.

9 days agoHDDS-930. Multipart Upload: Abort multiupload request. Contributed by Bharat Viswanadham.
Bharat Viswanadham [Mon, 7 Jan 2019 19:09:14 +0000 (11:09 -0800)] 
HDDS-930. Multipart Upload: Abort multiupload request. Contributed by Bharat Viswanadham.

9 days agoHADOOP-16031. Fixed TestSecureLogins unit test. Contributed by Akira Ajisaka
Eric Yang [Mon, 7 Jan 2019 18:21:14 +0000 (13:21 -0500)] 
HADOOP-16031.  Fixed TestSecureLogins unit test.  Contributed by Akira Ajisaka

9 days agoHADOOP-14556. S3A to support Delegation Tokens.
Steve Loughran [Mon, 7 Jan 2019 13:18:03 +0000 (13:18 +0000)] 
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran.

9 days agoHDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat...
Márton Elek [Mon, 7 Jan 2019 11:39:46 +0000 (12:39 +0100)] 
HDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat Viswanadham.

10 days agoHDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bhara... HDDS-901
Márton Elek [Mon, 7 Jan 2019 11:06:22 +0000 (12:06 +0100)] 
HDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bharat Viswanadham.

10 days agoHDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat...
Márton Elek [Mon, 7 Jan 2019 09:42:04 +0000 (10:42 +0100)] 
HDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat Viswanadham.

10 days agoHADOOP-15937. [JDK 11] Update maven-shade-plugin.version to 3.2.1. Contributed by...
Akira Ajisaka [Mon, 7 Jan 2019 10:17:23 +0000 (19:17 +0900)] 
HADOOP-15937. [JDK 11] Update maven-shade-plugin.version to 3.2.1. Contributed by Dinesh Chitlangia.

10 days agoYARN-9162. Fix TestRMAdminCLI#testHelp. Contributed by Ayush Saxena.
Akira Ajisaka [Mon, 7 Jan 2019 08:32:28 +0000 (17:32 +0900)] 
YARN-9162. Fix TestRMAdminCLI#testHelp. Contributed by Ayush Saxena.

10 days agoYARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed...
Weiwei Yang [Mon, 7 Jan 2019 07:57:31 +0000 (15:57 +0800)] 
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg.

10 days agoHADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu.
Weiwei Yang [Mon, 7 Jan 2019 07:56:49 +0000 (15:56 +0800)] 
HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu.

10 days agoRevert "YARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhish...
Weiwei Yang [Mon, 7 Jan 2019 00:58:09 +0000 (08:58 +0800)] 
Revert "YARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhishek Modi."

This reverts commit 650b9cbe168da00966bebbe6fbdee5c1a9dbabb0.

10 days agoYARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using...
Wangda Tan [Sun, 6 Jan 2019 18:25:35 +0000 (10:25 -0800)] 
YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda)

Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8

10 days agoYARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock....
Wangda Tan [Sun, 6 Jan 2019 18:24:29 +0000 (10:24 -0800)] 
YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)

Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519

11 days agoYARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhishek Modi.
Weiwei Yang [Sun, 6 Jan 2019 03:29:59 +0000 (11:29 +0800)] 
YARN-9178. TestRMAdminCli#testHelp is failing in trunk. Contributed by Abhishek Modi.

12 days agoRevert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by...
Sunil G [Fri, 4 Jan 2019 15:05:17 +0000 (20:35 +0530)] 
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."

This reverts commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb059fc204ed35bc0e264c42dd3a9fe9.

12 days agoHDDS-915. Submit client request to OM Ratis server.
Anu Engineer [Fri, 4 Jan 2019 23:25:26 +0000 (15:25 -0800)] 
HDDS-915. Submit client request to OM Ratis server.
Contributed by Hanisha Koneru.

12 days agoHADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
Eric Yang [Fri, 4 Jan 2019 22:48:18 +0000 (17:48 -0500)] 
HADOOP-15996.  Improved Kerberos username mapping strategy in Hadoop.
               Contributed by Bolke de Bruin

12 days agoYARN-9166. Fix logging for preemption of Opportunistic containers for Guaranteed...
Giovanni Matteo Fumarola [Fri, 4 Jan 2019 19:16:41 +0000 (11:16 -0800)] 
YARN-9166. Fix logging for preemption of Opportunistic containers for Guaranteed containers. Contributed by Abhishek Modi.

12 days agoHADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes...
Inigo Goiri [Fri, 4 Jan 2019 17:55:09 +0000 (09:55 -0800)] 
HADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes. Contributed by Sihai Ke.

12 days agoHDDS-896. Handle over replicated containers in SCM.
Anu Engineer [Fri, 4 Jan 2019 17:04:10 +0000 (09:04 -0800)] 
HDDS-896. Handle over replicated containers in SCM.
Contributed by Nandakumar.

12 days agoHADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu...
Sunil G [Fri, 4 Jan 2019 16:19:06 +0000 (21:49 +0530)] 
HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.

13 days agoYARN-6149. Allow port range to be specified while starting NM Timeline collector...
Rohith Sharma K S [Fri, 4 Jan 2019 08:37:02 +0000 (14:07 +0530)] 
YARN-6149. Allow port range to be specified while starting NM Timeline collector manager. Contributed by Abhishek Modi.

13 days agoYARN-8567. Fetching yarn logs fails for long running application if it is not present...
Rohith Sharma K S [Fri, 4 Jan 2019 08:31:24 +0000 (14:01 +0530)] 
YARN-8567. Fetching yarn logs fails for long running application if it is not present in timeline store. Contributed by Tarun Parimi.

13 days agoYARN-9038. [CSI] Add ability to publish/unpublish volumes on node managers. Contribut...
Sunil G [Fri, 4 Jan 2019 06:40:00 +0000 (12:10 +0530)] 
YARN-9038. [CSI] Add ability to publish/unpublish volumes on node managers. Contributed by Weiwei Yang.

13 days agoYARN-9147. Rmove auxiliary services when manifest file is removed.
Eric Yang [Thu, 3 Jan 2019 17:54:16 +0000 (12:54 -0500)] 
YARN-9147. Rmove auxiliary services when manifest file is removed.
           Contributed by Billie Rinaldi

13 days agoHDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
Pranay Singh [Thu, 3 Jan 2019 17:55:00 +0000 (09:55 -0800)] 
HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
13 days agoHDDS-957. Replace incorrect use of system property user.name.
Anu Engineer [Thu, 3 Jan 2019 17:43:26 +0000 (09:43 -0800)] 
HDDS-957. Replace incorrect use of system property user.name.
Contributed by Dinesh Chitlangia.

13 days agoYARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabl...
Weiwei Yang [Thu, 3 Jan 2019 15:56:28 +0000 (23:56 +0800)] 
YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie.

13 days agoHADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore...
Weiwei Yang [Thu, 3 Jan 2019 13:25:52 +0000 (21:25 +0800)] 
HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu.

13 days agoHDFS-14163. Debug Admin Command Should Support Generic Options. Contributed by Ayush...
Surendra Singh Lilhore [Thu, 3 Jan 2019 13:28:03 +0000 (18:58 +0530)] 
HDFS-14163. Debug Admin Command Should Support Generic Options. Contributed by Ayush Saxena.

13 days agoHDFS-14184. [SPS] Add support for URI based path in satisfystoragepolicy command...
Surendra Singh Lilhore [Thu, 3 Jan 2019 13:06:53 +0000 (18:36 +0530)] 
HDFS-14184. [SPS] Add support for URI based path in satisfystoragepolicy command. Contributed by Ayush Saxena.

2 weeks agoHADOOP-16025. Update the year to 2019.
Ayush Saxena [Wed, 2 Jan 2019 22:24:01 +0000 (22:24 +0000)] 
HADOOP-16025. Update the year to 2019.

Contributed by Ayush Saxena.

2 weeks agoHDDS-393. Audit Parser tool for processing ozone audit logs.
Anu Engineer [Wed, 2 Jan 2019 19:52:12 +0000 (11:52 -0800)] 
HDDS-393. Audit Parser tool for processing ozone audit logs.
Contributed by Dinesh Chitlangia.

2 weeks agoHDDS-482. NullPointer exception thrown on console when cli operation failed.
Anu Engineer [Wed, 2 Jan 2019 19:30:54 +0000 (11:30 -0800)] 
HDDS-482. NullPointer exception thrown on console when cli operation failed.
Contributed by Nandakumar.

2 weeks agoHADOOP-15860. ABFS: Throw exception when directory / file name ends with a period...
Sean Mackrory [Wed, 2 Jan 2019 15:55:12 +0000 (08:55 -0700)] 
HADOOP-15860. ABFS: Throw exception when directory / file name ends with a period (.). Contributed by Shweta Yakkali.

2 weeks agoHDDS-949. Update Ratis to 0.4.0-a8c4ca0-SNAPSHOT.
Nanda kumar [Wed, 2 Jan 2019 14:28:48 +0000 (19:58 +0530)] 
HDDS-949. Update Ratis to 0.4.0-a8c4ca0-SNAPSHOT.
Contributed by Xiaoyu Yao.

2 weeks agoMAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contribut...
Weiwei Yang [Wed, 2 Jan 2019 13:39:45 +0000 (21:39 +0800)] 
MAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contributed by Fei Hui.

2 weeks agoHADOOP-16009. Replace the url of the repository in Apache Hadoop source code.
Akira Ajisaka [Sun, 30 Dec 2018 21:28:24 +0000 (06:28 +0900)] 
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code.

2 weeks agoHDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contr...
Akira Ajisaka [Sun, 30 Dec 2018 18:16:26 +0000 (03:16 +0900)] 
HDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contributed by Ayush Saxena.

2 weeks agoHDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
Wei-Chiu Chuang [Fri, 28 Dec 2018 18:34:18 +0000 (10:34 -0800)] 
HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.

2 weeks agoYARN-8894. Improve InMemoryPlan#toString. Contributed by BELUGA BEHR.
Akira Ajisaka [Fri, 28 Dec 2018 08:43:47 +0000 (17:43 +0900)] 
YARN-8894. Improve InMemoryPlan#toString. Contributed by BELUGA BEHR.

2 weeks agoYARN-8878. Remove StringBuffer from ManagedParentQueue.java. Contributed by BELUGA...
Akira Ajisaka [Fri, 28 Dec 2018 08:29:22 +0000 (17:29 +0900)] 
YARN-8878. Remove StringBuffer from ManagedParentQueue.java. Contributed by BELUGA BEHR.

2 weeks agoHADOOP-15962. The buffer size is small when unpacking tar archives. Contributed by...
Akira Ajisaka [Fri, 28 Dec 2018 06:38:23 +0000 (15:38 +0900)] 
HADOOP-15962. The buffer size is small when unpacking tar archives. Contributed by BELUGA BEHR.

2 weeks agoHADOOP-15819. FileSystem cache misused in S3A integration tests. Contributed by Adam...
Sean Mackrory [Thu, 27 Dec 2018 15:17:52 +0000 (08:17 -0700)] 
HADOOP-15819. FileSystem cache misused in S3A integration tests. Contributed by Adam Antal.

3 weeks agoHDDS-951. Replace the source url of Ozone logo. Contributed by Takanobu Asanuma.
Akira Ajisaka [Thu, 27 Dec 2018 02:32:49 +0000 (11:32 +0900)] 
HDDS-951. Replace the source url of Ozone logo. Contributed by Takanobu Asanuma.

3 weeks agoYARN-9090. [Submarine] Update submarine installation script document. Contributed...
Sunil G [Wed, 26 Dec 2018 02:56:48 +0000 (08:26 +0530)] 
YARN-9090. [Submarine] Update submarine installation script document. Contributed by Xun Liu.

3 weeks agoMerge branch 'HDFS-12943' into trunk
Konstantin V Shvachko [Mon, 24 Dec 2018 18:00:02 +0000 (10:00 -0800)] 
Merge branch 'HDFS-12943' into trunk

3 weeks agoHDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed... HDFS-12943
Konstantin V Shvachko [Mon, 24 Dec 2018 17:39:20 +0000 (09:39 -0800)] 
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.

3 weeks agoHDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed...
Chao Sun [Thu, 20 Dec 2018 06:20:31 +0000 (22:20 -0800)] 
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed by Chao Sun.

3 weeks agoHDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHa...
Konstantin V Shvachko [Wed, 19 Dec 2018 20:39:57 +0000 (12:39 -0800)] 
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHandler. Contributed by Konstantin V Shvachko.