incubator-hivemall.git
4 years agoFixed to include relocated HCatalog in hivemall-all.jar
Makoto Yui [Thu, 14 Jun 2018 05:45:26 +0000 (14:45 +0900)] 
Fixed to include relocated HCatalog in hivemall-all.jar

4 years ago[HIVEMALL-203] Relocated org.codehaus.jackson to hivemall.codehause.jackson in hivema...
Makoto Yui [Mon, 11 Jun 2018 07:22:00 +0000 (16:22 +0900)] 
[HIVEMALL-203] Relocated org.codehaus.jackson to hivemall.codehause.jackson in hivemall-all.jar

## What changes were proposed in this pull request?

Relocated `org.codehaus.jackson` to `hivemall.codehause.jackson` in hivemall-all.jar because Jackson can be missing in some Hadoop/Hive enviroment

## What type of PR is it?

Improvement

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-203

## How was this patch tested?

manual tests

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `./bin/format_code.sh`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Makoto Yui <myui@apache.org>

Closes #151 from myui/relocate_jackson.

4 years ago[HIVEMALL-145] Merge Brickhouse functions
Makoto Yui [Wed, 6 Jun 2018 09:09:17 +0000 (18:09 +0900)] 
[HIVEMALL-145] Merge Brickhouse functions

## What changes were proposed in this pull request?

Merge [brickhouse](https://github.com/klout/brickhouse) functions.

## What type of PR is it?

Feature

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-145

## How was this patch tested?

unit tests and manual tests

## How to use this feature?

as described in [user guide](http://hivemall.incubator.apache.org/userguide/misc/generic_funcs.html).

## Checklist

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?
- [x] Invite active/main Brickhouse developers as Hivemall PPMC members or committers.
https://github.com/klout/brickhouse/issues/149
- [x] +1 from Klout members to merge

Author: Makoto Yui <myui@apache.org>

Closes #135 from myui/merge_brickhouse.

4 years agoupdate conv.awk location
nono [Thu, 24 May 2018 09:58:17 +0000 (18:58 +0900)] 
update conv.awk location

http 404 before correction

## What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

## What type of PR is it?

[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

## What is the Jira issue?

(Put link here and add [HIVEMALL-*Jira number*] in PR title, e.g., [HIVEMALL-533])

## How was this patch tested?

(Please explain how this patch was tested. e.g., unit tests, integration tests, manual tests)

## How to use this feature?

(Please remove this section if not needed)

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `./bin/format_code.sh`, for your commit?
- [ ] Did you run system tests on Hive (or Spark)?

Author: nono <aschor@users.noreply.github.com>

Closes #150 from aschor/patch-1.

4 years agoUpdate GitHub PR template for code formatter
Takuya Kitazawa [Thu, 24 May 2018 00:34:45 +0000 (09:34 +0900)] 
Update GitHub PR template for code formatter

4 years agoRequest contributers to use ./bin/format_code.sh
Takuya Kitazawa [Wed, 16 May 2018 08:51:36 +0000 (17:51 +0900)] 
Request contributers to use ./bin/format_code.sh

4 years agoUpdate README according to the change of formatter
Takuya Kitazawa [Wed, 16 May 2018 08:43:18 +0000 (17:43 +0900)] 
Update README according to the change of formatter

4 years agoRemoved unnessesary entry
Makoto Yui [Sat, 28 Apr 2018 01:52:05 +0000 (10:52 +0900)] 
Removed unnessesary entry

4 years agoRefactored to remove IDE warnings
Makoto Yui [Sat, 28 Apr 2018 01:36:10 +0000 (10:36 +0900)] 
Refactored to remove IDE warnings

4 years agoApplied formatter
Makoto Yui [Fri, 27 Apr 2018 06:36:44 +0000 (15:36 +0900)] 
Applied formatter

4 years agoChanged to use spotless-maven-plugin for the formatter
Makoto Yui [Fri, 27 Apr 2018 06:28:30 +0000 (15:28 +0900)] 
Changed to use spotless-maven-plugin for the formatter

4 years agoReverted formatter-maven-plugin version to 0.5.2
Makoto Yui [Fri, 27 Apr 2018 03:20:54 +0000 (12:20 +0900)] 
Reverted formatter-maven-plugin version to 0.5.2

4 years agoRemoved warnings about duplicate entry
Makoto Yui [Fri, 27 Apr 2018 02:52:06 +0000 (11:52 +0900)] 
Removed warnings about duplicate entry

4 years agoFixed formatting scheme for multi-module project
Makoto Yui [Thu, 26 Apr 2018 16:14:15 +0000 (01:14 +0900)] 
Fixed formatting scheme for multi-module project

4 years agoApplied refactoring for #145
Makoto Yui [Thu, 26 Apr 2018 06:46:07 +0000 (15:46 +0900)] 
Applied refactoring for #145

4 years agoRenamed a unit test class name
Makoto Yui [Thu, 26 Apr 2018 05:52:53 +0000 (14:52 +0900)] 
Renamed a unit test class name

4 years agoMake size of incubator logo smaller
Takuya Kitazawa [Thu, 26 Apr 2018 02:52:06 +0000 (11:52 +0900)] 
Make size of incubator logo smaller

4 years agoFix incubator logo at the bottom of site
Takuya Kitazawa [Thu, 26 Apr 2018 02:38:46 +0000 (11:38 +0900)] 
Fix incubator logo at the bottom of site

4 years ago[HIVEMALL-191] Add Kryo serialization test to existing workaround code
Takuya Kitazawa [Wed, 25 Apr 2018 08:04:02 +0000 (17:04 +0900)] 
[HIVEMALL-191] Add Kryo serialization test to existing workaround code

## What changes were proposed in this pull request?

Add Kryo serialization test to existing workaround code as: https://github.com/apache/incubator-hivemall/commit/f6765dff7be67e1a3327709bbb9bfdc6eba7b97f

To be more precise, currently two UDFs `quantified_features` and `tokenize_ja` explicitly have the workaround lazy instantiation code. So, this PR makes their `transient` keyword unnecessary.

## What type of PR is it?

Improvement

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-191

## How was this patch tested?

Added some unit tests, and manually tested as well

## Checklist

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #145 from takuti/HIVEMALL-191.

4 years ago[HIVEMALL-193] Implement a tool for generating a list of Hivemall UDFs
Takuya Kitazawa [Wed, 25 Apr 2018 07:46:01 +0000 (16:46 +0900)] 
[HIVEMALL-193] Implement a tool for generating a list of Hivemall UDFs

## What changes were proposed in this pull request?

Automatically generate a list of UDFs for:

- https://hivemall.incubator.apache.org/userguide/misc/funcs.html
- https://hivemall.incubator.apache.org/userguide/misc/generic_funcs.html

Initial mock implementation: https://github.com/takuti/hivemalldoc

## What type of PR is it?

Improvement, Documentation

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-193

## How was this patch tested?

See output: https://gist.github.com/takuti/312d3a11bf85fc4044399d7e97a06f13

## How to use this feature?

```
$ mvn clean package -Dskiptests=true -Dmaven.test.skip=true
$ mvn org.apache.hivemall:hivemall-docs:generate-funcs-list
```

## Checklist

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #148 from takuti/HIVEMALL-193.

4 years ago[HIVEMALL-197] Update Apache incubator logo
Takuya Kitazawa [Fri, 20 Apr 2018 07:04:56 +0000 (16:04 +0900)] 
[HIVEMALL-197] Update Apache incubator logo

## What changes were proposed in this pull request?

* Avoid direct link to ASF's file
* Update Apache incubator logo

## What type of PR is it?

Documentation

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-197

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #147 from takuti/HIVEMALL-197.

4 years agoApplied refactoring
Makoto Yui [Thu, 19 Apr 2018 07:20:27 +0000 (16:20 +0900)] 
Applied refactoring

4 years ago[HIVEMALL-192] Fix typos: graphvis -> graphviz
Takuya Kitazawa [Wed, 18 Apr 2018 08:27:01 +0000 (17:27 +0900)] 
[HIVEMALL-192] Fix typos: graphvis -> graphviz

## What changes were proposed in this pull request?

Fix crucial typos.

## What type of PR is it?

Improvement

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-192

## Checklist

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #146 from takuti/HIVEMALL-192.

4 years agoFormat
Takuya Kitazawa [Tue, 17 Apr 2018 02:28:53 +0000 (11:28 +0900)] 
Format

4 years agoUpdated randomforest hyperparameter description
Makoto Yui [Tue, 17 Apr 2018 02:05:01 +0000 (11:05 +0900)] 
Updated randomforest hyperparameter description

4 years agoUpdated description of RandomForest classifier option
Makoto Yui [Tue, 17 Apr 2018 01:55:12 +0000 (10:55 +0900)] 
Updated description of RandomForest classifier option

4 years agoFix typo in documentation: Whether, wheather -> weather
Takuya Kitazawa [Tue, 17 Apr 2018 00:42:47 +0000 (09:42 +0900)] 
Fix typo in documentation: Whether, wheather -> weather

4 years agoRemoved a link in user guide
Makoto Yui [Mon, 16 Apr 2018 14:12:54 +0000 (23:12 +0900)] 
Removed a link in user guide

4 years ago[HIVEMALL-189] Create a list of all functions
Takuya Kitazawa [Mon, 16 Apr 2018 13:46:36 +0000 (22:46 +0900)] 
[HIVEMALL-189] Create a list of all functions

## What changes were proposed in this pull request?

Create a list of all functions in the documentation. In order to make maintenance easier and simpler, the list is systematically generated by reading `Description` annotation in the code: [takuti/hivemalldoc](https://github.com/takuti/hivemalldoc).

In case this list does not look sufficient, let's update `Description` annotation itself and make the code more informative in the future.

## What type of PR is it?

Documentation

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-189

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #143 from takuti/HIVEMALL-189.

4 years agoMoved a file used in a test to test/resources
Makoto Yui [Fri, 13 Apr 2018 07:50:05 +0000 (16:50 +0900)] 
Moved a file used in a test to test/resources

4 years agoClose #144: [HIVEMALL-190][HOTFIX] Fixed a bug in tree_predict_v1 on loading old...
Makoto Yui [Fri, 13 Apr 2018 07:20:09 +0000 (16:20 +0900)] 
Close #144: [HIVEMALL-190][HOTFIX] Fixed a bug in tree_predict_v1 on loading old prediction models

4 years agoFix typos
Takuya Kitazawa [Fri, 13 Apr 2018 06:41:16 +0000 (15:41 +0900)] 
Fix typos

4 years agoFixed array_concat to return List<Writable>
Makoto Yui [Thu, 12 Apr 2018 06:13:28 +0000 (15:13 +0900)] 
Fixed array_concat to return List<Writable>

4 years agoRemove deprecated sha1 UDF from define-udfs.td.hql
Takuya Kitazawa [Thu, 12 Apr 2018 00:00:27 +0000 (09:00 +0900)] 
Remove deprecated sha1 UDF from define-udfs.td.hql

4 years agoFixed a Kryo serialization error in select_k_best UDF
Makoto Yui [Wed, 11 Apr 2018 05:53:37 +0000 (14:53 +0900)] 
Fixed a Kryo serialization error in select_k_best UDF

4 years agoFix typo in define-udfs.td.hql
Takuya Kitazawa [Tue, 10 Apr 2018 07:14:03 +0000 (16:14 +0900)] 
Fix typo in define-udfs.td.hql

4 years ago[HIVEMALL-188] Avoid KryoException: java.lang.NullPointerException
Takuya Kitazawa [Tue, 10 Apr 2018 05:16:13 +0000 (14:16 +0900)] 
[HIVEMALL-188] Avoid KryoException: java.lang.NullPointerException

## What changes were proposed in this pull request?

Fix a bug in `tokenize_ja` that occasionally raises `KryoException: java.lang.NullPointerException`

## What type of PR is it?

Bug Fix

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-188

## How was this patch tested?

Manual tests

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #142 from takuti/HIVEMALL-188.

4 years agoMerged brickhouse functions #135
Makoto Yui [Mon, 9 Apr 2018 07:04:37 +0000 (16:04 +0900)] 
Merged brickhouse functions #135

4 years ago[HIVEMALL-117][SPARK] Update the installation guide for Spark
Takeshi Yamamuro [Thu, 5 Apr 2018 06:24:55 +0000 (15:24 +0900)] 
[HIVEMALL-117][SPARK] Update the installation guide for Spark

## What changes were proposed in this pull request?
This pr updated the installation guide for Spark.

## What type of PR is it?
Documentation

## What is the Jira issue?
https://issues.apache.org/jira/browse/HIVEMALL-117

## How was this patch tested?
N/A

Author: Takeshi Yamamuro <yamamuro@apache.org>

Closes #141 from maropu/HIVEMALL-117.

4 years ago[HIVEMALL-180][SPARK] Drop the Spark-2.0 support
Takeshi Yamamuro [Mon, 2 Apr 2018 05:19:30 +0000 (14:19 +0900)] 
[HIVEMALL-180][SPARK] Drop the Spark-2.0 support

## What changes were proposed in this pull request?
This pr dropped the module for Spark-2.0.

## What type of PR is it?
Improvement

## What is the Jira issue?
https://issues.apache.org/jira/browse/HIVEMALL-180

## How was this patch tested?
Existing tests

Author: Takeshi Yamamuro <yamamuro@apache.org>

Closes #138 from maropu/HIVEMALL-180.

4 years agoChange the organization of nzw
Kento NOZAWA [Mon, 2 Apr 2018 05:17:07 +0000 (14:17 +0900)] 
Change the organization of nzw

## What changes were proposed in this pull request?

Update Kento Nozawa's organization.

## What type of PR is it?

[Documentation]

## What is the Jira issue?

This fix is a minor fix for release, so I have not yet created a jira ticket. Let me know if I should create it.

## How was this patch tested?

By compiling the source code, confirming this change does not break the structure of pom.xml.

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [ ] Did you run system tests on Hive (or Spark)?

Author: Kento NOZAWA <k_nzw@klis.tsukuba.ac.jp>

Closes #140 from nzw0301/change-nzw-org.

4 years agoClose #137: [HIVEMALL-179][SPARK] Support spark-v2.3
Takeshi Yamamuro [Wed, 28 Mar 2018 23:41:54 +0000 (08:41 +0900)] 
Close #137: [HIVEMALL-179][SPARK] Support spark-v2.3

4 years agoUpdated the project site
Makoto Yui [Tue, 13 Mar 2018 15:59:07 +0000 (00:59 +0900)] 
Updated the project site

4 years agoUpdated the project site for v0.5.0 release
Makoto Yui [Tue, 13 Mar 2018 11:50:02 +0000 (20:50 +0900)] 
Updated the project site for v0.5.0 release

4 years ago[HIVEMALL-174][DOC] Update RandomForest document to reflect changes in usages
Makoto Yui [Tue, 13 Mar 2018 10:45:24 +0000 (19:45 +0900)] 
[HIVEMALL-174][DOC] Update RandomForest document to reflect changes in usages

## What changes were proposed in this pull request?

Update RandomForest document to reflect changes in usages

## What type of PR is it?

Documentation

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-174

Author: Makoto Yui <myui@apache.org>

Closes #136 from myui/rf_docs.

4 years agoUpdated Mentor information becuase Markus resigned
Makoto Yui [Wed, 7 Mar 2018 05:49:07 +0000 (14:49 +0900)] 
Updated Mentor information becuase Markus resigned

4 years agoUpdate release guide
Makoto Yui [Tue, 6 Mar 2018 14:58:19 +0000 (23:58 +0900)] 
Update release guide

4 years agoFixed LICENSE file
Makoto Yui [Tue, 6 Mar 2018 09:31:26 +0000 (18:31 +0900)] 
Fixed LICENSE file

4 years agoFix typo: multipler -> multiplier
Takuya Kitazawa [Wed, 28 Feb 2018 15:40:40 +0000 (07:40 -0800)] 
Fix typo: multipler -> multiplier

4 years agoFix typo: propcess -> process
Takuya Kitazawa [Wed, 21 Feb 2018 21:33:32 +0000 (06:33 +0900)] 
Fix typo: propcess -> process

4 years agomvn validate and compile-xgboost is no more used
Makoto Yui [Wed, 21 Feb 2018 02:27:06 +0000 (11:27 +0900)] 
mvn validate and compile-xgboost is no more used

4 years agoFix CI failure
Takuya Kitazawa [Wed, 21 Feb 2018 02:20:35 +0000 (11:20 +0900)] 
Fix CI failure

## What changes were proposed in this pull request?

This PR should fix CI failure like: https://travis-ci.org/apache/incubator-hivemall/builds/343706510

- Set env variable JAVA8_HOME which is enforced by pom for building Spark 2.2
- Fix Spark-related CI configuration

## What type of PR is it?

Hot Fix

## What is the Jira issue?

N/A

## How was this patch tested?

Check the latest CI results below.

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #134 from takuti/travis-set-JAVA8_HOME.

4 years agoFix typo: Statefull -> Stateful
Takuya Kitazawa [Tue, 20 Feb 2018 21:05:44 +0000 (06:05 +0900)] 
Fix typo: Statefull -> Stateful

4 years agoClose #131: [v0.5.0-rc3] Merge v0.5.0 branch
Makoto Yui [Tue, 20 Feb 2018 07:17:51 +0000 (16:17 +0900)] 
Close #131: [v0.5.0-rc3] Merge v0.5.0 branch

4 years agoRenamed a file
Makoto Yui [Wed, 14 Feb 2018 07:50:14 +0000 (16:50 +0900)] 
Renamed a file

4 years agoUpdate release guide
Makoto Yui [Wed, 14 Feb 2018 07:41:29 +0000 (16:41 +0900)] 
Update release guide

4 years agoUpdated release guide
Makoto Yui [Thu, 25 Jan 2018 10:36:56 +0000 (19:36 +0900)] 
Updated release guide

4 years agoUpdated release guide and added artifact verification docs
Makoto Yui [Thu, 25 Jan 2018 08:34:51 +0000 (17:34 +0900)] 
Updated release guide and added artifact verification docs

4 years agoUpdated to install md5sha1sum
Makoto Yui [Mon, 15 Jan 2018 05:57:19 +0000 (14:57 +0900)] 
Updated to install md5sha1sum

4 years agoClose #133: Updating mailing lists for announcing new releases
Tsuyoshi Ozawa [Fri, 12 Jan 2018 10:59:51 +0000 (19:59 +0900)] 
Close #133: Updating mailing lists for announcing new releases

4 years agoClose #132: Update Tsuyoshi's organization
Tsuyoshi Ozawa [Fri, 12 Jan 2018 09:45:17 +0000 (18:45 +0900)] 
Close #132: Update Tsuyoshi's organization

4 years agoUpdated release guide
Makoto Yui [Fri, 5 Jan 2018 14:40:19 +0000 (23:40 +0900)] 
Updated release guide

4 years agoAdded --version option
Makoto Yui [Fri, 5 Jan 2018 06:27:30 +0000 (15:27 +0900)] 
Added --version option

4 years agoAdded -pom option
Makoto Yui [Fri, 5 Jan 2018 05:23:55 +0000 (14:23 +0900)] 
Added -pom option

4 years agoFixed pom to avoid git push by maven-release-plugin
Makoto Yui [Thu, 4 Jan 2018 12:04:07 +0000 (21:04 +0900)] 
Fixed pom to avoid git push by maven-release-plugin

4 years agoUpdated release setup guide
Makoto Yui [Thu, 4 Jan 2018 09:46:15 +0000 (18:46 +0900)] 
Updated release setup guide

4 years agoAdded pom.xml.next and pom.xml.tag to gitignore
Makoto Yui [Wed, 27 Dec 2017 09:09:43 +0000 (18:09 +0900)] 
Added pom.xml.next and pom.xml.tag to gitignore

4 years agoAdded gitignore entry
Makoto Yui [Wed, 27 Dec 2017 08:48:52 +0000 (17:48 +0900)] 
Added gitignore entry

4 years ago[HIVEMALL-164] Fixed pom for appending proper NOTICE/LICENSE/DISCLAIMER to jars
Akira Ajisaka [Wed, 27 Dec 2017 08:22:44 +0000 (17:22 +0900)] 
[HIVEMALL-164] Fixed pom for appending proper NOTICE/LICENSE/DISCLAIMER to jars

## What changes were proposed in this pull request?

Fixed pom for appending proper NOTICE/LICENSE/DISCLAIMER to jars. `maven-remote-resources-plugin` used in parent Apache pom does not work well.

This PR closes #128

## What type of PR is it?

Improvement

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-164

## How was this patch tested?

manual tests

## How to use this feature?

`./bin/build.sh`

Author: Makoto Yui <myui@apache.org>

Closes #129 from myui/HIVEMALL-164.

4 years agoClose #119: [HIVEMALL-148] Add a script for merging GitHub PR
Makoto Yui [Wed, 27 Dec 2017 07:43:23 +0000 (16:43 +0900)] 
Close #119: [HIVEMALL-148] Add a script for merging GitHub PR

4 years agoFixed to include DISCLAIMER in jars
Makoto Yui [Tue, 26 Dec 2017 08:41:19 +0000 (17:41 +0900)] 
Fixed to include DISCLAIMER in jars

4 years agoPrepare for the next snapshot release
Makoto Yui [Tue, 26 Dec 2017 06:58:55 +0000 (15:58 +0900)] 
Prepare for the next snapshot release

4 years agoFixed pom.xml for release versioning
Makoto Yui [Tue, 26 Dec 2017 05:58:44 +0000 (14:58 +0900)] 
Fixed pom.xml for release versioning

4 years agoClose #127: [HIVEMALL-2] Change Maven release scheme for ASF release
Makoto Yui [Tue, 26 Dec 2017 05:25:38 +0000 (14:25 +0900)] 
Close #127: [HIVEMALL-2] Change Maven release scheme for ASF release

4 years ago[HIVEMALL-162] Support L1 normalization
Takuya Kitazawa [Mon, 18 Dec 2017 07:28:59 +0000 (16:28 +0900)] 
[HIVEMALL-162] Support L1 normalization

Support `l1_normalize` in a similar manner to `l2_normalize`

Feature

- https://issues.apache.org/jira/browse/HIVEMALL-59
- https://issues.apache.org/jira/browse/HIVEMALL-162

Unit test and manual test on EMR

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #126 from takuti/l1-normalize.

4 years ago[Hotfix] Fixed CI error due to depending roaringbitmap version
Makoto Yui [Mon, 18 Dec 2017 07:18:36 +0000 (16:18 +0900)] 
[Hotfix] Fixed CI error due to depending roaringbitmap version

4 years agoApply formatter
Takuya Kitazawa [Mon, 18 Dec 2017 00:55:57 +0000 (09:55 +0900)] 
Apply formatter

4 years agoFix typo
Takuya Kitazawa [Mon, 27 Nov 2017 03:14:36 +0000 (12:14 +0900)] 
Fix typo

4 years agoClose #125: [HIVEMALL-18] approx_distinct_count UDAF using HyperLogLog++ #125
Makoto Yui [Tue, 21 Nov 2017 12:49:24 +0000 (21:49 +0900)] 
Close #125: [HIVEMALL-18] approx_distinct_count UDAF using HyperLogLog++ #125

4 years ago[HIVEMALL-157] Avoid Null Pointer Exception caused by uninitialized queue handler
Takuya Kitazawa [Thu, 2 Nov 2017 04:48:00 +0000 (13:48 +0900)] 
[HIVEMALL-157] Avoid Null Pointer Exception caused by uninitialized queue handler

## What changes were proposed in this pull request?

Even though `to_ordered_list` allows (and ignores) NULL inputs, following query fails due to NPE:

```sql
select to_ordered_list(null, null)
```
> Null Pointer Exception

This PR fixes the problem; now, the function returns empty list in case that queue handler is uninitialized because of NULL inputs:

> []

## What type of PR is it?

Bug Fix

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-157

## How was this patch tested?

Manually tested on local and EMR Hive

## Checklist

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #124 from takuti/fix-to_ordered_list-npe.

4 years ago[HOTFIX] Reverted to support Java 7
Makoto Yui [Thu, 26 Oct 2017 11:54:32 +0000 (20:54 +0900)] 
[HOTFIX] Reverted to support Java 7

4 years agoClose #123: [HIVEMALL-154] Refactor Field-aware Factorization Machines to support...
Makoto Yui [Tue, 24 Oct 2017 15:40:54 +0000 (00:40 +0900)] 
Close #123: [HIVEMALL-154] Refactor Field-aware Factorization Machines to support Instance-wise L2 normalization

4 years agoUpdated eclipse style file for Java 8
Makoto Yui [Thu, 19 Oct 2017 08:03:16 +0000 (17:03 +0900)] 
Updated eclipse style file for Java 8

4 years agoApplied source code formatter
Makoto Yui [Wed, 18 Oct 2017 12:18:22 +0000 (21:18 +0900)] 
Applied source code formatter

4 years agoAdded a FFM unit test
Makoto Yui [Wed, 18 Oct 2017 12:15:28 +0000 (21:15 +0900)] 
Added a FFM unit test

4 years agoFixed assertion conditions
Makoto Yui [Mon, 16 Oct 2017 11:54:53 +0000 (20:54 +0900)] 
Fixed assertion conditions

4 years agoFixed typos
Makoto Yui [Mon, 16 Oct 2017 11:53:53 +0000 (20:53 +0900)] 
Fixed typos

4 years agoClose #122: [HIVEMALL-147][Spark] Support all Hivemall functions of v0.5-rc.1 in...
Takeshi Yamamuro [Mon, 16 Oct 2017 11:52:56 +0000 (20:52 +0900)] 
Close #122: [HIVEMALL-147][Spark] Support all Hivemall functions of v0.5-rc.1 in Spark Dataframe

4 years agoClose #121: [HIVEMALL-151] Support Matrix conversion from DoK to CSR/CSC matrix
Makoto Yui [Mon, 16 Oct 2017 11:35:00 +0000 (20:35 +0900)] 
Close #121: [HIVEMALL-151] Support Matrix conversion from DoK to CSR/CSC matrix

5 years ago[HIVEMALL-149] Add tiny script for updating resources/ddl/define-*
Takuya Kitazawa [Wed, 4 Oct 2017 09:28:20 +0000 (18:28 +0900)] 
[HIVEMALL-149] Add tiny script for updating resources/ddl/define-*

## What changes were proposed in this pull request?

Add a script for updating resources/ddl/define-*

## What type of PR is it?

Improvement

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-149

## How to use this feature?

`./bin/add_define.sh`

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #120 from takuti/HIVEMALL-149-define.

5 years ago[HIVEMALL-146] Yet another UDF to generate n-grams
Takuya Kitazawa [Wed, 4 Oct 2017 03:06:26 +0000 (12:06 +0900)] 
[HIVEMALL-146] Yet another UDF to generate n-grams

## What changes were proposed in this pull request?

Add a new UDF `to_ngrams(array<string> words, int minSize, int maxSize)` which returns list of n-grams `minSize <= n <= maxSize` for given words. This UDF can be alternative of the original Hive `ngrams` function.

## What type of PR is it?

Feature

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-146

## How was this patch tested?

Unit test, manual tests both on EMR and local Hive

## How to use this feature?

as documented

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #118 from takuti/HIVEMALL-146-ngrams.

5 years agoUpdated PR template
Makoto Yui [Thu, 28 Sep 2017 07:56:59 +0000 (16:56 +0900)] 
Updated PR template

5 years agoFixed rendering errors in SLIM doc
Makoto Yui [Thu, 28 Sep 2017 03:54:04 +0000 (12:54 +0900)] 
Fixed rendering errors in SLIM doc

5 years agoFixed a link on SLIM documentation
Makoto Yui [Thu, 28 Sep 2017 03:31:49 +0000 (12:31 +0900)] 
Fixed a link on SLIM documentation

5 years agoClose #117, Close #111: [HIVEMALL-17] Support SLIM neighborhood-learning recommendati...
Kento NOZAWA [Thu, 28 Sep 2017 03:16:17 +0000 (12:16 +0900)] 
Close #117, Close #111: [HIVEMALL-17] Support SLIM neighborhood-learning recommendation algorithm

5 years agoClose #115: [HIVEMALL-124][BUGFIX] Fixed bugs in BinaryResponseMeasure (nDCG, MRR...
Makoto Yui [Fri, 15 Sep 2017 09:52:33 +0000 (18:52 +0900)] 
Close #115: [HIVEMALL-124][BUGFIX] Fixed bugs in BinaryResponseMeasure (nDCG, MRR, AP)

5 years agoFixed CI error about f1score in Spark again
Makoto Yui [Thu, 14 Sep 2017 05:46:23 +0000 (14:46 +0900)] 
Fixed CI error about f1score in Spark again

5 years agoFixed CI error about f1score in Spark
Makoto Yui [Thu, 14 Sep 2017 05:21:33 +0000 (14:21 +0900)] 
Fixed CI error about f1score in Spark

5 years agoMinor refactoring of FMeasureUDAF
Makoto Yui [Wed, 13 Sep 2017 13:55:05 +0000 (22:55 +0900)] 
Minor refactoring of FMeasureUDAF

5 years agoDocumentation fixes for Evaluation
Makoto Yui [Wed, 13 Sep 2017 13:54:42 +0000 (22:54 +0900)] 
Documentation fixes for Evaluation