Tommaso Teofili [Fri, 4 Sep 2020 12:55:41 +0000 (14:55 +0200)]
Merge pull request #92 from jzonthemtn/readme-pkgs
Adding step for packages to readme.
jzonthemtn [Fri, 4 Sep 2020 12:22:33 +0000 (08:22 -0400)]
Adding step for packages to readme.
Tommaso Teofili [Sat, 25 Apr 2020 14:29:55 +0000 (16:29 +0200)]
Merge pull request #91 from arfunk/patch-1
Update Dockerfile
arfunk [Fri, 24 Apr 2020 11:32:54 +0000 (14:32 +0300)]
Update Dockerfile
1. maven:latest now bases on OL7. changed to debian based base image.
2. removed java 8 installation - base image contains openjdk 11
3. removed JAVA_HOME env - this ENV is set up in base image
4. added mvn clean package command to build downloaded sources
Tommaso Teofili [Sun, 12 Apr 2020 09:43:26 +0000 (11:43 +0200)]
Merge pull request #90 from iadbbwarln/patch-1
Remove bashism
Rokas [Sun, 12 Apr 2020 07:38:10 +0000 (10:38 +0300)]
Remove bashism
Remove bashism and requirement for system to have /bin/sh == bash.
This is required to run on Debian10 amd64.
Tommaso Teofili [Fri, 6 Dec 2019 08:07:42 +0000 (09:07 +0100)]
[maven-release-plugin] prepare for next development iteration
Tommaso Teofili [Fri, 6 Dec 2019 08:07:17 +0000 (09:07 +0100)]
[maven-release-plugin] prepare release apache-joshua-6.2
Tommaso Teofili [Wed, 13 Nov 2019 07:14:41 +0000 (08:14 +0100)]
JOSHUA-344 - upgraded mockito to 3.0.0
Tommaso Teofili [Sun, 29 Sep 2019 06:52:19 +0000 (08:52 +0200)]
Merge pull request #89 from magali-joine/patch-1
Add OpenJDK dependency required for "jni.h"
ᎹᎦᎵ ᏦᎢᏁ [Wed, 25 Sep 2019 20:58:15 +0000 (16:58 -0400)]
Add OpenJDK dependency required for "jni.h"
Fixes docker build: Solves
```
100%] Linking CXX executable ../tests/model_test
[100%] Built target model_test
/code/jni/kenlm_wrap.cc:28:17: fatal error: jni.h: No such file or directory
#include <jni.h>
^
compilation terminated.
Removing intermediate container
0c2cb0c17a12
```
Tommaso Teofili [Fri, 14 Jun 2019 06:14:28 +0000 (08:14 +0200)]
Merge pull request #88 from jamesewoo/docker-fix
Update path to env, remove git command
James Woo [Wed, 12 Jun 2019 19:36:41 +0000 (19:36 +0000)]
Update path to env, remove git command
Tommaso Teofili [Sun, 12 May 2019 15:19:10 +0000 (17:19 +0200)]
Merge pull request #87 from bd2019us/JOSHUA-342
Using replace() instead of replaceAll() for non-regex patterns
bd2019us [Sun, 12 May 2019 01:46:17 +0000 (20:46 -0500)]
Attempt to fix test results
Tommaso Teofili [Fri, 10 May 2019 10:23:40 +0000 (12:23 +0200)]
JOSHUA-343 - dropped incubat* from pom and other build files, dropped Incubator DISCLAIMER.txt
bd2019us [Sat, 20 Apr 2019 23:48:00 +0000 (18:48 -0500)]
Using replace() instead of replaceAll() for non-regex patterns
Using replace() instead replaceAll() when no regex is used remove's the overhead associated with replaceAll()
Tommaso Teofili [Mon, 17 Dec 2018 17:11:26 +0000 (18:11 +0100)]
JOSHUA-329 - fixing wrong index selection
Thamme Gowda [Tue, 6 Mar 2018 01:53:09 +0000 (17:53 -0800)]
Fix: tuner utilize threads when NUM_THREADS is set
Thamme Gowda [Tue, 6 Mar 2018 01:13:27 +0000 (17:13 -0800)]
Fix: memory overflow in tuning
when larger language models are used, the tuner needs more memory.
Even though we allocate more memory in the training pipeline script
the value is ignored at one place in pipeline.
This patch fixes it by exporting env var, and passing it to the JVM
Tommaso Teofili [Wed, 10 Jan 2018 16:17:35 +0000 (17:17 +0100)]
no jira - this closes #80
Tommaso Teofili [Wed, 27 Sep 2017 10:17:05 +0000 (12:17 +0200)]
no Jira - added IDEA files to .gitignore
Lewis John McGibbney [Wed, 28 Jun 2017 04:32:00 +0000 (21:32 -0700)]
Upddate badges
Tommaso Teofili [Wed, 8 Mar 2017 23:22:38 +0000 (00:22 +0100)]
[maven-release-plugin] prepare for next development iteration
Tommaso Teofili [Wed, 8 Mar 2017 23:17:18 +0000 (00:17 +0100)]
[maven-release-plugin] prepare release apache-joshua-6.1
Tommaso Teofili [Tue, 7 Mar 2017 20:19:24 +0000 (21:19 +0100)]
JOSHUA-331 - added IDEA project files to .gitignore
Tommaso Teofili [Tue, 7 Mar 2017 13:25:23 +0000 (14:25 +0100)]
JOSHUA-331 - addded missing rat-check excludes
Tommaso Teofili [Tue, 7 Mar 2017 13:16:18 +0000 (14:16 +0100)]
JOSHUA-331 - berkeleyLM bin/gz files generated from plain text one
Matt Post [Mon, 6 Mar 2017 21:06:45 +0000 (16:06 -0500)]
regenerated files as derivatives of 'lm'
Tommaso Teofili [Mon, 6 Mar 2017 20:00:33 +0000 (21:00 +0100)]
JOSHUA-331 - reverted to 6.1-SNAPSHOT
Matt Post [Mon, 6 Mar 2017 10:54:20 +0000 (05:54 -0500)]
added script for querying http server in bulk
Matt Post [Fri, 3 Mar 2017 20:57:35 +0000 (15:57 -0500)]
bugfix: URL string was being decoded twice
HttpExchange.getRequestURI().getQuery() returns a partially-decoded query string, e.g., %25 is transformed to a linefeed. Previously, we again called URLDecoder.decode() to decode each argument. This was only problematic in particular situations where special characters were encoded. It should now be fixed.
Matt Post [Fri, 3 Mar 2017 15:01:14 +0000 (10:01 -0500)]
Merge branch 'kenlm_docker'
Matt Post [Fri, 3 Mar 2017 15:01:05 +0000 (10:01 -0500)]
added language pack VERSIONS file
Matt Post [Fri, 3 Mar 2017 14:58:33 +0000 (09:58 -0500)]
added full path to config file
Matt Post [Fri, 3 Mar 2017 00:03:21 +0000 (19:03 -0500)]
cleanup, now adds lp.conf file
Matt Post [Thu, 2 Mar 2017 20:59:18 +0000 (15:59 -0500)]
updated docker files for kenlm + language pack support
There were some docker files but they were somewhat out of date. This push introduces
a new KenLM docker image which builds KenLM and makes use of the joshua.config.kenlm
file that is found in language packs version 3+.
Matt Post [Wed, 1 Feb 2017 01:28:58 +0000 (20:28 -0500)]
added docker file to build KenLM
Matt Post [Thu, 2 Mar 2017 18:02:35 +0000 (13:02 -0500)]
Fixed javadoc
Matt Post [Thu, 2 Mar 2017 16:30:38 +0000 (11:30 -0500)]
RESTful server now handles multiple sentences
This is done via multiple "q=" tags. Before, each instance would override the last, but now, they are aggregated into a list
Matt Post [Thu, 23 Feb 2017 21:54:42 +0000 (16:54 -0500)]
now supports relative paths
Joshua now computes all paths read from config files relative to location
of joshua.config. This eases building language packs and loading models from a library
because you no longer have to worry about cd()ing to the correct place first.
Any relative paths (e.g., those provided in language packs) will be canonicalized by
prefixing the full path to the parent directory containing joshua.config. Absolute
paths are not affected.
Tommaso Teofili [Thu, 23 Feb 2017 08:15:56 +0000 (09:15 +0100)]
[maven-release-plugin] prepare for next development iteration
Tommaso Teofili [Thu, 23 Feb 2017 08:15:19 +0000 (09:15 +0100)]
[maven-release-plugin] prepare release apache-joshua-6.1
Tommaso Teofili [Thu, 23 Feb 2017 08:10:10 +0000 (09:10 +0100)]
JOSHUA-324 - rollback changes in pom
Tommaso Teofili [Wed, 22 Feb 2017 12:47:55 +0000 (13:47 +0100)]
[maven-release-plugin] prepare for next development iteration
Tommaso Teofili [Wed, 22 Feb 2017 12:46:40 +0000 (13:46 +0100)]
[maven-release-plugin] prepare release apache-joshua-6.1
Tommaso Teofili [Wed, 22 Feb 2017 12:43:06 +0000 (13:43 +0100)]
[maven-release-plugin] rollback the release of apache-joshua-6.1
Tommaso Teofili [Wed, 22 Feb 2017 12:41:40 +0000 (13:41 +0100)]
[maven-release-plugin] prepare release apache-joshua-6.1
Tommaso Teofili [Sat, 18 Feb 2017 14:30:02 +0000 (15:30 +0100)]
JOSHUA-324 - added exclude for release files
Tommaso Teofili [Sat, 18 Feb 2017 14:19:20 +0000 (15:19 +0100)]
JOSHUA-324 - added exclude for IDEA files
Tommaso Teofili [Sat, 18 Feb 2017 10:40:07 +0000 (11:40 +0100)]
JOSHUA-324 - added missing rat exclude
Tommaso Teofili [Sat, 18 Feb 2017 09:43:24 +0000 (10:43 +0100)]
no Jira - added pub key for tommaso
Matt Post [Wed, 1 Feb 2017 01:26:25 +0000 (20:26 -0500)]
added script to facilitate easy testing of language packs
It just takes a language pack directory and a test set, runs the language pack on the test set,
and writes the results to a subdirectory LP/evaluation/TEST/*, where LP is the language pack and
TEST is the basename of the test set.
Matt Post [Wed, 1 Feb 2017 00:34:59 +0000 (19:34 -0500)]
copies over KenLM now
Matt Post [Wed, 1 Feb 2017 00:33:27 +0000 (19:33 -0500)]
make some arguments optional
Matt Post [Wed, 1 Feb 2017 00:33:06 +0000 (19:33 -0500)]
sets default language
Matt Post [Tue, 31 Jan 2017 04:50:22 +0000 (23:50 -0500)]
bugfix in moses phrase table conversion
problem was with handling lines starting with '['
Matt Post [Tue, 31 Jan 2017 04:41:34 +0000 (23:41 -0500)]
don't copy grammar on failure if sorted
Matt Post [Tue, 31 Jan 2017 02:02:37 +0000 (21:02 -0500)]
bugfix in label strip
Matt Post [Tue, 31 Jan 2017 02:02:14 +0000 (21:02 -0500)]
fixed script moving, added new script
Matt Post [Tue, 31 Jan 2017 02:01:45 +0000 (21:01 -0500)]
added thrax_conf, small bugfixes in output and cleanup
Matt Post [Tue, 31 Jan 2017 01:43:41 +0000 (20:43 -0500)]
added check to see if iso-639 module installed
Matt Post [Tue, 31 Jan 2017 01:42:31 +0000 (20:42 -0500)]
removed unused argument
Matt Post [Fri, 27 Jan 2017 17:54:59 +0000 (12:54 -0500)]
reverted dependency download script, better way to handle for travis
Lewis John McGibbney [Fri, 27 Jan 2017 17:10:07 +0000 (09:10 -0800)]
remove apache-release profile
Lewis John McGibbney [Fri, 27 Jan 2017 05:39:59 +0000 (21:39 -0800)]
Final preparation for RC#3
Lewis John McGibbney [Fri, 27 Jan 2017 05:33:39 +0000 (21:33 -0800)]
Final preparation for RC#3
Lewis John McGibbney [Fri, 27 Jan 2017 05:18:50 +0000 (21:18 -0800)]
Final preparation for RC#3
Lewis John McGibbney [Fri, 27 Jan 2017 05:07:18 +0000 (21:07 -0800)]
Include SNAPSHOT in version
Matt Post [Thu, 26 Jan 2017 15:43:33 +0000 (10:43 -0500)]
Merge branch 'master' of github.com:KellenSunderland/incubator-joshua
Matt Post [Thu, 26 Jan 2017 01:18:18 +0000 (20:18 -0500)]
Merge branch 'JOSHUA-327'
Matt Post [Thu, 26 Jan 2017 01:02:23 +0000 (20:02 -0500)]
Merge branch 'master' into JOSHUA-327
Matt Post [Thu, 26 Jan 2017 01:02:06 +0000 (20:02 -0500)]
Merge branch 'JOSHUA-328'
Matt Post [Thu, 26 Jan 2017 01:01:55 +0000 (20:01 -0500)]
do the glue grammar check before loading the packed grammar
Matt Post [Wed, 25 Jan 2017 21:14:59 +0000 (16:14 -0500)]
Added check / warning that packed grammar is loaded first
Matt Post [Wed, 25 Jan 2017 18:43:20 +0000 (13:43 -0500)]
attempt to fix travis CI build
download-deps.sh was recently edited to require ack. of downloading non-Apache licensed
software. this caused travis ci builds to hang indefinitely.
you can now bypass this with a very long argument to the script.
Kellen Sunderland [Fri, 2 Dec 2016 10:04:01 +0000 (11:04 +0100)]
JOSHUA-324 renamed LICENSE, removed minification of license in bootstrap.min.css
Lewis John McGibbney [Wed, 18 Jan 2017 21:30:54 +0000 (13:30 -0800)]
Add version to Maven assembly plugin
Lewis John McGibbney [Wed, 18 Jan 2017 21:26:45 +0000 (13:26 -0800)]
Set skip to false in Maven assembly
Lewis John McGibbney [Wed, 18 Jan 2017 21:19:38 +0000 (13:19 -0800)]
Address tarLongFileMode definition in Maven assembly
Lewis John McGibbney [Wed, 18 Jan 2017 21:14:23 +0000 (13:14 -0800)]
Address tarLongFileMode definition in Maven assembly
Lewis John McGibbney [Wed, 18 Jan 2017 20:31:45 +0000 (12:31 -0800)]
Rollback version
Lewis John McGibbney [Wed, 18 Jan 2017 03:12:10 +0000 (19:12 -0800)]
JOSHUA-324 Address Apache Joshua 6.1 RC#2 Issues
Tommaso Teofili [Wed, 21 Dec 2016 10:44:27 +0000 (11:44 +0100)]
JOSHUA-324 - added missing incubating suffix
Matt Post [Mon, 12 Dec 2016 15:29:57 +0000 (10:29 -0500)]
Merge branch 'JOSHUA-325'
Matt Post [Mon, 12 Dec 2016 15:29:48 +0000 (10:29 -0500)]
added warning prompt
Matt Post [Sat, 10 Dec 2016 13:20:33 +0000 (08:20 -0500)]
updated org.apache parent POM version
Matt Post [Fri, 9 Dec 2016 21:10:52 +0000 (16:10 -0500)]
skip alignment stage if the consolidated file exists
Matt Post [Fri, 9 Dec 2016 21:07:13 +0000 (16:07 -0500)]
updated to allow a consolidated thrax input file
Tobias Domhan [Thu, 1 Dec 2016 09:21:52 +0000 (10:21 +0100)]
Merge branch 'master' of https://github.com/apache/incubator-joshua
Matt Post [Wed, 30 Nov 2016 14:58:50 +0000 (09:58 -0500)]
Merge branch 'JOSHUA-324'
Kellen Sunderland [Wed, 30 Nov 2016 09:41:26 +0000 (10:41 +0100)]
JOSHUA-324 Included correct license for OwnerMapTest
Tobias Domhan [Fri, 25 Nov 2016 10:06:58 +0000 (11:06 +0100)]
Updated list of committers with profile of tdomhan.
Matt Post [Wed, 23 Nov 2016 12:03:34 +0000 (07:03 -0500)]
fixed mailing list address user@ -> dev@
Michael A. Hedderich [Tue, 22 Nov 2016 12:36:53 +0000 (13:36 +0100)]
Updated list of committers with profile of mhedderich.
Lewis John McGibbney [Wed, 23 Nov 2016 04:28:21 +0000 (20:28 -0800)]
Add exclusion for pom.xml.releaseBackup to assembly
Lewis John McGibbney [Wed, 23 Nov 2016 03:45:49 +0000 (19:45 -0800)]
[maven-release-plugin] prepare for next development iteration
Lewis John McGibbney [Wed, 23 Nov 2016 03:45:42 +0000 (19:45 -0800)]
[maven-release-plugin] prepare release apache-joshua-6.1
Lewis John McGibbney [Wed, 23 Nov 2016 03:43:08 +0000 (19:43 -0800)]
Prepare for Joshia 6.1 incubating RC#2
Matt Post [Tue, 22 Nov 2016 18:55:37 +0000 (13:55 -0500)]
Merge branch 'master' of github.com:KellenSunderland/incubator-joshua