incubator-amaterasu.git
5 weeks agoadded tags master
Yaniv Rodenski [Sun, 15 Apr 2018 11:01:44 +0000 (21:01 +1000)] 
added tags

5 weeks agochanged branch regex
Yaniv Rodenski [Sun, 15 Apr 2018 07:36:56 +0000 (17:36 +1000)] 
changed branch regex

5 weeks agocleand up script
Yaniv Rodenski [Sat, 14 Apr 2018 14:00:47 +0000 (00:00 +1000)] 
cleand up script

5 weeks agoadded test
Yaniv Rodenski [Sat, 14 Apr 2018 13:45:26 +0000 (23:45 +1000)] 
added test

5 weeks agomoved env to script
Yaniv Rodenski [Sat, 14 Apr 2018 13:41:09 +0000 (23:41 +1000)] 
moved env to script

5 weeks agoadded echo for debug
Yaniv Rodenski [Sat, 14 Apr 2018 12:14:02 +0000 (22:14 +1000)] 
added echo for debug

5 weeks agoadded export to TRAVIS_BRANCH
Yaniv Rodenski [Sat, 14 Apr 2018 12:03:49 +0000 (22:03 +1000)] 
added export to TRAVIS_BRANCH

5 weeks agoadded branch env to build yaml
Yaniv Rodenski [Sat, 14 Apr 2018 11:48:18 +0000 (21:48 +1000)] 
added branch env to build yaml

5 weeks agoadded branch env to build yaml
Yaniv Rodenski [Sat, 14 Apr 2018 11:39:30 +0000 (21:39 +1000)] 
added branch env to build yaml

5 weeks agoadded branch env to build yaml
Yaniv Rodenski [Sat, 14 Apr 2018 11:38:27 +0000 (21:38 +1000)] 
added branch env to build yaml

5 weeks agoreleasing version brances
Yaniv Rodenski [Sat, 14 Apr 2018 00:34:31 +0000 (10:34 +1000)] 
releasing version brances

6 weeks agoMerge pull request #16 from annoymousGiraf/master
Yaniv Rodenski [Wed, 11 Apr 2018 03:47:19 +0000 (13:47 +1000)] 
Merge pull request #16 from annoymousGiraf/master

update badge for incubator

6 weeks agoupdate badge for incubator 16/head
guy peleg [Wed, 11 Apr 2018 02:43:24 +0000 (12:43 +1000)] 
update badge for incubator

6 weeks agoMerge pull request #15 from annoymousGiraf/master
Yaniv Rodenski [Wed, 11 Apr 2018 01:20:53 +0000 (11:20 +1000)] 
Merge pull request #15 from annoymousGiraf/master

Build Pipe line

7 weeks agoupdating premission on branches 15/head
Guy Peleg - The Real thing [Tue, 3 Apr 2018 01:53:49 +0000 (11:53 +1000)] 
updating premission on branches

should be change to RC, + refine the files with versions

7 weeks agoadding skip clenaup
Guy Peleg - The Real thing [Tue, 3 Apr 2018 01:33:06 +0000 (11:33 +1000)] 
adding skip clenaup

7 weeks agoUpdating path for release
Guy Peleg - The Real thing [Tue, 3 Apr 2018 01:25:26 +0000 (11:25 +1000)] 
Updating path for release

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Tue, 3 Apr 2018 01:02:18 +0000 (11:02 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Tue, 3 Apr 2018 00:51:48 +0000 (10:51 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Tue, 3 Apr 2018 00:49:28 +0000 (10:49 +1000)] 
Update .travis.yml

7 weeks agotest
Guy Peleg - The Real thing [Mon, 2 Apr 2018 13:37:22 +0000 (23:37 +1000)] 
test

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Mon, 2 Apr 2018 13:09:42 +0000 (23:09 +1000)] 
Update .travis.yml

7 weeks agoadd release
guy.peleg [Mon, 2 Apr 2018 12:59:09 +0000 (22:59 +1000)] 
add release

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Sun, 1 Apr 2018 00:49:30 +0000 (10:49 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Sun, 1 Apr 2018 00:27:32 +0000 (10:27 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Sun, 1 Apr 2018 00:23:49 +0000 (10:23 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Sun, 1 Apr 2018 00:21:03 +0000 (10:21 +1000)] 
Update .travis.yml

7 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Sun, 1 Apr 2018 00:18:32 +0000 (10:18 +1000)] 
Update .travis.yml

7 weeks agoMerge pull request #4 from roadan/AMATERASU-20
Guy Peleg - The Real thing [Sat, 31 Mar 2018 11:04:40 +0000 (22:04 +1100)] 
Merge pull request #4 from roadan/AMATERASU-20

fixed path case in tests to support Upper case repos

7 weeks agoMerge branch 'master' into AMATERASU-20 14/head
Guy Peleg - The Real thing [Sat, 31 Mar 2018 11:04:28 +0000 (22:04 +1100)] 
Merge branch 'master' into AMATERASU-20

7 weeks agofixed path case in tests to support Upper case repos
Yaniv Rodenski [Fri, 30 Mar 2018 03:54:33 +0000 (14:54 +1100)] 
fixed path case in tests to support Upper case repos

8 weeks agolower path
guy.peleg [Thu, 29 Mar 2018 03:18:52 +0000 (14:18 +1100)] 
lower path

8 weeks agoUpdate .travis.yml
Guy Peleg - The Real thing [Tue, 27 Mar 2018 23:55:41 +0000 (10:55 +1100)] 
Update .travis.yml

adding cahce

8 weeks agoMerge pull request #3 from roadan/AMATERASU-20
Guy Peleg - The Real thing [Tue, 27 Mar 2018 22:33:11 +0000 (09:33 +1100)] 
Merge pull request #3 from roadan/AMATERASU-20

Amaterasu 20

8 weeks agoMerge pull request #13 from eyalbenivri/AMATERASU-18
Yaniv Rodenski [Tue, 27 Mar 2018 05:43:15 +0000 (16:43 +1100)] 
Merge pull request #13 from eyalbenivri/AMATERASU-18

AMATERASU-18

8 weeks agofixed path case in tests
Yaniv Rodenski [Tue, 27 Mar 2018 05:27:39 +0000 (16:27 +1100)] 
fixed path case in tests

8 weeks agofixed path case in tests
Yaniv Rodenski [Tue, 27 Mar 2018 05:17:35 +0000 (16:17 +1100)] 
fixed path case in tests

8 weeks agoadditional logging for travis
Yaniv Rodenski [Tue, 27 Mar 2018 03:55:45 +0000 (14:55 +1100)] 
additional logging for travis

8 weeks agocleaned root
Yaniv Rodenski [Tue, 27 Mar 2018 03:46:52 +0000 (14:46 +1100)] 
cleaned root

8 weeks agodeleted dup spark master
Yaniv Rodenski [Tue, 27 Mar 2018 03:44:51 +0000 (14:44 +1100)] 
deleted dup spark master

8 weeks agochanged env.workingDir schema in tests
Yaniv Rodenski [Tue, 27 Mar 2018 03:39:06 +0000 (14:39 +1100)] 
changed env.workingDir schema in tests

8 weeks agofixed tests work path
Yaniv Rodenski [Tue, 27 Mar 2018 03:23:00 +0000 (14:23 +1100)] 
fixed tests work path

8 weeks agofixed tests work path
Yaniv Rodenski [Tue, 27 Mar 2018 03:07:47 +0000 (14:07 +1100)] 
fixed tests work path

8 weeks agotests are runing cleanly
Yaniv Rodenski [Tue, 27 Mar 2018 02:22:18 +0000 (13:22 +1100)] 
tests are runing cleanly

8 weeks agoMerge pull request #2 from roadan/AMATERASU-20
Guy Peleg - The Real thing [Tue, 27 Mar 2018 02:05:25 +0000 (13:05 +1100)] 
Merge pull request #2 from roadan/AMATERASU-20

Amaterasu 20

8 weeks agofixed absolute paths in tests
Yaniv Rodenski [Sun, 25 Mar 2018 23:43:46 +0000 (10:43 +1100)] 
fixed absolute paths in tests

2 months agohandling memory formats 13/head
Yaniv Rodenski [Mon, 5 Mar 2018 00:20:11 +0000 (11:20 +1100)] 
handling memory formats

2 months agofixed some bugs
Eyal Ben Ivri [Sun, 4 Mar 2018 21:37:44 +0000 (22:37 +0100)] 
fixed some bugs

2 months agoMerge pull request #12 from annoymousGiraf/master
Yaniv Rodenski [Sun, 4 Mar 2018 11:41:37 +0000 (22:41 +1100)] 
Merge pull request #12 from annoymousGiraf/master

adding basic pipeline with distribution list

2 months agoUpdate .travis.yml 12/head
Yaniv Rodenski [Sun, 4 Mar 2018 11:41:15 +0000 (22:41 +1100)] 
Update .travis.yml

Moving to apache.org email, will change to commits@ mailing list later

2 months agoget cpus return cpus now :)
Yaniv Rodenski [Sun, 4 Mar 2018 10:15:10 +0000 (21:15 +1100)] 
get cpus return cpus now :)

2 months agodriverConfiguration not cupled to spark
Yaniv Rodenski [Sun, 4 Mar 2018 10:08:15 +0000 (21:08 +1100)] 
driverConfiguration not cupled to spark

2 months agoadded spark framework providers support and moved logic there.
Eyal Ben Ivri [Sun, 4 Mar 2018 09:52:03 +0000 (10:52 +0100)] 
added spark framework providers support and moved logic there.

2 months agoremoved .gitignore-ception
Eyal Ben Ivri [Sun, 4 Mar 2018 08:55:49 +0000 (09:55 +0100)] 
removed .gitignore-ception
refactored execData in sparkrunnersprovider
added future comment
but mainly added logic in appmaster to handle spark-specific configurations

2 months agoadded driver configuration to the SDK
Yaniv Rodenski [Sun, 4 Mar 2018 01:03:48 +0000 (12:03 +1100)] 
added driver configuration to the SDK

2 months agoMerge github.com:apache/incubator-amaterasu
guy.peleg [Sun, 25 Feb 2018 22:59:42 +0000 (09:59 +1100)] 
Merge github.com:apache/incubator-amaterasu

2 months agoadded logic to read ama-workers / spark drivers(am) from configuration. Spark is...
Eyal Ben Ivri [Sun, 25 Feb 2018 14:44:28 +0000 (15:44 +0100)] 
added logic to read ama-workers / spark drivers(am) from configuration. Spark is first, second amaterasu configs, third is defaults. check against maximum cluster resources is also in place.

2 months agoMerge pull request #11 from roadan/AMATERASU-14
Eyal Ben Ivri [Sun, 25 Feb 2018 13:56:13 +0000 (14:56 +0100)] 
Merge pull request #11 from roadan/AMATERASU-14

Amaterasu-14

2 months agoMerge github.com:apache/incubator-amaterasu
guy.peleg [Sun, 25 Feb 2018 10:23:12 +0000 (21:23 +1100)] 
Merge github.com:apache/incubator-amaterasu

2 months agoall tests are fixed 10/head 11/head
Yaniv Rodenski [Sun, 25 Feb 2018 00:17:51 +0000 (11:17 +1100)] 
all tests are fixed

2 months agofixed mesos issues
Yaniv Rodenski [Sat, 24 Feb 2018 13:16:20 +0000 (00:16 +1100)] 
fixed mesos issues

2 months agoMerge pull request #2 from nadav-har-tzvi/AMATERASU-14
Yaniv Rodenski [Fri, 23 Feb 2018 23:41:24 +0000 (10:41 +1100)] 
Merge pull request #2 from nadav-har-tzvi/AMATERASU-14

amaterasu was altered to use yarn, mesos doesn't respect yarn's conveā€¦

2 months agoamaterasu was altered to use yarn, mesos doesn't respect yarn's conventions
Nadav Har Tzvi [Fri, 23 Feb 2018 14:46:47 +0000 (16:46 +0200)] 
amaterasu was altered to use yarn, mesos doesn't respect yarn's conventions
Not working still.

2 months agoreadas -> reads
Yaniv Rodenski [Fri, 23 Feb 2018 06:21:16 +0000 (17:21 +1100)] 
readas -> reads

2 months agonotifier output fix
Yaniv Rodenski [Fri, 23 Feb 2018 06:18:33 +0000 (17:18 +1100)] 
notifier output fix

3 months agoadding customize notifcations
annoymousGiraf [Wed, 21 Feb 2018 01:01:02 +0000 (12:01 +1100)] 
adding customize notifcations

3 months agoadding build step to skip test for now
annoymousGiraf [Wed, 21 Feb 2018 00:54:13 +0000 (11:54 +1100)] 
adding build step to skip test for now

3 months agoUpdate .travis.yml
annoymousGiraf [Wed, 21 Feb 2018 00:53:50 +0000 (11:53 +1100)] 
Update .travis.yml

3 months agoadded license header to new files
Yaniv Rodenski [Mon, 19 Feb 2018 03:37:46 +0000 (14:37 +1100)] 
added license header to new files

3 months agoMerge pull request #9 from eyalbenivri/feature/AMATERASU-16-deploy-bin-check
Yaniv Rodenski [Sun, 18 Feb 2018 10:55:59 +0000 (21:55 +1100)] 
Merge pull request #9 from eyalbenivri/feature/AMATERASU-16-deploy-bin-check

Simple impl. relaying on version check and upload in the yarn client.

3 months agoadded condition on start-yarn script to delete the folder and recreate when force... 9/head
Eyal Ben Ivri [Sun, 18 Feb 2018 10:00:05 +0000 (11:00 +0100)] 
added condition on start-yarn script to delete the folder and recreate when force flag is passed.

3 months agoweb server works on mesos again
Yaniv Rodenski [Sun, 18 Feb 2018 07:45:51 +0000 (18:45 +1100)] 
web server works on mesos again

3 months agoMerge pull request #8 from annoymousGiraf/master
Yaniv Rodenski [Fri, 16 Feb 2018 08:24:21 +0000 (19:24 +1100)] 
Merge pull request #8 from annoymousGiraf/master

replacing Circeci with Travis

3 months agogetting jetty errors
Yaniv Rodenski [Fri, 16 Feb 2018 06:05:51 +0000 (17:05 +1100)] 
getting jetty errors

3 months agoadding badge 8/head
annoymousGiraf [Fri, 16 Feb 2018 01:11:28 +0000 (12:11 +1100)] 
adding badge

3 months agoMoving to travis
annoymousGiraf [Fri, 16 Feb 2018 01:02:05 +0000 (12:02 +1100)] 
Moving to travis

3 months agoDelete config.yml
annoymousGiraf [Fri, 16 Feb 2018 00:57:50 +0000 (11:57 +1100)] 
Delete config.yml

deleting Circieci

3 months agoMerge pull request #7 from annoymousGiraf/master
Yaniv Rodenski [Thu, 15 Feb 2018 12:32:33 +0000 (23:32 +1100)] 
Merge pull request #7 from annoymousGiraf/master

basic travisci support files

3 months agoMerge pull request #1 from annoymousGiraf/AMA-Travis 7/head
annoymousGiraf [Thu, 15 Feb 2018 12:09:03 +0000 (23:09 +1100)] 
Merge pull request #1 from annoymousGiraf/AMA-Travis

adding support for travisci

3 months agoadding support for travisci
annoymousGiraf [Thu, 15 Feb 2018 12:07:52 +0000 (23:07 +1100)] 
adding support for travisci

adding support for travisci intial commit

3 months agoMerge branch 'AMATERASU-14' of github.com:roadan/incubator-amaterasu into AMATERASU-14
Yaniv Rodenski [Wed, 14 Feb 2018 23:44:21 +0000 (10:44 +1100)] 
Merge branch 'AMATERASU-14' of github.com:roadan/incubator-amaterasu into AMATERASU-14

3 months agoSparkSqlRunner implements AmaterasuRunner
Yaniv Rodenski [Wed, 14 Feb 2018 23:44:14 +0000 (10:44 +1100)] 
SparkSqlRunner implements AmaterasuRunner

3 months agoMerge pull request #1 from nadav-har-tzvi/AMATERASU-14
Yaniv Rodenski [Wed, 14 Feb 2018 23:43:18 +0000 (10:43 +1100)] 
Merge pull request #1 from nadav-har-tzvi/AMATERASU-14

fill in for miniconda expected path

3 months agofill in for miniconda expected path
Nadav Har Tzvi [Wed, 14 Feb 2018 21:25:06 +0000 (23:25 +0200)] 
fill in for miniconda expected path

3 months agoMerge pull request #6 from roadan/AMATERASU-15
Eyal Ben Ivri [Tue, 13 Feb 2018 08:39:19 +0000 (09:39 +0100)] 
Merge pull request #6 from roadan/AMATERASU-15

Let's open an improvement ticket regarding the suggestion made here

3 months agotests are failing due to conda issue
Yaniv Rodenski [Mon, 12 Feb 2018 02:01:32 +0000 (13:01 +1100)] 
tests are failing due to conda issue

3 months agoadded YARN notifications 6/head
Yaniv Rodenski [Sat, 10 Feb 2018 05:48:13 +0000 (16:48 +1100)] 
added YARN notifications

3 months agoclient registers via zookeeper
Yaniv Rodenski [Sun, 4 Feb 2018 06:42:49 +0000 (17:42 +1100)] 
client registers via zookeeper

3 months agojob with active mq is running successfuly
Yaniv Rodenski [Sat, 3 Feb 2018 13:02:26 +0000 (00:02 +1100)] 
job with active mq is running successfuly

3 months agoregister brocker with zookeeper
Yaniv Rodenski [Sat, 3 Feb 2018 06:51:01 +0000 (17:51 +1100)] 
register brocker with zookeeper

3 months agoregister brocker with zookeeper
Yaniv Rodenski [Sat, 3 Feb 2018 06:50:25 +0000 (17:50 +1100)] 
register brocker with zookeeper

3 months agoadded active mq brocker
Yaniv Rodenski [Fri, 2 Feb 2018 22:27:11 +0000 (09:27 +1100)] 
added active mq brocker

3 months agoMerge pull request #5 from roadan/AMATERASU-17
Eyal Ben Ivri [Thu, 25 Jan 2018 10:22:20 +0000 (11:22 +0100)] 
Merge pull request #5 from roadan/AMATERASU-17

Amaterasu 17

3 months agoMerge branch 'AMATERASU-17' of github.com:roadan/incubator-amaterasu into AMATERASU-17 5/head
Yaniv Rodenski [Thu, 25 Jan 2018 00:00:17 +0000 (11:00 +1100)] 
Merge branch 'AMATERASU-17' of github.com:roadan/incubator-amaterasu into AMATERASU-17

3 months agofixed spark.yarn.jars
Yaniv Rodenski [Wed, 24 Jan 2018 23:40:24 +0000 (10:40 +1100)] 
fixed spark.yarn.jars

3 months agofixed container resources
Yaniv Rodenski [Wed, 24 Jan 2018 12:15:09 +0000 (23:15 +1100)] 
fixed container resources

3 months agoframework files are distributed to containers
Yaniv Rodenski [Wed, 24 Jan 2018 03:06:40 +0000 (14:06 +1100)] 
framework files are distributed to containers

3 months agofixed spark.yarn.jars
Yaniv Rodenski [Wed, 24 Jan 2018 23:40:24 +0000 (10:40 +1100)] 
fixed spark.yarn.jars

3 months agofixed container resources
Yaniv Rodenski [Wed, 24 Jan 2018 12:15:09 +0000 (23:15 +1100)] 
fixed container resources

3 months agoframework files are distributed to containers
Yaniv Rodenski [Wed, 24 Jan 2018 03:06:40 +0000 (14:06 +1100)] 
framework files are distributed to containers