incubator-myriad.git
4 weeks agoMYRIAD-282 Add key information in Vagrant -> libvirt -> mesos (#120) master
Javi Roman [Mon, 17 Dec 2018 20:01:19 +0000 (21:01 +0100)] 
MYRIAD-282 Add key information in Vagrant -> libvirt -> mesos (#120)

Updated some instructions in Vagrant (libvirt) for Mesos in
order to match 1.5.x Mesos version. Included key instructions
about MESOS_NATIVE_JAVA_LIBRARY inclusion as well.

JIRA:
    [MYRIAD-282] https://issues.apache.org/jira/browse/MYRIAD-282

4 weeks agoMYRIAD-281 myriad-repository is pointing to wrong repository (#119)
Javi Roman [Fri, 14 Dec 2018 12:47:16 +0000 (13:47 +0100)] 
MYRIAD-281 myriad-repository is pointing to wrong repository (#119)

JIRA:

 [MYRIAD-281] https://issues.apache.org/jira/browse/MYRIAD-281

2 months agoMYRIAD-264 Upgrade Mesos API to 1.5.0
jpgilaberte [Fri, 26 Oct 2018 13:48:38 +0000 (15:48 +0200)] 
MYRIAD-264 Upgrade Mesos API to 1.5.0

Until now Apache Myriad was based on Apache Mesos API 0.28.x
This patch enable Aapache Myriad for running in Apache Mesos 1.5.x

In order to align with current Apache Mesos deployments we have to
upgrade "at least" towards Apache Mesos 1.5.x API (this is the Mesos version
shipped in DC/OS 1.11.x and son on).

JIRA:
    [MYRIAD-264] https://issues.apache.org/jira/browse/MYRIAD-264

Pull Request:
    Closes #114

Author:    jpgilaberte <jpgilaberte@stratio.com>
Date:      Fri Oct 26 15:48:38 2018 +0200

2 months agoMYRIAD-277 Fix source repository for Apache Mesos
Javi Roman [Fri, 16 Nov 2018 16:40:40 +0000 (17:40 +0100)] 
MYRIAD-277 Fix source repository for Apache Mesos

Avoiding Ansible deprecation warnings, and fixed Apache Mesos git source

JIRA:
    [MYRIAD-277] https://issues.apache.org/jira/browse/MYRIAD-277

Pull Request:
    Closes #115

Author:    Javi Roman <jroman.espinar@gmail.com>
Date:      Fri Nov 16 17:40:40 2018 +0100

2 months agoMYRIAD-274 Fix auto-incremented dependencies
jpgilaberte [Fri, 19 Oct 2018 14:35:11 +0000 (16:35 +0200)] 
MYRIAD-274 Fix auto-incremented dependencies

Myriad.js is not added to the jar in the build

In the construction phase of the scheduler, the buffer / uglify task
fails without a trace and does not add myriad.js to the js folder.
Possibly it is due to an incompatibility between versions and how
the versions in Node are handled with ~ and ^.

JIRA:
    [MYRIAD-274] https://issues.apache.org/jira/projects/MYRIAD/issues/MYRIAD-274

Pull Request:
    Closes #113

Author:    jpgilaberte <jpgilaberte@stratio.com>
Date:      Fri Oct 19 16:35:11 2018 +0200

7 months agoMYRIAD-267 Mount local Myriad development folder into build VM
Javi Roman [Wed, 6 Jun 2018 13:40:59 +0000 (15:40 +0200)] 
MYRIAD-267 Mount local Myriad development folder into build VM

In order to make easier the development, an improvement is
mount the local (laptop) development repository of Myriad
into the "build" VM. So you can edit out of the VM and you
get the build output within the VM for using it.

JIRA:
    [MYRIAD-267] https://issues.apache.org/jira/browse/MYRIAD-267

Pull Request:
    Closes #112

Author:    Javi Roman <jroman.espinar@gmail.com>
Date:      Wed Jun 6 15:40:59 2018 +0200

8 months agoRemove maven central repository, use only jcenter
Yinon Avraham [Wed, 25 Oct 2017 11:08:53 +0000 (14:08 +0300)] 
Remove maven central repository, use only jcenter

jcenter is a super set on top of maven central,
so having both of those repositories is redundant,
and the preferred one should be jcenter.

Pull Request:
    Closes #103

Author:    Yinon Avraham <yinonavraham@gmail.com>
Date:      Wed Oct 25 14:08:53 2017 +0300

8 months agoMYRIAD-263 Add HDFS as system service in DC/OS vagrant testbed
Javi Roman [Sat, 21 Apr 2018 11:11:48 +0000 (13:11 +0200)] 
MYRIAD-263 Add HDFS as system service in DC/OS vagrant testbed

The local development environment based on vagrant-libvirt (DC/OS)
needs deploy HDFS as foundation for Myriad. We have available HDFS
as Mesos framework at Mesosphere Universe, however running this
framework is not straightforward. So I propose deploy HDFS as systemd services,
this is easy and allow us focus the in our development (Myriad).

JIRA:
    [MYRIAD-263] https://issues.apache.org/jira/browse/MYRIAD-263

Pull Request:
    Closes #110

Author:    Javi Roman <jroman.espinar@gmail.com>
Date:      Sat Apr 21 13:11:48 2018 +0200

8 months agoMYRIAD-80 Resolvedependency conflicts
jpgilaberte [Sat, 3 Feb 2018 08:42:48 +0000 (09:42 +0100)] 
MYRIAD-80 Resolvedependency conflicts

The Yarn lib directory contains jars that have different versions
than what appears in the myriad build/libs directory. This causes
multiple versions of libraries to be in the yarn/libs directory
if you blindly copy jars from the build directory.

JIRA:
    [MYRIAD-80] https://issues.apache.org/jira/browse/MYRIAD-80

Pull Request:
    Closes #105

Author:    jpgilaberte <jpgilaberte@stratio.com>
Date:      Sat Feb 3 09:42:48 2018 +0100

9 months agoAdded links to readme.md and fixed other stuff.
jpgilaberte [Wed, 18 Apr 2018 16:20:25 +0000 (18:20 +0200)] 
Added links to readme.md and fixed other stuff.

Resolve confilcts in branch. Copy form PR #52 make by @ruth-mapr

Pull Request:
    Closes #109
    Closes #52

Author:    jpgilaberte <jpgilaberte@stratio.com>
Date:      Wed Apr 18 18:20:25 2018 +0200

9 months agoMYRIAD-73 Add <pre> tag in yaml example
jpgilaberte [Fri, 2 Feb 2018 11:03:56 +0000 (12:03 +0100)] 
MYRIAD-73 Add <pre> tag in yaml example

JIRA:
    [MYRIAD-73] https://issues.apache.org/jira/browse/MYRIAD-73

Pull Request:
    Closes #106

Author:    jpgilaberte <jpgilaberte@stratio.com>
Date:      Fri Feb 2 12:03:56 2018 +0100

9 months agoA full DC/OS cluster for Apache Myriad development and testing with resources
Javi Roman [Sat, 7 Apr 2018 08:59:50 +0000 (10:59 +0200)] 
A full DC/OS cluster for Apache Myriad development and testing with resources
such as Mesos-DNS, Minuteman load balancer (VIPs), Marathon meta-scheduler and so on.

JIRA:
    [MYRIAD-262] https://issues.apache.org/jira/browse/MYRIAD-262

Pull Request:
    Closes #108

Author:  Javi Roman <jroman.espinar@gmail.com>
Date:    Sat Apr 7 10:59:50 2018 +0200

9 months agoSupport for Vagrant-libvirt based testbed.
Javi Roman [Fri, 16 Mar 2018 18:22:08 +0000 (19:22 +0100)] 
Support for Vagrant-libvirt based testbed.

The top level vagrant folder is organizated for supporing a set of
Vagrant file approaches. The first approach is to support Apache Mesos
clusters for Apache Myriad development. The availables configuraions are:

1. vagrant/mesos/virtualbox -> the original Vagrant file so far in Apache Myriad
2. vagrant/mesos/libvirt -> new Vagrant structure based on Libivrt/KVM

JIRA:
    [MYRIAD-261] https://issues.apache.org/jira/browse/MYRIAD-261

Pull Request:
    Closes #107

Author: Javi Roman <jroman.espinar@gmail.com>
Date:   Fri, 16 Mar 2018 19:22:08 +0100

9 months agoSwitching to oraclejdk8 to take care of JDK version issues with builds
Mohit Soni [Wed, 15 Nov 2017 14:54:40 +0000 (09:54 -0500)] 
Switching to oraclejdk8 to take care of JDK version issues with builds

Pull Request:
        Closes #104

Author: Mohit Soni <mohitsoni1989@gmail.com>
Date:   Wed Nov 15 09:54:40 2017 -0500

2 years agoUsed reserved resources firstly. 93/head 94/head 97/head 98/head
Klaus Ma [Fri, 7 Oct 2016 13:49:58 +0000 (21:49 +0800)] 
Used reserved resources firstly.

2 years agoImplementation of MYRIAD-229, MYRIAD-237, MYRIAD-238, MYRIAD-225
hokiegeek2 [Wed, 17 Aug 2016 19:21:56 +0000 (15:21 -0400)] 
Implementation of MYRIAD-229, MYRIAD-237, MYRIAD-238, MYRIAD-225
JIRA:
[MYRIAD-225] https://issues.apache.org/jira/browse/MYRIAD-225
        [MYRIAD-229] https://issues.apache.org/jira/browse/MYRIAD-239
        [MYRIAD-237] https://issues.apache.org/jira/browse/MYRIAD-237
[MYRIAD-237] https://issues.apache.org/jira/browse/MYRIAD-237
Pull Request:
  Closes #91

Author:    hokiegeek2 <hokiegeek2@gmail.com>
Date:      Wed Aug 17 15:21:56 2016 -0400

2 years agoRefactor which addresses Myriad 213, 214, and 136 in the process.
DarinJ [Thu, 9 Jun 2016 14:08:46 +0000 (10:08 -0400)] 
Refactor which addresses Myriad 213, 214, and 136 in the process.
-Refactored ExecutorCommandLineGenerator classes to use this class (resolves Myriad-214 in the process).
-Refactor TackFactory classes as necessary to work with this. This adds a removes several methods to TaskUtils to get port Resources.
-Created a ResourceOfferContainer moving the work of checking offers and creating the resources from them out of the ResourceOfferEventHandler and TaskFactory Classes.
-Remove NMPorts and Ports classes.
JIRA:
[MYRIAD-136] https://issues.apache.org/jira/browse/MYRIAD-136
        [MYRIAD-213] https://issues.apache.org/jira/browse/MYRIAD-213
        [MYRIAD-214] https://issues.apache.org/jira/browse/MYRIAD-214
Pull Request:
  Closes #79

2 years agoMYRIAD-218 Cleaned up TaskUtils. Removed unused methods and methods
ponnu [Tue, 26 Jul 2016 01:03:15 +0000 (21:03 -0400)] 
MYRIAD-218 Cleaned up TaskUtils. Removed unused methods and methods
which are only used in unit tests
JIRA:
[MYRIAD-218] https://issues.apache.org/jira/browse/MYRIAD-218
Pull Request:
  Closes #87
Author:    ponnu <ponnulingam.r@gmail.com>
Date:      Mon Jul 25 21:03:15 2016 -0400

2 years agoMYRIAD-234 JUnit test additions, updates, minor code cleanup, and
hokiegeek2 [Fri, 15 Jul 2016 13:12:24 +0000 (09:12 -0400)] 
MYRIAD-234 JUnit test additions, updates, minor code cleanup, and
additional javadoc comments
JIRA:
  [MYRIAD-234] https://issues.apache.org/jira/browse/MYRIAD-234
Pull Request:
  Closes #86
Author:    hokiegeek2 <hokiegeek2@gmail.com>
Date:      Fri Jul 15 09:12:24 2016 -0400

2 years agoMYRIAD-220 Initial check-in
hokiegeek2 [Thu, 30 Jun 2016 20:03:44 +0000 (16:03 -0400)] 
MYRIAD-220 Initial check-in
Encapsulates changes to implement MYRIAD-220 along with enhanced/added comments
JIRA:
  [MYRIAD-220] https://issues.apache.org/jira/browse/MYRIAD-220
Pull Request:
  Closes #84
Author:    hokiegeek2 <hokiegeek2@gmail.com>
Date:      Thu Jun 30 16:03:44 2016 -0400

2 years agoMYRIAD-200
hokiegeek2 [Thu, 9 Jun 2016 19:03:24 +0000 (15:03 -0400)] 
MYRIAD-200

Increase JUnit Test Coverage

JIRA:
  [MYRIAD-200] https://issues.apache.org/jira/browse/MYRIAD-200

Pull Request:
  Closes #78

Author:    hokiegeek2 <hokiegeek2@gmail.com>

2 years agoWebsite updates.
DarinJ [Wed, 29 Jun 2016 04:46:59 +0000 (00:46 -0400)] 
Website updates.

When the last the last PR was merged the @JsonSerialize anotations were not being removed on objects that are no longer Optionals.  This caused the config to not be serialized properly and this broke REST interface /api/config and the corresponding issues with the WebUI.

2 years agotypo & set minimum-allocation-mb for fine grain
Klaus Ma [Thu, 30 Jun 2016 03:38:37 +0000 (11:38 +0800)] 
typo & set minimum-allocation-mb for fine grain

set minimum-allocation-mb for fine grain.

Pull Request:
  Closes #82

Author:    Klaus Ma <madaxa@cn.ibm.com>

2 years agoFixed regression in Configuration
darinj [Sun, 26 Jun 2016 20:17:17 +0000 (16:17 -0400)] 
Fixed regression in Configuration

When the last the last PR was merged the @JsonSerialize anotations were not being removed on objects that are no longer Optionals.  This caused the config to not be serialized properly and this broke REST interface /api/config and the corresponding issues with the WebUI.

Pull Request:
  Closes #80

Author:    darinj <darinj.work@gmail.com>

2 years agoBulk commit of MYRIAD-198 changes
hokiegeek2 [Fri, 20 May 2016 16:11:32 +0000 (12:11 -0400)] 
Bulk commit of MYRIAD-198 changes

We overuse Optionals in the config and then use an or method in various factories later. In many cases having the configuration return a default when the parameter was specified would create cleaner code.

Pull Request:
  Closes #76
Author: hokiegeek2 <hokiegeek2@gmail.com>

2 years agoUpdate cgroups documentation - was missing a necessary yarn-site configuration. 0.2.x 116/head myriad-0.2.0-incubating
darinj [Sat, 21 May 2016 18:37:28 +0000 (14:37 -0400)] 
Update cgroups documentation - was missing a necessary yarn-site configuration.
Fix minor typo hierachy->hierarchy.
Pull Request:
  Closes #65
Author: Darin Johnson <darinj@apache.org>

2 years agoUpdate NOTICE file to 2016
darinj [Tue, 17 May 2016 21:03:01 +0000 (17:03 -0400)] 
Update NOTICE file to 2016

Author: Darin Johnson <darinj@apache.org>

2 years agoCouple of minor bug fixes for 0.2.0 RC:
Sarjeet Singh [Mon, 16 May 2016 08:41:16 +0000 (01:41 -0700)] 
Couple of minor bug fixes for 0.2.0 RC:
1. UI frameworkShutdown is broken because of PR#58.
2. Additional 'sudo' from cgroup cmdline.
3. Adding profile info to flexdown UI (keep same with flexup).
Pull Request:
  Closes #74
Author: sarjeet2013

2 years agodocker/build.gradle was missing header file
darinj [Fri, 13 May 2016 01:56:25 +0000 (21:56 -0400)] 
docker/build.gradle was missing header file
Pull Request:
  Closes #73
Author: DarinJ <darinj@apache.org>

2 years agoRelease prep: 0.2.0
darinj [Thu, 12 May 2016 18:56:49 +0000 (14:56 -0400)] 
Release prep:
-Version bump 0.2.0
-Update Docs
-Update Sample Configuration
-Minor changes to docker scripts
Pull Request:
  Closes: #72

2 years agoContinuation of Myriad 171, started to work towards public methods incrementResources...
darinj [Tue, 10 May 2016 20:47:02 +0000 (16:47 -0400)] 
Continuation of Myriad 171, started to work towards public methods incrementResources and decrementResources, as it's easier to reason about purely additve functions in multithreaded environments.  Fixed minor bugs in previous Myriad-171 patch, placed the guard for Node Managers having negative resources in setNodeCapacity and reverted back any from calling yarnScheduler.updateNode directly.  Very well tested.

Todo: Figure out how to make setNodeCapacity private.
JIRA:
  [Myriad-171] https://issues.apache.org/jira/browse/MYRIAD-171
Pull Request:
  Closes #70
Author:
  DarinJ <darinj@apache.org>

2 years agoCreated better cgroup support please see cgroups.md for documentation.
darinj [Fri, 6 May 2016 04:02:57 +0000 (00:02 -0400)] 
Created better cgroup support please see cgroups.md for documentation.
JIRA:
  [Myriad-192] https://issues.apache.org/jira/browse/MYRIAD-192
Pull Request:
  Closes #69
Author:
  DarinJ <darinj@apache.org>

2 years agoAdded the ability to specify a URI to pull configuration data from, also added to...
darinj [Tue, 3 May 2016 03:09:49 +0000 (23:09 -0400)] 
Added the ability to specify a URI to pull configuration data from, also added to REST endpoints:
/api/config.tgz and /api/binary.tgz which provide an easy download for the hadoop configs and the hadoop binarys.  Configuration is done by assigning:

servedConfigPath: dist/config.tgz
servedBinaryPath: dist/hadoop-2.7.0.tgz

and

executor:
  configUri: http://127.0.0.1:8192/api/artifacts/config.tgz
  nodemanagerUri: http://127.0.0.1:8192/api/artifacts/binary.tgz

Able to use,
yarnEnvironment:
  HADOOP_CONF_DIR=$MESOS_SANDBOX/config
  YARN_HOME=$MESOS_SANDBOX/hadoop-2.7.0

JIRA:
  [Myriad-189] https://issues.apache.org/jira/browse/MYRIAD-189
Pull Request:
  Closes #68
Author:
  DarinJ <darinj@apache.org>

2 years agoAdded Docker Support, see the README.md in docker directory for quick start guide.
darinj [Mon, 2 May 2016 19:08:20 +0000 (15:08 -0400)] 
Added Docker Support, see the README.md in docker directory for quick start guide.

Code changes:
- Added classes necessary to pass configuration to TaskFactory
- Modified classes necessary to consume the configuration changes
- Edits to docker/scripts mostly to break up the build

@Todo
- add support for MesosInfo (for AppC support), will be done as more information about the MesosInfo object appears.
- add configuration Uri to avoid rebuilding images (done, separate PR).
- clean up docker scripts more, including the ability to pass build arguments, will be incrementally done.

JIRA:
  [Myriad-136] https://issues.apache.org/jira/browse/MYRIAD-136
Pull Request:
  Closes #67
Author:
  DarinJ <darinj@apache.org>

Code changes:
- Added classes necessary to pass configuration to TaskFactory
- Modified classes necessary to consume the configuration changes
- Edits to docker/scripts mostly to break up the build

@Todo
- add support for MesosInfo (for AppC support), will be done as more information about the MesosInfo object appears.
- add configuration Uri to avoid rebuilding images (done, separate PR).
- clean up docker scripts more, including the ability to pass build arguments, will be incrementally done.

2 years agoUpdate to mesos 0.28.1
Mohit Soni [Sun, 1 May 2016 08:02:14 +0000 (01:02 -0700)] 
Update to mesos 0.28.1
JIRA:
  [Myriad-197] https://issues.apache.org/jira/browse/MYRIAD-197
Pull Request:
  Closes #66
Author:
  Mohit Soni <mohitsoni1989@gmail.com>

2 years agoMade JVM URI, Path and JAVA_LIBRARY_PATH configurable for executors
Mohit Soni [Sun, 1 May 2016 07:52:54 +0000 (00:52 -0700)] 
Made JVM URI, Path and JAVA_LIBRARY_PATH configurable for executors
JIRA:
  [Myriad-196] https://issues.apache.org/jira/browse/MYRIAD-196
Pull Request:
  Closes #65
Author:
  Mohit Soni <mohitsoni1989@gmail.com>

2 years ago[Myriad 171] - updateFile had parameter change between Hadoop 2.7.0->2.7.1
darinj [Mon, 14 Mar 2016 06:04:26 +0000 (02:04 -0400)] 
[Myriad 171] - updateFile had parameter change between Hadoop 2.7.0->2.7.1
[Myriad 190] - Tests fail on Hadoop 2.6.2+

Corrects behavior for hadoop 2.7.1+ and hadoop 2.6.2+.

Added support to specify hadoopVer from command line as follows:
```
./gradlew -PhadoopVer=X.Y.Z build
```
where `X.Y.Z` is the hadoop version.

JIRA:
  [Myriad-171] https://issues.apache.org/jira/browse/MYRIAD-171
  [Myriad-190] https://issues.apache.org/jira/browse/MYRIAD-190

Pull Request:
  Closes #63

Author:
  darinj darinj@apache.org

2 years agoDocker Gradle Integration
Brandon Gulla [Wed, 18 Nov 2015 17:51:49 +0000 (12:51 -0500)] 
Docker Gradle Integration

Docker RM now is built via Gradle.

Pull Request:
  Closes #55

Author:
  Brandon Gulla brandon@brandongulla.com

2 years ago[Myriad 188] - NodeManager switch to UNHEALTHY causes NPE on ResourceManager.
darinj [Tue, 8 Mar 2016 10:51:51 +0000 (05:51 -0500)] 
[Myriad 188] - NodeManager switch to UNHEALTHY causes NPE on ResourceManager.

JIRA:
  [Myriad-188] https://issues.apache.org/jira/browse/MYRIAD-188
  [Myriad-156] https://issues.apache.org/jira/browse/MYRIAD-156

Pull Request:
  Closes #62

Author:
  darinj darinj@apache.org

2 years ago[MYRIAD-153] tasks not finishing when FGS is enabled.
DarinJ [Tue, 23 Feb 2016 04:05:29 +0000 (23:05 -0500)] 
[MYRIAD-153] tasks not finishing when FGS is enabled.

The root cause is that when a container is preempted by the Resource Manager, it can go from AQUIRED to RELEASED in which case the Mesos task would be started, however since the container never got to state RUNNING the ContainerManagerImpl never called MyriadAuxService.initializeContainer or MyriadAuxService.stopContainer the solution is to intercept the method releaseContainers in AbstractScheduler to kill any yarn_task which is preempted this way and immediately adjust the resources of the node so another container doesn't start expecting these resources.

JIRA:
  [MYRIAD-153] https://issues.apache.org/jira/browse/MYRIAD-153

Pull Request:
  Closes #59

2 years agoMYRIAD-186 Clean up the build
Zachary Jaffee [Fri, 26 Feb 2016 23:31:08 +0000 (15:31 -0800)] 
MYRIAD-186 Clean up the build

JIRA:
  [MYRIAD-186] https://issues.apache.org/jira/browse/MYRIAD-186

Pull Request:
  Closes #60

2 years agoThis closes: #56
Ken Sipe [Wed, 24 Feb 2016 18:31:11 +0000 (12:31 -0600)] 
This closes: #56
Review: https://github.com/apache/incubator-myriad/pull/56

2 years agoThis closes: #53
Ken Sipe [Wed, 24 Feb 2016 18:13:54 +0000 (12:13 -0600)] 
This closes: #53
Review: https://github.com/apache/incubator-myriad/pull/53

2 years agoThis closes: #58
Ken Sipe [Wed, 24 Feb 2016 18:10:57 +0000 (12:10 -0600)] 
This closes: #58
Review: https://github.com/apache/incubator-myriad/pull/58

2 years agoadded import and changed logger to not be static
Ken Sipe [Wed, 24 Feb 2016 18:10:40 +0000 (12:10 -0600)] 
added import and changed logger to not be static

2 years agoMerge branch 'pr-54'
Ken Sipe [Wed, 24 Feb 2016 17:52:05 +0000 (11:52 -0600)] 
Merge branch 'pr-54'

This closes: #54
Review: https://github.com/apache/incubator-myriad/pull/54

2 years agoAdded blog post to announce Myriad 0.1.0
smarella [Sat, 12 Dec 2015 09:43:00 +0000 (01:43 -0800)] 
Added blog post to announce Myriad 0.1.0

- Created separate "news" and "blogs" dirs under _posts
- Included "Blogs" in left side nav and in the footer
- Fixed landing page to show only "news" feeds only
- New blogs added to "_posts/blogs" will be auto picked

This closes: #54
Review: https://github.com/apache/incubator-myriad/pull/54

2 years agoMYRIAD-175 Change Destroy myriad REST api method from 'GET' to 'POST/PUT' 58/head
Zachary Jaffee [Wed, 24 Feb 2016 05:04:21 +0000 (21:04 -0800)] 
MYRIAD-175 Change Destroy myriad REST api method from 'GET' to 'POST/PUT'

2 years agoMYRIAD-181 Build failure due to dependency on zookeeper test jar 56/head
Zachary Jaffee [Fri, 19 Feb 2016 06:09:50 +0000 (22:09 -0800)] 
MYRIAD-181 Build failure due to dependency on zookeeper test jar

3 years agoFixed typo in gradle.properties name
Mohit Soni [Fri, 18 Dec 2015 05:57:49 +0000 (21:57 -0800)] 
Fixed typo in gradle.properties name

3 years agoAdded 0.1.0 release info to news and downloads
smarella [Sat, 12 Dec 2015 04:14:42 +0000 (20:14 -0800)] 
Added 0.1.0 release info to news and downloads

3 years agoExclude 'support' folder from release sources 53/head
smarella [Thu, 10 Dec 2015 07:31:21 +0000 (23:31 -0800)] 
Exclude 'support' folder from release sources

3 years agoScripts to help with Apache Releases
smarella [Thu, 10 Dec 2015 07:28:31 +0000 (23:28 -0800)] 
Scripts to help with Apache Releases

3 years agoAdded 'incubating' to first mentions of Myriad on website.
Adam B [Thu, 10 Dec 2015 07:12:00 +0000 (23:12 -0800)] 
Added 'incubating' to first mentions of Myriad on website.

Added 'incubating' status to first mentions of Apache Myriad on the website,
per Apache branding guidelines.

This closes: #51
Review: https://github.com/apache/incubator-myriad/pull/51

3 years agoAdded 'destroy api' details to Myriad REST API section
Sarjeet Singh [Thu, 10 Dec 2015 07:11:43 +0000 (23:11 -0800)] 
Added 'destroy api' details to Myriad REST API section

This closes: #50
Review: https://github.com/apache/incubator-myriad/pull/50

3 years agoFixed rendering problem, by putting license headers in the right place and commenting...
Mohit Soni [Thu, 3 Dec 2015 02:41:38 +0000 (18:41 -0800)] 
Fixed rendering problem, by putting license headers in the right place and commenting them appropriately

3 years agoIncorporated feedback from IPMC on RC2 0.1.x myriad-0.1.0-incubating
smarella [Fri, 20 Nov 2015 05:52:37 +0000 (21:52 -0800)] 
Incorporated feedback from IPMC on RC2

- Added build instructions to generate a "gradlew" script when building Myriad from source downloads. Myriad's source releases will henceforth exclude the "gradlew" script and the "gradle-wrapper.jar".
- Modified the LICENSE file to match the stock LICENSE. Added a note that normalize.css is MIT licensed.
- Updated the top level README to include an explicit section for build instructions. It just points to the "developing myriad" document so that users don't struggle to find out where the build instructions are located.

This closes: #49
Review: https://github.com/apache/incubator-myriad/pull/49

3 years agoMissed Update
Naveen Manivannan [Fri, 20 Nov 2015 05:52:16 +0000 (21:52 -0800)] 
Missed Update

cp: cannot stat '../myriad-executor/build/libs/myriad-executor-runnable-0.0.1.jar': No such file or directory

This closes: #46
Review: https://github.com/apache/incubator-myriad/pull/46

3 years agoThis closes: #48
Ken Sipe [Wed, 18 Nov 2015 21:08:12 +0000 (15:08 -0600)] 
This closes: #48
Review: https://github.com/apache/incubator-myriad/pull/48

upgrades gradle build to 2.9

3 years agoThis closes: #47
Brandon Gulla [Wed, 18 Nov 2015 17:51:49 +0000 (12:51 -0500)] 
This closes: #47
Review: https://github.com/apache/incubator-myriad/pull/47

Prepended FrameworkName to the task-name
Removed the 'task' declaration in taskName per git discussion

3 years agoupdating gradlew to 2.9 which provides faster incremental builds 48/head
Ken Sipe [Wed, 18 Nov 2015 19:13:26 +0000 (13:13 -0600)] 
updating gradlew to 2.9 which provides faster incremental builds

3 years agoPrepended FrameworkName to the task-name
Brandon Gulla [Wed, 18 Nov 2015 14:33:50 +0000 (09:33 -0500)] 
Prepended FrameworkName to the task-name

3 years agoAdded ASF Source Headers
Santosh Marella [Fri, 13 Nov 2015 00:35:02 +0000 (16:35 -0800)] 
Added ASF Source Headers

The policy here seems to indicate even the documentation files that are part of the release tar ball needs to include the source headers, either as a header or as footer.
http://www.apache.org/legal/src-headers.html#header-text

Included it in the footer of the .md files.

This closes: #45
Review: https://github.com/apache/incubator-myriad/pull/45

3 years agofixed networking so web interfaces forward correctly
klucar [Fri, 13 Nov 2015 00:34:52 +0000 (16:34 -0800)] 
fixed networking so web interfaces forward correctly

This closes: #44
Review: https://github.com/apache/incubator-myriad/pull/44

3 years agoUpdated Vagrantfile to work with the supported Mesos and Hadoop versi…
klucar [Thu, 12 Nov 2015 00:58:44 +0000 (16:58 -0800)] 
Updated Vagrantfile to work with the supported Mesos and Hadoop versi…

…ons.

Broke provisioning into separate scripts in the ./vagrant directory.
Updated vagrant documentation
Added .npmrc that eliminates node symbolic links so build will work under Vagrant.

This closes: #43
Review: https://github.com/apache/incubator-myriad/pull/43

3 years agoUpdated gradle.properties
Mohit Soni [Tue, 10 Nov 2015 18:36:19 +0000 (10:36 -0800)] 
Updated gradle.properties

* Corrected jvm args, ```-Xmx``` and ```-XX:MaxPermSize``` now uses 'm' character to specify size in MB.
* Enable gradle daemon for dev environments

This closes: #42
Review: https://github.com/apache/incubator-myriad/pull/42

3 years agoMyriad 172
klucar [Tue, 10 Nov 2015 18:36:07 +0000 (10:36 -0800)] 
Myriad 172

This corrects the offer handling in `TaskUtils.getScalarResource`.  Previously, the case were the amount of resources of the frameworkRole was less than the amount used was overlooked.  This caused a positive number to be added to the amount still needed, resulting in more than the desired resource being requested.  Using `Math.max(resourceDoubleValue-used,0)` corrects this behaviour.

Tested and confirmed correct resources were requested.

This closes: #41
Review: https://github.com/apache/incubator-myriad/pull/41

3 years agoRemoves trailing whitespaces in docs
Zhongyue Luo [Tue, 10 Nov 2015 01:59:46 +0000 (09:59 +0800)] 
Removes trailing whitespaces in docs

This closes: #39
Review: https://github.com/apache/incubator-myriad/pull/39

3 years agoFixes sample yarn-site path in remote distribution config doc
Zhongyue Luo [Tue, 10 Nov 2015 04:07:38 +0000 (20:07 -0800)] 
Fixes sample yarn-site path in remote distribution config doc

Changed only file path to the current version.

This closes: #38
Review: https://github.com/apache/incubator-myriad/pull/38

3 years agoChanged occurrences of Myriad and Hadoop versions
smarella [Tue, 10 Nov 2015 04:07:22 +0000 (20:07 -0800)] 
Changed occurrences of Myriad and Hadoop versions

Myriad: 0.0.1 -> 0.1.0
Hadoop: 2.7.1 -> 2.7.0

This closes: #37
Review: https://github.com/apache/incubator-myriad/pull/37

3 years agoChanged HADOOP_VERSION from 2.7.1 to 2.7.0 to ensure maximum compatib…
Brandon Gulla [Tue, 10 Nov 2015 04:07:08 +0000 (20:07 -0800)] 
Changed HADOOP_VERSION from 2.7.1 to 2.7.0 to ensure maximum compatib…

Changed hadoop version from 2.7.1 to 2.7.0.

This closes: #36
Review: https://github.com/apache/incubator-myriad/pull/36

3 years agoMYRIAD-170 Myriad initialization fails with "parameter 5 of org.apach…
Swapnil Daingade [Mon, 9 Nov 2015 02:50:54 +0000 (18:50 -0800)] 
MYRIAD-170 Myriad initialization fails with "parameter 5 of org.apach…

…e.myriad.scheduler.MyriadOperations.<init>() is not @Nullable

Myriad State store is no longer passed using Guice
We now get state store from RMContext.

Tried using HA disabled in yarn and myriad. Was able to run CGS and FGS NM's
Tried using HA enabled in yarn and myriad. Was able to run CGS and FGS NM's

This closes: #35
Review: https://github.com/apache/incubator-myriad/pull/35

3 years agoFix Myriad config file path in docs
Zhongyue Luo [Mon, 9 Nov 2015 02:50:19 +0000 (18:50 -0800)] 
Fix Myriad config file path in docs

Changes myriad-config-default.yml path

This closes: #34
Review: https://github.com/apache/incubator-myriad/pull/34

3 years agoAdded Apache license headers to some more files
smarella [Fri, 6 Nov 2015 00:46:44 +0000 (16:46 -0800)] 
Added Apache license headers to some more files

- Used Apache RAT tool
- Also modified the sample yarn-site.xml to have appropriate values.

This closes: #33
Review: https://github.com/apache/incubator-myriad/pull/33

3 years agoRemoved unused MesosModule and TestMyriadScheduler classes
klucar [Thu, 29 Oct 2015 12:38:31 +0000 (08:38 -0400)] 
Removed unused MesosModule and TestMyriadScheduler classes

This closes: #25
Review: #25

3 years agoUpdated all existing doc *.md files with the equivalent (and reviewed) content from...
Ruth Harris [Thu, 5 Nov 2015 00:54:22 +0000 (16:54 -0800)] 
Updated all existing doc *.md files with the equivalent (and reviewed) content from the wiki.

This closes: #29
Review: https://github.com/apache/incubator-myriad/pull/29

3 years agoMYRIAD-164 Remove Myriad state after framework shutdown
Swapnil Daingade [Thu, 5 Nov 2015 00:52:48 +0000 (16:52 -0800)] 
MYRIAD-164 Remove Myriad state after framework shutdown

New Myriad framework fails to start after an earlier one is shutdown.

The Myriad state saves the framework id for the old framework.
When the new framework starts, it tries to re-registers with the old framework id.
This causes an error message similar to

I1029 12:07:08.330493 15884 sched.cpp:819] Got error 'Completed framework
attempted to re-register'
I1029 12:07:08.330507 15884 sched.cpp:1625] Asked to abort the driver
I1029 12:07:08.331507 15884 sched.cpp:861] Aborting framework
'20151029-110656-1986333194-5050-10105-0001'

We need to remove the Myriad state as part of framework shutdown.

Added a method removeMyriadState to MyriadStateStore interface and added
implementation in MyriadFileSystemRMStateStore.

This closes: #31
Review: https://github.com/apache/incubator-myriad/pull/31

3 years agoMerge branch 'master' of https://git-wip-us.apache.org/repos/asf/incubator-myriad
Santosh Marella [Thu, 5 Nov 2015 00:45:28 +0000 (16:45 -0800)] 
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/incubator-myriad

Merging to amend the previous commit message.

3 years agoMyriad 162 This corrects how offers are handled when using the framework role parameter.
DarinJ [Wed, 4 Nov 2015 04:43:28 +0000 (23:43 -0500)] 
Myriad 162 This corrects how offers are handled when using the framework role parameter.

Prior to this fix if Myriad recieved an offer with resource from the default role and it's declared
role it incorrectly declared all cpu and memory as used by the default role.
This let to TASK_LOST errors, which the logs stated were a result of insufficient resources.

This closes: #32
Review: #32

3 years agoMyriad 162 This corrects how offers are handled when using the framework role parameter.
DarinJ [Wed, 4 Nov 2015 04:43:28 +0000 (23:43 -0500)] 
Myriad 162 This corrects how offers are handled when using the framework role parameter.

Prior to this fix if Myriad recieved an offer with resource from the default role and it's declared
role it incorrectly declared all cpu and memory as used by the default role.
This let to TASK_LOST errors, which the logs stated were a result of insufficient resources.

3 years agoMYRIAD-144: Podling incubator website
klucar [Wed, 4 Nov 2015 22:10:52 +0000 (14:10 -0800)] 
MYRIAD-144: Podling incubator website

based on jekyll

This closes: #30
Review: https://github.com/apache/incubator-myriad/pull/30

3 years agosorted import statements
klucar [Tue, 3 Nov 2015 22:26:49 +0000 (14:26 -0800)] 
sorted import statements

after the namespace change, the import statements were no longer sorted.

Added line wrapping for long lines. Set the line length to 132.

This closes: #26
Review: https://github.com/apache/incubator-myriad/pull/26

3 years agoFixes MYRIAD-114
klucar [Tue, 3 Nov 2015 22:08:49 +0000 (14:08 -0800)] 
Fixes MYRIAD-114

Fixed gulp build to not include local paths and gradle-ized build.
Removed public/ from git repo and added it to .gitignore.

This closes: #28
Review: https://github.com/apache/incubator-myriad/pull/28

3 years agoMYRIAD-160 Addressing review comment about removing port after being …
Yuliya Feldman [Thu, 29 Oct 2015 21:44:27 +0000 (14:44 -0700)] 
MYRIAD-160 Addressing review comment about removing port after being …

…selected for use in NM

This closes: #27
Review: https://github.com/apache/incubator-myriad/pull/27

3 years agoMYRIAD-159 Mesos version bump 0.22.1->0.24.1
DarinJ [Thu, 29 Oct 2015 16:01:01 +0000 (09:01 -0700)] 
MYRIAD-159 Mesos version bump 0.22.1->0.24.1

This closes: #23
Review: https://github.com/apache/incubator-myriad/pull/23

3 years agoremoving compilation warnings
Ken Sipe [Wed, 28 Oct 2015 23:56:45 +0000 (16:56 -0700)] 
removing compilation warnings

This closes: #24
Review: https://github.com/apache/incubator-myriad/pull/24

3 years agoMinor changes for destroy Myriad to work smoothly
Swapnil Daingade [Mon, 26 Oct 2015 20:21:28 +0000 (13:21 -0700)] 
Minor changes for destroy Myriad to work smoothly

* Making MyriadWebServer singleton
* Stopping the webserver after the driver has shutdown so there can be no more flexup and flexdown requests
* Making sure that the Myriad UI works on older versions of Firefox and IE.
  Minor syntax changes in js files like
-       renderOverlay() {
+       renderOverlay: function () {

This closes: #21
Review: #21

3 years agoDeleted old class and reset gradle build to phase1
Paul Read [Mon, 17 Aug 2015 15:36:21 +0000 (11:36 -0400)] 
Deleted old class and reset gradle build to phase1

3 years agorebase and removed all but one shutdown
Paul Read [Mon, 17 Aug 2015 15:06:01 +0000 (11:06 -0400)] 
rebase and removed all but one shutdown

Update

updated

3 years agoRebase
Paul Read [Mon, 17 Aug 2015 14:45:40 +0000 (10:45 -0400)] 
Rebase

3 years ago# This is a combination of 2 commits. # The first commit's message is:
Paul Read [Thu, 11 Jun 2015 12:04:14 +0000 (08:04 -0400)] 
# This is a combination of 2 commits. # The first commit's message is:

rebase, removed all but one shutdown

# This is the 2nd commit message:

Remove all but one destroy menu option

3 years agoMYRIAD-160 Randomizing Mesos ports assigned to NMs to make sure that in case of flexd...
Yuliya Feldman [Mon, 26 Oct 2015 18:22:13 +0000 (11:22 -0700)] 
MYRIAD-160 Randomizing Mesos ports assigned to NMs to make sure that in case of flexdown and subsequent flexup NM does not use previously used port ports clashes can still happen, but this minimizes those events.

This closes: #20
Review: #20

3 years agocom.ebay => org.apache
klucar [Wed, 28 Oct 2015 13:54:48 +0000 (09:54 -0400)] 
com.ebay => org.apache

This closes: #22
Review: #22

3 years agospacing changes
klucar [Wed, 28 Oct 2015 13:07:44 +0000 (09:07 -0400)] 
spacing changes

3 years agoMYRIAD-148 Ability to correctly serialize Optional. By default Option…
Yuliya Feldman [Mon, 26 Oct 2015 17:29:32 +0000 (10:29 -0700)] 
MYRIAD-148 Ability to correctly serialize Optional. By default Option…

…al<T> serialized value is just "present" and not a real value (if present). Created custom serializers to serialize value versus state of Optional

This closes: #19
Review: https://github.com/apache/incubator-myriad/pull/19

3 years agoMYRIAD-41:Updated license headers for some more files
Santosh Marella [Fri, 23 Oct 2015 20:20:17 +0000 (13:20 -0700)] 
MYRIAD-41:Updated license headers for some more files

- There were new files that made it into the repo through PRs.
- Some test files based on groovy also needed license headers.
- FWIW, applied the license headers to the build files as well.

This closes: #15
Review: https://github.com/apache/incubator-myriad/pull/15

3 years agoMYRIAD-140 Fixing issue with validating request for flexDown where pr…
Yuliya Feldman [Tue, 20 Oct 2015 21:12:39 +0000 (14:12 -0700)] 
MYRIAD-140 Fixing issue with validating request for flexDown where pr…

…ofile is null.

This closes: #16
Review: https://github.com/apache/incubator-myriad/pull/16

3 years agoMYRIAD-158: Fixed the license string from .html
Sarjeet Singh [Tue, 20 Oct 2015 18:33:51 +0000 (11:33 -0700)] 
MYRIAD-158: Fixed the license string from .html

Tested and UI looks fine now.

This closes: #14
Review: https://github.com/apache/incubator-myriad/pull/14

3 years agoRefactored ResourceManager Docker support
root [Tue, 20 Oct 2015 18:29:54 +0000 (11:29 -0700)] 
Refactored ResourceManager Docker support

Highlights:
  - Hadoop distribution is now user definable. Use the HADOOP_TARBALL_URL environment variable to force the docker to download and use your distribution.
  - Hadoop 2.7.1 is now the default distribution used.
  - The base image is now based off of Debian for leaner docker images.
  - ResourceManager now runs as 'yarn' user.

Addresses MYRIAD-146

This closes: #13
Review: https://github.com/apache/incubator-myriad/pull/13

3 years agoMYRIAD-154 Restarting RM starts a "default" medium-profile NM on each…
Swapnil Daingade [Tue, 20 Oct 2015 18:29:33 +0000 (11:29 -0700)] 
MYRIAD-154 Restarting RM starts a "default" medium-profile NM on each…

… restart.

We check if there is atleast one NM in pending, staging or active state. if yes,
do not launch additional NMs.

Tested, NM was launched the first time as there were no NMs in pending, staging or active state.
Restarted RM multiple times. No new NM was launched.

This closes: #11
Review: https://github.com/apache/incubator-myriad/pull/11