incubator-hugegraph-computer.git
9 months agofeat: support local cluster coefficient algorithm cc-algo 108/head
imbajin [Tue, 28 Sep 2021 13:52:07 +0000 (21:52 +0800)] 
feat: support local cluster coefficient algorithm

better add more test case (multi increase graph)

9 months agoimprove number of transport threads and max_timeout_heartbeat_count (#103)
coderzc [Sun, 26 Sep 2021 08:35:20 +0000 (16:35 +0800)] 
improve number of transport threads and max_timeout_heartbeat_count (#103)

9 months agoimplement rings-detection algorithm (#95)
ShouJing [Sun, 26 Sep 2021 07:21:44 +0000 (15:21 +0800)] 
implement rings-detection algorithm (#95)

* add cycle detection algorithm
* improve: add field label in Vertex and Edge
* support properties filter in RingsDetection
* add StringValue
* add method object in Value
* update built-in object name in SpreadFilter and improve code style
* add standard rings-detection algorithm
* add RingsDetectionOutput
* resolve circular dependencies
* add message type IdListList rings-detection

9 months agoImplement triangle_count algorithms and improve some code (#101)
coderzc [Fri, 24 Sep 2021 07:58:27 +0000 (15:58 +0800)] 
Implement triangle_count algorithms and improve some code (#101)

* Implement triangle_count algorithms
* Improve some code

9 months agouse session timeout option for sendControlMessageToWorkers (#92)
coderzc [Mon, 13 Sep 2021 09:58:45 +0000 (17:58 +0800)] 
use session timeout option for sendControlMessageToWorkers (#92)

9 months agoimprove k8s resource allocation (#100)
coderzc [Mon, 13 Sep 2021 08:29:25 +0000 (16:29 +0800)] 
improve k8s resource allocation (#100)

* add DEFAULT_TRANSPORT_PORT
* split master and worker resource quantity
* transport threads don't exceed the count of workers

9 months agobugfix: calculate fileOffset error in method BufferFileInput#readFully when read...
ShouJing [Sun, 12 Sep 2021 13:06:55 +0000 (21:06 +0800)] 
bugfix: calculate fileOffset error in method BufferFileInput#readFully when read length is bigger than buffer capacity (#98)

9 months agoadd clear graph data method in unit test (#99)
ShouJing [Sun, 12 Sep 2021 09:04:07 +0000 (17:04 +0800)] 
add clear graph data method in unit test (#99)

* add clear graph data method

9 months agoFix: params of string format error (#97)
zyxxoo [Tue, 7 Sep 2021 05:48:19 +0000 (13:48 +0800)] 
Fix: params of string format error (#97)

Co-authored-by: vaughn.zhang <vaughn.zhang@zoom.us>
10 months agostandardized algorithm package and name (#96)
Jermy Li [Mon, 30 Aug 2021 13:10:23 +0000 (21:10 +0800)] 
standardized algorithm package and name (#96)

10 months agoimprove wcc test and add property(key) (#94)
coderzc [Fri, 27 Aug 2021 07:18:54 +0000 (15:18 +0800)] 
improve wcc test and add property(key) (#94)

* improve wcc test
* add property(key) for vertex and edge

10 months agoFix the count of input edge less than actual (#93)
Linary [Fri, 27 Aug 2021 03:15:48 +0000 (11:15 +0800)] 
Fix the count of input edge less than actual (#93)

10 months agooutput demo(pagerank) (#72)
zhoney [Thu, 26 Aug 2021 12:28:39 +0000 (20:28 +0800)] 
output demo(pagerank) (#72)

* implement hugegraph pagerank output class
* support multiple threads writeback
* add output configs to driver

10 months agofix FileGraphPartition and some warnings (#90)
Jermy Li [Tue, 17 Aug 2021 03:21:43 +0000 (11:21 +0800)] 
fix FileGraphPartition and some warnings (#90)

* improve FileGraphPartition
* fix warnings
* fix warnings of test
* fix MessageInputTest
* fix tow workers shared one data_dirs

10 months agochore: remove deleted files (#91)
zyxxoo [Mon, 16 Aug 2021 08:24:28 +0000 (16:24 +0800)] 
chore: remove deleted files (#91)

10 months agosort different type of message use different combiner (#85)
ShouJing [Mon, 16 Aug 2021 07:41:10 +0000 (15:41 +0800)] 
sort different type of message use different combiner (#85)

* fix bug: sort use Pointer but combiner used to combine Value or Property
* fix bug: merge to one file until Sorter#iterator is perfected

10 months agofix some k8s bug and improve some code (#83)
coderzc [Mon, 16 Aug 2021 03:37:28 +0000 (11:37 +0800)] 
fix some k8s bug and improve some code (#83)

* fix the pod deleted when job failed
* fix job active state inaccurate
* upgrade fabric8 k8s client version to 5.6.0
* add job cost statistics
* add AUTO_DESTROY_POD option for operator
* improve k8s error log message
* use a separate thread for execution waitJob on unit test
* delete history job before run k8s test

10 months agoremove etcd (#86)
coderzc [Thu, 12 Aug 2021 07:54:29 +0000 (15:54 +0800)] 
remove etcd (#86)

10 months agofeat: add degree centrality (#77)
zyxxoo [Wed, 11 Aug 2021 12:56:34 +0000 (20:56 +0800)] 
feat: add degree centrality (#77)

* feat: add degree centrality

* feat: add degree centrality

* feat: cal weight degreen centrality

* fix: params bug

* chore: improve style

* chore: handle more hugeType for weight property and add output test to test result

* refactor: number value extends Number type

* chore: improve code style

* chore: add TODO

* modify job id

* fix test

Co-authored-by: coderzc <zc1217zc@126.com>
10 months agoUse BytesId unify the Id classes (#78)
Linary [Wed, 11 Aug 2021 09:16:37 +0000 (17:16 +0800)] 
Use BytesId unify the Id classes (#78)

10 months agoadd wcc algorithm (#81)
houzhizhen [Wed, 11 Aug 2021 07:39:52 +0000 (15:39 +0800)] 
add wcc algorithm (#81)

10 months agoAdd mvn release plugin (#82)
Linary [Mon, 9 Aug 2021 08:18:10 +0000 (16:18 +0800)] 
Add mvn release plugin (#82)

10 months agoFix bug: last edge attched in currVertex missed to send (#80)
Linary [Mon, 9 Aug 2021 04:53:11 +0000 (12:53 +0800)] 
Fix bug: last edge attched in currVertex missed to send (#80)

10 months agofeat: add startup and make docker image code (#71)
zyxxoo [Fri, 6 Aug 2021 08:42:05 +0000 (16:42 +0800)] 
feat: add startup and make docker image code (#71)

10 months agoadd LICENSE for hugegraph-computer (#79)
coderzc [Fri, 6 Aug 2021 05:26:22 +0000 (13:26 +0800)] 
add LICENSE for hugegraph-computer (#79)

10 months agoadd page-rank algorithm (#70)
houzhizhen [Thu, 5 Aug 2021 10:54:42 +0000 (18:54 +0800)] 
add page-rank algorithm (#70)

* add page-rank algorithm
* Set algorithm's parameters in ComputerContextUtil#initContext
* register ComputerOptions to overwrite the config in driver.config.ComputerOptions

11 months agoimprove k8s operator test (#76)
coderzc [Tue, 3 Aug 2021 09:02:40 +0000 (17:02 +0800)] 
improve k8s operator test (#76)

* improve k8s operator test

* * improve k8s operator test
* modify ci badge

* add k8s operator test

11 months agoadd computer-k8s and computer-k8s-operator (#56)
coderzc [Tue, 3 Aug 2021 03:28:57 +0000 (11:28 +0800)] 
add computer-k8s and computer-k8s-operator (#56)

11 months agoFix bug: some input splits missed in iteration (#75)
Linary [Tue, 3 Aug 2021 03:28:01 +0000 (11:28 +0800)] 
Fix bug: some input splits missed in iteration (#75)

11 months agoFix bug: Number id like int convert LongId failed (#74)
Linary [Fri, 30 Jul 2021 06:24:15 +0000 (14:24 +0800)] 
Fix bug: Number id like int convert LongId failed (#74)

11 months agofix: use ip instead of hostname due to can't resolved on k8s (#73)
coderzc [Wed, 28 Jul 2021 03:24:40 +0000 (11:24 +0800)] 
fix: use ip instead of hostname due to can't resolved on k8s (#73)

11 months agoFix bug: judge whether a notice is needed is wrong for MessageQueue (#69)
Linary [Tue, 20 Jul 2021 08:15:06 +0000 (16:15 +0800)] 
Fix bug: judge whether a notice is needed is wrong for MessageQueue (#69)

11 months agoadd ComputeManager (#66)
houzhizhen [Wed, 7 Jul 2021 07:08:46 +0000 (15:08 +0800)] 
add ComputeManager (#66)

add class ComputeManager, FileGraphPartition, EdgesInput, MessageInput, ReusablePointer, VertexInput, LogOutput, MessageRecvStat
add class ComputeTestSuite, ComputeManagerTest, MockComputation, MockMessageSender, EdgesInputTest, EmptyEdgesTest, MessageInputTest
add method copy in IdValueList.
remove mergeGraph from MessageRecvManager;
add method recvStat in MessageRecvPartition
add method recvStats in MessageRecvPartitions
add methods merge(recvStat)recvStat in Partition
WorkerService links compute and output to corresponding methods in ComputeManager
move method writeMessage from ComputeMessageRecvPartitionTest to ReceiverUtil

11 months agoadd seqfile (#65)
ShouJing [Mon, 5 Jul 2021 08:31:58 +0000 (16:31 +0800)] 
add seqfile (#65)

* add ValueFileOutput/ValueFileInput
* add BitsFileReader/BitFileWriter
* add AbstractBufferedFileInput/AbstractBufferedFileOutput

11 months agochore: add issue template & auto stale issues and pr (#64)
imbajin [Mon, 5 Jul 2021 08:22:58 +0000 (16:22 +0800)] 
chore: add issue template & auto stale issues and pr (#64)

11 months agofix copyToByteArray(): remove duplicate() (#67)
coderzc [Mon, 5 Jul 2021 07:04:30 +0000 (15:04 +0800)] 
fix copyToByteArray(): remove duplicate() (#67)

11 months agoAdd test for MultiQueue take in wait status (#68)
Linary [Mon, 5 Jul 2021 06:27:28 +0000 (14:27 +0800)] 
Add test for MultiQueue take in wait status (#68)

12 months agoLet Sender and Receiver process compute message with type MESSAGE_CLASS (#63)
houzhizhen [Tue, 22 Jun 2021 08:53:10 +0000 (16:53 +0800)] 
Let Sender and Receiver process compute message with type MESSAGE_CLASS (#63)

* delete ValueFactory
* rename VALUE_CLASS to ALGORITHM_RESULT_CLASS, remove VALUE_TYPE
* add option OUTPUT_VALUE_NAME
* check channel not null in QueuedMessageSender#init

12 months agoFix send thread may blocked all the time (#61)
Linary [Mon, 21 Jun 2021 06:22:46 +0000 (14:22 +0800)] 
Fix send thread may blocked all the time (#61)

* Fix send thread may blocked all the time
* Add back MultiQueue class

12 months agoImplement StreamGraphInput and EntryInput (#60)
Linary [Fri, 18 Jun 2021 08:25:37 +0000 (16:25 +0800)] 
Implement StreamGraphInput and EntryInput (#60)

12 months agoImplement data receiver of worker (#51)
houzhizhen [Fri, 18 Jun 2021 05:40:23 +0000 (13:40 +0800)] 
Implement data receiver of worker (#51)

* add DataServerManager to manage the data server.
* add MessageRecvBuffers the manages buffers with limit size.
* add MessageRecvPartition to manage the data received for a partition and three subclass
  (VertexMessageRecvPartition,EdgeMessageRecvPartition, ComputeMessageRecvPartition).
* add MessageRecvPartitions to manage the partitions of data received, and three subclass
  (VertexMessageRecvPartitions,EdgeMessageRecvPartitions, ComputeMessageRecvPartitions)
* add MessageRecvManager to implement MessageHandler to handle network messages.
* process start-finish event.
* Partition add iterator and sort logic.
* add class SuperstepFileGenerator.
* create ConnectionManager in WorkerService.
* add mergeBuffers using sort-mamager.

12 months agoUse github action for ci via ci.yml (#62)
Linary [Fri, 18 Jun 2021 03:34:04 +0000 (11:34 +0800)] 
Use github action for ci via ci.yml (#62)

12 months agoLink managers in worker sending end (#52)
Linary [Tue, 15 Jun 2021 07:35:58 +0000 (15:35 +0800)] 
Link managers in worker sending end (#52)

* Link managers in worker sending end
* Optimize WriteBufferPool and SortedBufferQueuePool
* Rafact MessageSendPartition, WriteBuffer and Edge
* Refact writeEdge with label and name
* Let SortManager don't need Sender
* Refact GraphComputeOutput and GraphWritebackOutput
* Refact OptimizedBytesOutput
* Add Input/Output Factory
* Refact writeFixedInt in sort module
* Move pending message into MessageQueue
* Define a MultiQueue support multi put

12 months agoAdd sessionActive for client (#59)
coderzc [Thu, 10 Jun 2021 07:50:08 +0000 (15:50 +0800)] 
Add sessionActive for client (#59)

13 months agoFix EntriesUtil#entryFromInput and some improve (#58)
ShouJing [Fri, 4 Jun 2021 11:45:57 +0000 (19:45 +0800)] 
Fix EntriesUtil#entryFromInput and some improve (#58)

13 months agoadd PointerCombiner (#57)
houzhizhen [Thu, 3 Jun 2021 06:30:36 +0000 (14:30 +0800)] 
add PointerCombiner (#57)

13 months agoAdd store/sort module (#37)
ShouJing [Mon, 31 May 2021 06:51:32 +0000 (14:51 +0800)] 
Add store/sort module (#37)

* add hgkvFile/hgkvDir module
* add EntriesUtil.java
* add SorterTest.java
* move file verification to HgkvDir
* rebuild HgkvFile readFooter and Fix HgkvDir#open
* add sort module
* implement InnerSortFlusher and OuterSortFlusher
* add KvEntry#numSubEntries

13 months agoadd startAsync and finishAsync on client side, add onStarted and onFinished on server...
coderzc [Mon, 31 May 2021 06:33:01 +0000 (14:33 +0800)] 
add startAsync and finishAsync on client side, add onStarted and onFinished on server side (#53)

* add startAsync and finishAsync on client side
* add onStarted and onFinished on server side

13 months agorename DataFileManager to FileManager (#54)
houzhizhen [Fri, 28 May 2021 06:26:06 +0000 (14:26 +0800)] 
rename DataFileManager to FileManager (#54)

* rename DataFileManager to FileManager

* remove #nextFile() from FileGenerator

13 months agoimplement aggregator module (#46)
Jermy Li [Fri, 21 May 2021 07:50:09 +0000 (15:50 +0800)] 
implement aggregator module (#46)

* implement aggregator module
* add DefaultAggregator.newValue()
* integrate aggregator into master-service and worker-service
* ensure worker init() executed after master
* add rpc interface registeredAggregators()
* also add two-tier structure to store current-step and previous-step aggregators
* add repair() for Aggregator
* let master context use config of outer class
* support register aggregator with default value
* add Manager.inited()
* remove worker_id option and use server_port instead
* use rpc-url from master-info

13 months agoadd copy() and assign() methods to Value class (#49)
Jermy Li [Wed, 19 May 2021 11:56:19 +0000 (19:56 +0800)] 
add copy() and assign() methods to Value class (#49)

* add Value.copy()+assign() method
* add IntValueSumCombiner and FloatValueSumCombiner

13 months agoStandardize bsp synchronization between master and worker (#48)
houzhizhen [Thu, 13 May 2021 11:45:31 +0000 (19:45 +0800)] 
Standardize bsp synchronization between master and worker (#48)

13 months agolog job-id in BSP client (#50)
Jermy Li [Thu, 13 May 2021 09:28:43 +0000 (17:28 +0800)] 
log job-id in BSP client (#50)

* log job-id in BSP client

* set BspBase.init() private

13 months agoRefactor Writable and Readable class (#42)
Linary [Wed, 12 May 2021 04:02:47 +0000 (12:02 +0800)] 
Refactor Writable and Readable class (#42)

* Refactor Writable and Readable class

* Also simplify GraphOut and GraphInput

* remove ComputeException

* Add test for duplicate method

* fix write/read properties value type incorrect

13 months agofix some warning, improve start() and finish() (#44)
coderzc [Tue, 11 May 2021 10:06:31 +0000 (18:06 +0800)] 
fix some warning, improve start() and finish() (#44)

* fix some warning
* improve some log
* improve start/finish send to avoid timeout
* blocking -> flowBlocking

13 months agostandard log format of bsp module and improve some error message (#47)
Jermy Li [Mon, 10 May 2021 07:04:14 +0000 (15:04 +0800)] 
standard log format of bsp module and improve some error message (#47)

13 months agoadd DataDirManager (#43)
houzhizhen [Sat, 8 May 2021 11:25:10 +0000 (19:25 +0800)] 
add DataDirManager (#43)

13 months agoadd createId methods in GraphFactory (#45)
houzhizhen [Sat, 8 May 2021 11:24:41 +0000 (19:24 +0800)] 
add createId methods in GraphFactory (#45)

13 months agoadd flowControl, heartbeat (#40)
coderzc [Thu, 6 May 2021 03:37:56 +0000 (11:37 +0800)] 
add flowControl, heartbeat (#40)

* add flow control
* add heartBeat
* add task to check ack
* add task to check ack and remove lastAckTimestamp
* rest BarrierEvent
* remove AckType
* add checkMinPendingRequests
* use accumulate flush
* add timeout parameter method to startSession and finishSession
* use real ip start
* scheduleAtFixedRate -> scheduleWithFixedDelay
* add maxHeartbeatTimes
* add dataMessage release()
* max_heartbeat_timeouts -> max_timeout_heartbeat_count
* set backlog default value 511

14 months agocreate api module (#41)
houzhizhen [Thu, 29 Apr 2021 09:13:53 +0000 (17:13 +0800)] 
create api module (#41)

* move algorithm's used classes to api
* add module computer-api
* signal bsp at end of init in WorkerService and MasterService
* make ValueFactory abstract and add BuiltinValueFactory
* rename USER_DEFINED to CUSTOM_VALUE in ValueType
* Reduce call ComputerContext.instance() directly
* synchronious UnitTestBase.updateWithRequiredOptions and return Config
* pass Aggregator4Master to MasterComputation#init
* add parameter MasterContext in MasterComputation.close

14 months agorename FilterMapComputation to FilterComputation (#38)
houzhizhen [Fri, 16 Apr 2021 10:18:36 +0000 (18:18 +0800)] 
rename FilterMapComputation to FilterComputation (#38)

14 months agoadd transport server, client, encode, decode (#25)
Coderzc [Fri, 16 Apr 2021 07:54:13 +0000 (15:54 +0800)] 
add transport server, client, encode, decode (#25)

add transport server
add transport client
add encoder
add decoder

14 months agoImprove class for Input/Output and fix writeInt(position, v) in BufferedFileOutput...
ShouJing [Thu, 15 Apr 2021 02:58:14 +0000 (10:58 +0800)] 
Improve class for Input/Output and fix writeInt(position, v) in BufferedFileOutput (#32)

* Improve class for Input/Output and fix problem

* update compare method in BufferFileInput/UnsafeByteArrayInput

* add exception declaration on RandomAccessInput#compare

* Add test case for UnsafeByteArrayInput/BufferedFileInput compare method

* Check offset and lenght must be in buffer

* Improve local variable names in BufferedFileTest#testCompare

* Update argument check in UnsafeByteArrayInput#compare

14 months agoadd rpc support (#36)
Jermy Li [Wed, 14 Apr 2021 08:13:23 +0000 (16:13 +0800)] 
add rpc support (#36)

* add rpc server and client: MasterRpcManager,WorkerRpcManager
* add MasterInputManager and WorkerInputManager
* inject rpc service into GraphFetcher
* store managers through map instead of list
* add loadGraph() and mergeGraph() to WorkerInputManager
* add checkInited() for WorkerService and MasterService

14 months agoAdd close method for Input Fetcher (#35)
Linary [Tue, 13 Apr 2021 13:04:05 +0000 (21:04 +0800)] 
Add close method for Input Fetcher (#35)

Co-authored-by: ShouJing <1075185785@qq.com>
14 months agofix some warnings for computer-test (#34)
Jermy Li [Tue, 13 Apr 2021 12:39:11 +0000 (20:39 +0800)] 
fix some warnings for computer-test (#34)

14 months agofix some warnings (#33)
Jermy Li [Mon, 12 Apr 2021 12:16:05 +0000 (20:16 +0800)] 
fix some warnings (#33)

14 months agoadd WorkerService and MasterService (#27)
houzhizhen [Fri, 9 Apr 2021 06:44:13 +0000 (14:44 +0800)] 
add WorkerService and MasterService (#27)

* rename input to inputStep
* MasterService does not implement MasterContext
* add name in Combiner and Computation
* add category in Computation

14 months agocreate Heap/LoserTree (#26)
ShouJing [Wed, 7 Apr 2021 07:32:55 +0000 (15:32 +0800)] 
create Heap/LoserTree (#26)

* add InputsSorting interface and implementation

14 months agoadd Partitioner and HashPartitioner (#29)
houzhizhen [Wed, 7 Apr 2021 02:40:09 +0000 (10:40 +0800)] 
add Partitioner and HashPartitioner (#29)

15 months agoInstall HugeGraphServer from specified commit id (#31)
Linary [Fri, 2 Apr 2021 09:29:39 +0000 (17:29 +0800)] 
Install HugeGraphServer from specified commit id (#31)

15 months agoadd copy, getLast, contains in ListValue (#30)
houzhizhen [Fri, 2 Apr 2021 02:29:59 +0000 (10:29 +0800)] 
add copy, getLast, contains in ListValue (#30)

* make getLast next to get

15 months agoadd createObject(class_option) to config (#28)
houzhizhen [Tue, 30 Mar 2021 14:34:14 +0000 (22:34 +0800)] 
add createObject(class_option) to config (#28)

15 months agoAdd computation interface (#17)
houzhizhen [Fri, 26 Mar 2021 02:41:24 +0000 (10:41 +0800)] 
Add computation interface (#17)

* Add computation interface

* add FilterMapComputation and ReduceComputation

* add MasterComputation

15 months agoadd ComputerDriver interface (#23)
houzhizhen [Tue, 23 Mar 2021 03:02:42 +0000 (11:02 +0800)] 
add ComputerDriver interface (#23)

15 months agoadd ComputerOutput interface (#24)
houzhizhen [Mon, 22 Mar 2021 06:25:58 +0000 (14:25 +0800)] 
add ComputerOutput interface (#24)

15 months agoConfig add getBoolean, getInt, getLong, getDouble, getString (#21)
houzhizhen [Mon, 22 Mar 2021 02:48:32 +0000 (10:48 +0800)] 
Config add  getBoolean, getInt, getLong, getDouble, getString (#21)

15 months agoadd sort interface (#19)
houzhizhen [Thu, 18 Mar 2021 01:33:32 +0000 (09:33 +0800)] 
add sort interface (#19)

* first version of sorter

* add sort interface

* remove first version of sorter

15 months agoadd available in RandomAccessInput (#22)
houzhizhen [Wed, 17 Mar 2021 12:03:47 +0000 (20:03 +0800)] 
add available in RandomAccessInput (#22)

15 months agoadd transport interface (#20)
houzhizhen [Wed, 17 Mar 2021 03:45:20 +0000 (11:45 +0800)] 
add transport interface (#20)

15 months agoImplement vertex/edge fetcher to load data from hugegraph server (#18)
Linary [Mon, 15 Mar 2021 13:00:43 +0000 (21:00 +0800)] 
Implement vertex/edge fetcher to load data from hugegraph server (#18)

* Add install-hugegraph-from-source.sh

* Add HugeConverter

15 months agoadd BufferedFileDataOutput and BufferedFileDataInput (#15)
houzhizhen [Thu, 11 Mar 2021 03:41:07 +0000 (11:41 +0800)] 
add BufferedFileDataOutput and BufferedFileDataInput (#15)

* add BufferedFileDataOutput and BufferedFileDataInput

* add BufferedInputStream and BufferedOutputStream

15 months agoadd DefaultPropertiesCombiner and DefaultVertexValueCombiner (#16)
houzhizhen [Wed, 10 Mar 2021 11:36:21 +0000 (19:36 +0800)] 
add DefaultPropertiesCombiner and DefaultVertexValueCombiner (#16)

* add OverwriteValueCombiner, MergeNewPropertiesCombiner and MergeOldPropertiesCombiner

16 months agoreconstruct StreamGraph{Input/Output} to associate with UnsafeByteArray{Input/Output...
houzhizhen [Mon, 8 Feb 2021 13:04:36 +0000 (21:04 +0800)] 
reconstruct StreamGraph{Input/Output} to associate with UnsafeByteArray{Input/Output} (#14)

16 months agoadd Combiner (#12)
houzhizhen [Fri, 5 Feb 2021 11:58:24 +0000 (19:58 +0800)] 
add Combiner (#12)

* add Combiner, DoubleValueSumCombiner, IdValueMinimumCombiner, LongValueSumCombiner
* Value implements Comparable<Value>

16 months agoadd UnsafeByteArrayGraphInput and UnsafeByteArrayGraphOutput (#13)
houzhizhen [Thu, 4 Feb 2021 09:30:51 +0000 (17:30 +0800)] 
add UnsafeByteArrayGraphInput and UnsafeByteArrayGraphOutput (#13)

16 months agoadd Bsp4Worker, Bsp4Master and Etcd based implementation (#9)
houzhizhen [Thu, 4 Feb 2021 09:14:54 +0000 (17:14 +0800)] 
add Bsp4Worker, Bsp4Master and Etcd based implementation (#9)

16 months agoAdd Vertex, Edge, Properties and JsonStructGraphOutput (#10)
Linary [Thu, 4 Feb 2021 00:59:50 +0000 (08:59 +0800)] 
Add Vertex, Edge, Properties and JsonStructGraphOutput (#10)

* Add Vertex, Edge, Properties and JsonStructGraphOutput

* Add Recycler and Allocator

* Use RecycleReference to hold Handle and Recyclable

* Use Factory to create Vertex and Edge

17 months agoadd etcd dependency (#8)
houzhizhen [Mon, 25 Jan 2021 05:47:04 +0000 (13:47 +0800)] 
add etcd dependency (#8)

* add etcd dependency
* add EtcdClient
* add BspTestSuite
* improve exception messages
* get value from put event
* fix a unit test setting bug
* unuse static import
* define const ENCODING

17 months agoImprove class for Id, Value, GraphOutput and GraphInput (#6)
Linary [Tue, 19 Jan 2021 01:13:59 +0000 (09:13 +0800)] 
Improve class for Id, Value, GraphOutput and GraphInput (#6)

* Improve class for Id, Value, GraphOutput and GraphInput

* Add ListValue and improve code

* Add IdValueList and IdValueListList

* Let StreamGraphOutput as a proxy of DataOutputStream

* Add CsvStructGraphOutput and JsonStructGraphOutput

18 months agoadd Id as base type of vertex id (#4)
houzhizhen [Thu, 31 Dec 2020 06:52:02 +0000 (14:52 +0800)] 
add Id as base type of vertex id (#4)

* add Id as base type of vertex id

* rename method readFields to read in Writable

* add TextId, ByteArrayUtil, CoderUtil, PlainByteArrayComparator

* add DoubleValue

* tiny improve

* add ValueType and NullValue

* rename TextId to Utf8Id, add code in ValueType

* add CommonTestSuite

* update the code type into int from byte, and other tiny improvements

* remove String.format

18 months agoDefine some base exception class (#5)
Linary [Tue, 29 Dec 2020 07:43:38 +0000 (15:43 +0800)] 
Define some base exception class (#5)

* Add test module and codecov plugin

18 months agoAdd checkstyle plugin to check code style (#3)
Linary [Fri, 25 Dec 2020 12:17:46 +0000 (20:17 +0800)] 
Add checkstyle plugin to check code style (#3)

* Add checkstyle plugin to check code style

* Add travis yaml

18 months agoMerge pull request #2 from hugegraph-ee/build-framework
houzhizhen [Sat, 12 Dec 2020 03:41:26 +0000 (11:41 +0800)] 
Merge pull request #2 from hugegraph-ee/build-framework

Build hugegraph-computer project framework

18 months agoBuild hugegraph-computer project framework 2/head
liningrui [Fri, 11 Dec 2020 06:53:59 +0000 (14:53 +0800)] 
Build hugegraph-computer project framework

21 months agoMerge pull request #1 from hugegraph-ee/module
houzhizhen [Mon, 28 Sep 2020 03:30:10 +0000 (11:30 +0800)] 
Merge pull request #1 from hugegraph-ee/module

add module computer-core and computer-algorithm

21 months agoadd module computer-core and computer-algorithm 1/head
houzhizhen@baidu.com [Wed, 23 Sep 2020 07:51:04 +0000 (15:51 +0800)] 
add module computer-core and computer-algorithm

21 months agofirst commit
houzhizhen@baidu.com [Tue, 22 Sep 2020 03:23:15 +0000 (11:23 +0800)] 
first commit