GraphBuilder 1.0 Beta Release
We are pleased to announce the initial beta release of GraphBuilder, our first public release of the code base.
Processing large graphs in a distributed computing environment presents multiple system-level challenges, from parallelizing the graph construction algorithms to achieving balanced system utilization. In addition, the resultant graph must be carefully partitioned to ensure that subsequent application processing is properly balanced. GraphBuilder addresses these challenges with a carefully-designed multi-stage pipeline that leverages the Apache Hadoop framework to achieve scalability.
We are using GraphBuilder to carry out systems research at Intel Labs. We hope that you too will find this tool to be useful for your research and commercial use!
The GraphBuilder beta release supports the following features:
- Graph Construction - Feature extractor for XML and a clean interface for plug-in custom feature extractors.
- Graph Cleaning - Options to eliminate dangling, self, and duplicate edges.
- Graph Transformation - Options for edge directionality conversion.
- Graph Normalization - Compression technique for sparse graph labels.
- Graph Partitioning - Scheme to ensure even distribution of graph data for a balanced distributed computation (supports vertex partitioning scheme for GraphLab 2.1)
- Graph Serialization - Supports JSON Serialization
- Algorithms that are optimized for natural graphs, which possess scale-free structure and power-law degree distribution.
Apache 2 license http://www.apache.org/licenses/LICENSE-2.0.html
- Discussions about GraphBuilder occur on the email@example.com mailing list
- Subscribe to the list at https://lists.01.org/mailman/listinfo/graphbuilder
- Archives are found at http://lists.01.org/pipermail/graphbuilder
- URL: https://github.com/01org/graphbuilder
- HTTP: https://github.com/01org/graphbuilder.git
- GIT-readonly: git://github.com/01org/graphbuilder.git
Note: We will not use any of the integrate, merge, or tracking functions of GitHub, so please continue to use the provided lists.