Commit Graph

128 Commits

Author SHA1 Message Date
Da Zheng
6e7f19f27b [Distributed] add distributed in-degree and out-degree. (#2918)
* add distributed in-degree and out-degree.

* update comments.

* fix a bug.

* add tests.

* add tests.

* fix a bug.

* fix docstring.

* update doc.

* fix

* fix.

Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2021-05-18 19:46:09 +08:00
Quan (Andy) Gan
657c220de7 [Feature] Python interface for adjacency matrix summation and multiplication (#2893)
* test commit

* fixes

* oops

* add docs

* lint

* why does it say I have a trailing whitespace

* oh ok

* fixes

* why there's an invalid argument error

* address comments

* fix

* address comments
2021-05-17 19:47:02 +08:00
kyawlinoo
b03077b60d [NN] GCNII model added <https://arxiv.org/pdf/2007.02133.pdf> (#2874)
* Auto stash before rebase of "origin/pytorch-nn-working"

GCNII model added

* linting

* linting

* lint

* Frequency Adaptive gcn init comit

* Revert "Frequency Adaptive gcn init comit"

This reverts commit 86a80586ac.

* Update python/dgl/nn/pytorch/conv/gcn2conv.py

modified docstring

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* added beta formula and changed param name

* fix docstring

* lint

* white space lint

* update docstring

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* docstring formula update

* added gcn2

* added GCN2Conv

* Update nn.pytorch.rst

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-05-17 10:25:59 +08:00
Quan (Andy) Gan
caa6d6072c [Feature] Replacing thread_wrapped_func with minimal mp.Process wrapper (#2905)
* standardizing thread_wrapped_func

* lints

* Update __init__.py
2021-05-14 11:34:49 +08:00
YYY
c18f957d0e [Model] add implementation of twirls (#2770)
* add implementation of twirls

* format the code

* fix some format error, and ignore others

* fix format errors

* fix format errors

* expose unfolding & attention

* Update nn.pytorch.rst

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-05-11 09:58:48 +08:00
xiang song(charlie.song)
975eb8fc5d [Distributed] Distributed node embedding and sparse optimizer (#2733)
* Draft for sparse emb

* add some notes

* Fix

* Add sparse optim for dist pytorch

* Update test

* Fix

* upd

* upd

* Fix

* Fix

* Fix bug

* add transductive exmpale

* Fix example

* Some fix

* Upd

* Fix lint

* lint

* lint

* lint

* upd

* Fix lint

* lint

* upd

* remove dead import

* update

* lint

* update unitest

* update example

* Add adam optimizer

* Add unitest and update data

* upd

* upd

* upd

* Fix docstring and fix some bug in example code

* Update rgcn readme

Co-authored-by: Ubuntu <ubuntu@ip-172-31-57-25.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
2021-05-03 08:37:40 +08:00
Hengrui Zhang
a1f59c3b68 [Feature] QM9Edge Dataset Support (#2704)
* [Feature] Support QM9Edge Datset

* Update qm9_edge.py

* disable tqdm

* Update qm9_edge.py

* Update qm9_edge.py

* Update qm9_edge.py

* Update qm9_edge.py

* Update qm9_edge.py

* Update qm9_edge.py

* Update qm9_edge.py

* remove preprocessing part

* add comparisons in qm9.py

* [docs] add qm9edge dataset

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-03-09 14:51:21 +08:00
Quan (Andy) Gan
99751d4960 [Doc] Rename block to message flow graph (#2702)
* rename block to mfg

* revert

* rename
2021-02-25 18:26:19 +08:00
Minjie Wang
8a07ab7737 [Doc] Tutorials re-organization (#2683)
* reorg

* change titles

* rm some stale API doc; minor fix

* fix docs

* add warning

* rm new-tutorial run in ci

* lint
2021-02-20 17:42:45 +08:00
Da Zheng
0fc649523b [Doc] Distributed heterogeneous graph training (#2654)
* update DistGraph docstrings.

* add user guide.

* add doc string.

* fix.

* fix.

* fix.

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-02-19 10:48:05 -08:00
xiang song(charlie.song)
453d358d2c [Doc] Fix docs for sparse optimizer (#2680)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-02-19 14:07:35 +08:00
Quan (Andy) Gan
3a19bbc508 fix doc (#2604) 2021-02-02 11:04:43 +08:00
Minjie Wang
4ca706e1b4 [Doc] Update doc of dgl.function (#2585)
* update doc of dgl.function

* small fix
2021-01-28 16:32:18 +08:00
Zihao Ye
7bab1365e2 [feature] Supporting half precision floating data type (fp16). (#2552)
* add tvm as submodule

* compilation is ok but calling fails

* can call now

* pack multiple modules, change names

* upd

* upd

* upd

* fix cmake

* upd

* upd

* upd

* upd

* fix

* relative path

* upd

* upd

* upd

* singleton

* upd

* trigger

* fix

* upd

* count reducible

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* only keep related files

* upd

* upd

* upd

* upd

* lint

* lint

* lint

* lint

* pylint

* upd

* upd

* compilation

* fix

* upd

* upd

* upd

* upd

* upd

* upd

* upd doc

* refactor

* fix

* upd number

Co-authored-by: Zhi Lin <linzhilynn@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-42-78.us-east-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-21-156.us-east-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-01-28 11:21:58 +08:00
xiang song(charlie.song)
a7e941c379 [Feature] Add support for sparse embedding (#2451)
* Add sparse embedding for dgl and update rgcn example

* upd

* Fix

* Revert "Fix"

This reverts commit 4da87cdfb8.

* Fix

* upd

* upd

* Fix

* Add unitest and update impl

* fix

* Clean up rgcn example code

* upd

* upd

* update

* Fix

* update score

* sparse for sage

* remove model sparse

* upd

* upd

* remove global norm

* revert delete model_sparse.py

* update according to comments

* Fix doc

* upd

* Fix test

* upd

* lint

* lint

* lint

* upd

* upd

* clean up

Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal>
2021-01-28 00:26:49 +08:00
Tong He
0855d25501 [NN] Support scalar edge weight for GraphConv, SAGEConv and GINConv (#2557)
* add edge weight in forward

* fix lint

* fix

* fix

* address comments

* add utils

* add util to normalize in gcn way

* fix lint

* add unittest

* fix lint

* fix docstring

* fix docstring

* address comments

* improve notation consistence

* use preferred fn
2021-01-26 23:34:12 +08:00
Quan (Andy) Gan
6c23fba8fa [Doc][Org] move edge_softmax to functional (#2442)
* move edge_softmax to functional

* change examples

* fixes

* revert

* fix

* fix

* remove

* fix

* test

* add init

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-01-26 12:46:37 +08:00
Quan (Andy) Gan
2288098ba6 [Feature] Converting a block to a graph and allow block construction (#2555)
* first commit

* more commit

* fix and docstring

* add to api reference

* address comments

* Update convert.py
2021-01-24 12:44:54 +08:00
xnouhz
2c6d071617 [Feature] QM9 Dataset Support (#2521)
* [Model] MixHop for Node Classification task

* [docs] update

* [docs] update

* [fix] remove seed option

* [fix] update readme

* [feature] support qm9 dataset

* [style] update

* [docs] fix the details

* [fix] indexing only support int

* [style] update

* [fix] multiple backends support

* [docs] add qm9

* [fix] Z type: float32 -> int32

* [fix] Z type: int32 -> long

* [docs] add ref

* [docs] fix

* [docs] update

* [docs] update

* [fix] test eval

* [docs] fix example

Co-authored-by: xnuohz@126.com <ubuntu@ip-172-31-44-184.us-east-2.compute.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-01-21 01:33:30 +08:00
Da Zheng
1db7588739 fix. (#2534)
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-01-14 14:23:36 +08:00
Quan (Andy) Gan
e018939729 [Tutorial] New tutorials for small graphs (#2482)
* new tutorials for small graphs

* address changes and use GraphDataLoader

* fix and add data

* fix load_data

* style fixes

* Update 5_graph_classification.py
2021-01-10 22:24:21 +08:00
Tong He
e2e524df41 [Feature] Add GraphDataLoader implementation (#2496)
* add graph dataloader

* add to doc

* fix

* fix

* fix docstring

* update according to torch default_collate

* add unittest

* fix

* fix lint

* fix
2021-01-07 13:38:21 +08:00
Zihao Ye
fa5f4d6aa7 [Doc] Hotfix on docstring of set_batch_num_edges (#2498) 2021-01-06 21:45:04 +08:00
Zihao Ye
f960468f50 [feature] APIs for manually set batch_num_nodes and batch_num_edges (#2430)
* wip

* udp

* upd

* fix typo

* lint

* lint

* upd

* upd

* lint

* lint

* upd

* upd

* tftest

* fix

* fallback numpy

* fix tf

* docstring

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-01-04 23:43:58 +08:00
Zihao Ye
baace710cf [documentation] Improve the docstring of global pooling layer (#2437)
* upd

* fix-link

* lint
2020-12-21 10:12:54 +08:00
Zihao Ye
6b02babbad [doc] Add docstring for segment reduce. (#2375) 2020-11-27 18:04:13 +08:00
Mufei Li
45e3e9af2c [WIP] Misc Fix (#2359)
* Update

* Update

* Update
2020-11-19 23:54:55 +08:00
nv-dlasalle
6eda605ccd [BugFix][Dataloading] Disable AsyncTransferer copying to anywhere but the GPU (#2323)
* Disable copying for anywhere but the GPU

* Remove unused import and remove references to transferring from the GPU from the docs

* Skip gpu test in cpu mode

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2020-11-07 21:34:54 +08:00
nv-dlasalle
d453d72dd1 [Doc][Dataloading] Expand documentation of AsyncTransferer (#2313)
* Update docs

* Make non-default streams non-blocking
2020-11-02 12:28:30 -08:00
nv-dlasalle
f673fc2553 [Dataloading] Add class for copying tensors to/from the GPU on a non-default stream (#2284)
* Add async transferer class

* Add async ndarray copy interface

* Add python bindings

* Fix comment

* Add python class

* Fix linting issues

* Add python unit test

* Update python interface

* move async_transferer to cuda only directory

* Fix linting issue

* Move out of contrib

* Add doc strings

* Move test compute from backend

* Update comment

* Fix test naming

* Fix argument usage

* Wrap/unwrap backend parameters

* Move to dataloading

* Move to 'dataloading'

* Make GPU/CPU compatible

* Fix unit tests

* Add docs

* Use only backend interface for datamovement in unit test
2020-10-30 07:29:06 -07:00
Mufei Li
7a6d66682f Update dgl.data.rst (#2217) 2020-09-21 10:15:24 +08:00
Mufei Li
877101a96b [Doc] Update Doc for UDFs (#2131)
* Update Doc for UDFs

* add degree bucketing explanation

* Update udf.rst

* Update

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2020-09-13 04:57:06 +08:00
Jinjing Zhou
0afacfb873 Fix create_format_ to create_formats (#2184)
* Update dgl.DGLGraph.rst

* Update gcn.py
2020-09-12 14:44:30 +08:00
Zihao Ye
5bc029b99f upd (#2097) 2020-08-23 21:25:31 +08:00
Minjie Wang
163398c036 Update dgl.DGLGraph.rst 2020-08-23 10:53:33 +08:00
Tianjun Xiao
7ead28c315 [Doc] [NN] Fix message and nn user guide link (#2090)
* fix user guide link

* some fix on tensorflow
2020-08-22 00:18:22 +08:00
Xiangkun Hu
6f26cfcaec [Doc] Fix links and references in dataset user guide (#2085)
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref

* modify the link of save_graphs and load_graphs in dataset user guide

* move image to s3 server.

* fix links and ref
2020-08-21 21:09:26 +08:00
Minjie Wang
f13b9b6212 [Doc] Scan the API docs and make many changes (#2080)
* WIP: api

* dgl.sampling, dgl.data

* dgl.sampling; dgl.dataloading

* sampling packages

* convert

* subgraph

* deprecate

* subgraph APIs

* All docstrings for convert/subgraph/transform

* almost all funcs under dgl namespace

* WIP: DGLGraph

* done graph query

* message passing functions

* lint

* fix merge error

* fix test

* lint

* fix

Co-authored-by: Quan Gan <coin2028@hotmail.com>
2020-08-20 23:26:49 +08:00
Da Zheng
9da1629c9d [Distributed] Some small fixes on doc (#2049)
* quick fix.

* update sparse optimizer.

* fix.

* fix
2020-08-18 21:13:19 -07:00
Da Zheng
75ffc31f76 [Doc] Update the docstring of distributed APIs. (#2025)
* add doc.

* update DistGraph.

* add DistTensor.

* update DistEmbedding.

* add partition.py

* add sampling.

* fix.

* add graph partition book and create a base class.

* fix test.

* add rst.

* update doc rst.

* update.

* fix.

* fix docs

* update distributed tensor and embeddings.

* add checks.

* update DistGraph.

* update initialization.

* fix graph partition book.

* update graph partition book.

* update partition.

* update partition.

* fix.

* add example code.

* update DistGraph

* Update python/dgl/distributed/dist_context.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* Update python/dgl/distributed/dist_context.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* Update python/dgl/distributed/dist_dataloader.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* Update python/dgl/distributed/dist_dataloader.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* Update python/dgl/distributed/dist_dataloader.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* update initialize.

* update dataloader.

* update distgraph.

* update DistGraph.

* update DistTensor.

* update.

* more updates.

* fix lint.

* add num_nodes and num_edges

Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2020-08-18 11:53:45 -07:00
Tianjun Xiao
65866989c0 [NN] [Doc] Fix nn api doc (#2047)
* fix mxnet nn doc and no note on chebconv

* change notes to note to highlight
2020-08-18 23:47:16 +08:00
Mufei Li
be444e52d9 [Doc/Feature] Refactor, doc update and behavior fix for graphs (#1983)
* Update graph

* Fix for dgl.graph

* from_scipy

* Replace canonical_etypes with relations

* from_networkx

* Update for hetero_from_relations

* Roll back the change of canonical_etypes to relations

* heterograph

* bipartite

* Update doc

* Fix lint

* Fix lint

* Fix test cases

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Update

* Fix test

* Fix

* Update

* Use DGLError

* Update

* Update

* Update

* Update

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Update

* Fix

* Update

* Fix

* Fix

* Fix

* Update

* Fix

* Update

* Fix

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

* Fix

* Update

* Update

* Update

* Update

* Update

* Update

* rewrite sanity checks

* delete unnecessary checks

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

* Update

* Update

* Update

* Fix

* Fix

* Fix

* Update

* Fix

* Update

* Fix

* Fix

* Update

* Fix

* Update

* Fix

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Quan Gan <coin2028@hotmail.com>
2020-08-18 04:26:29 +08:00
Jinjing Zhou
0afc3cf8e1 [NN] Add ChebConv for Tensorflow (#2038)
* add chebconv

* fix

* lint

* fix lint

* docs
2020-08-17 22:12:27 +08:00
Quan (Andy) Gan
4f1da61b58 [Doc] fix inconsistencies in minibatch user guide (#2032) 2020-08-17 12:43:43 +08:00
Quan (Andy) Gan
1f7b219594 [Doc] User guide section 5 and 6 (#2029)
* [Doc] User guide section 5 and 6

* oops

* fix
2020-08-17 09:47:01 +08:00
Xiangkun Hu
62e69b67aa [Doc] Modify the link of save_graphs and load_graphs in dataset user guide (#2027)
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref

* modify the link of save_graphs and load_graphs in dataset user guide
2020-08-15 09:21:08 +08:00
Jinjing Zhou
de2e608bb3 Update dgl.rst (#2020) 2020-08-14 18:18:45 +08:00
Xiangkun Hu
f4f78803cf [Doc] Update links by :ref in dataset user guide (#2024)
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref
2020-08-14 17:28:54 +08:00
Quan (Andy) Gan
cd48435206 [Transform] Docstring and subframes (#1962)
* update knn graph docs

* more docs

* [Doc] transform module docstrings

* remove copy_ndata and copy_edata

* fix

* lint

* fix

* fix

* fix

* clean up docstrings

* fix docstring

* dtype specifications

* addresses comments

* fix

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2020-08-13 10:41:43 +08:00
Tianjun Xiao
69f5869f3b [Doc] NN doc refactor Conv Layers (#1672)
* go through gcn, relgcn

* fix tagconv formula

* fix doc in sageconv

* fix sgconv doc

* replace hat with tilde

* more comments on gmmconv

* fix agnnconv chebconv doc

* modify nnconv doc

* remove &

* add nn conv examples

* Rebase master

* More merge conflicts

* check homo

* add back self loop for some convs, check homo in tranform

* add example for denseconv

* add example and doc for dotgat and cfconv

* check in-degree for graphconv

* add language fix

* gconv address all comments

* another round of change based on api template

* change agnn

* go through agnn, appnp, atomic, cf, cheb, dense, gat, sage modules

* finish pytorch part of nn conv

* mxnet graphconv done

* tensorflow graphconv works

* add new modules into doc

* add comments to not split code

* refine doc

* resr

* more comments

* more fix

* finish conv and dense conv part api

* pylint fix

* fix pylink

* fix pylint

* more fix

* fix

* fix test fail because zere in degree

* fix test fail

* sage is not update for mxnet tf

Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-81.us-east-2.compute.internal>
2020-08-12 18:47:19 +08:00