20 Commits

Author SHA1 Message Date
Rhett Ying
9782c021de [Dist] move DistNode/EdgeDataLoader to distributed (#7755) 2024-08-29 16:10:05 +08:00
Augusto Berndt
94d3c6cb9f [Doc] Fix a typo in dgl.dataloading.rst (#5211)
changing privimitive to primitive
2023-01-20 14:23:26 +08:00
Rhett Ying
85bd0cdeca [Doc] remove deprected Node/EdgeDataLoader (#5171) 2023-01-13 13:22:16 +08:00
Muhammed Fatih BALIN
84a12cf6a1 [Doc] Add Labor Sampler documentation (#4986)
Co-authored-by: Xin Yao <xiny@nvidia.com>
2022-12-07 08:42:26 +08:00
Mufei Li
9fee20b91d [Sampler] [Example] SAINTSampler and Simplify GraphSAINT Example (#3879)
* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2022-03-30 13:51:37 +08:00
Minjie Wang
ae3316c846 [Doc] Update doc of dataloading package. (#3886)
* wip: dataloading doc

* update dataloading package doc and many others

* lint
2022-03-26 21:59:02 +08:00
Quan (Andy) Gan
d41d07d0f6 [Doc and bugfix] Add docs and user guide and update tutorial for sampling pipeline (#3774)
* huuuuge update

* remove

* lint

* lint

* fix

* what happened to nccl

* update multi-gpu unsupervised graphsage example

* replace most of the dgl.mp.process with torch.mp.spawn

* update if condition for use_uva case

* update user guide

* address comments

* incorporating suggestions from @jermainewang

* oops

* fix tutorial to pass CI

* oops

* fix again

Co-authored-by: Xin Yao <xiny@nvidia.com>
2022-02-28 02:21:51 +08:00
Quan (Andy) Gan
701b4fccc2 [Sampling] New sampling pipeline plus asynchronous prefetching (#3665)
* initial update

* more

* more

* multi-gpu example

* cluster gcn, finalize homogeneous

* more explanation

* fix

* bunch of fixes

* fix

* RGAT example and more fixes

* shadow-gnn sampler and some changes in unit test

* fix

* wth

* more fixes

* remove shadow+node/edge dataloader tests for possible ux changes

* lints

* add legacy dataloading import just in case

* fix

* update pylint for f-strings

* fix

* lint

* lint

* lint again

* cherry-picking commit fa9f494

* oops

* fix

* add sample_neighbors in dist_graph

* fix

* lint

* fix

* fix

* fix

* fix tutorial

* fix

* fix

* fix

* fix warning

* remove debug

* add get_foo_storage apis

* lint
2022-01-30 16:13:00 +08:00
Quan (Andy) Gan
90f10b31cb [Feature] Negative sampling (#3599)
* first commit

* a bunch of fixes

* add unique

* lint

* lint

* lint

* address comments

* Update negative_sampler.py

* fix

* description

* address comments and fix

* fix

* replace unique with replace

* test pylint

* Update negative_sampler.py
2022-01-07 18:26:14 +08:00
Quan (Andy) Gan
b8ce0f41a3 [Sampling] Cluster-GCN and ShaDow-GNN DataLoader (#3487)
* first commit

* next commit

* third commit

* add ShaDow-GNN sampler and unit tests

* fixes

* lint

* cr*p

* lint

* fix lint

* fixes and more unit tests

* more tests

* fix docs

* lint

* fix

* fix

* fix

* fixes

* fix doc
2021-11-16 13:16:25 +08:00
Quan (Andy) Gan
99751d4960 [Doc] Rename block to message flow graph (#2702)
* rename block to mfg

* revert

* rename
2021-02-25 18:26:19 +08:00
Minjie Wang
8a07ab7737 [Doc] Tutorials re-organization (#2683)
* reorg

* change titles

* rm some stale API doc; minor fix

* fix docs

* add warning

* rm new-tutorial run in ci

* lint
2021-02-20 17:42:45 +08:00
Tong He
e2e524df41 [Feature] Add GraphDataLoader implementation (#2496)
* add graph dataloader

* add to doc

* fix

* fix

* fix docstring

* update according to torch default_collate

* add unittest

* fix

* fix lint

* fix
2021-01-07 13:38:21 +08:00
nv-dlasalle
6eda605ccd [BugFix][Dataloading] Disable AsyncTransferer copying to anywhere but the GPU (#2323)
* Disable copying for anywhere but the GPU

* Remove unused import and remove references to transferring from the GPU from the docs

* Skip gpu test in cpu mode

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2020-11-07 21:34:54 +08:00
nv-dlasalle
d453d72dd1 [Doc][Dataloading] Expand documentation of AsyncTransferer (#2313)
* Update docs

* Make non-default streams non-blocking
2020-11-02 12:28:30 -08:00
nv-dlasalle
f673fc2553 [Dataloading] Add class for copying tensors to/from the GPU on a non-default stream (#2284)
* Add async transferer class

* Add async ndarray copy interface

* Add python bindings

* Fix comment

* Add python class

* Fix linting issues

* Add python unit test

* Update python interface

* move async_transferer to cuda only directory

* Fix linting issue

* Move out of contrib

* Add doc strings

* Move test compute from backend

* Update comment

* Fix test naming

* Fix argument usage

* Wrap/unwrap backend parameters

* Move to dataloading

* Move to 'dataloading'

* Make GPU/CPU compatible

* Fix unit tests

* Add docs

* Use only backend interface for datamovement in unit test
2020-10-30 07:29:06 -07:00
Minjie Wang
f13b9b6212 [Doc] Scan the API docs and make many changes (#2080)
* WIP: api

* dgl.sampling, dgl.data

* dgl.sampling; dgl.dataloading

* sampling packages

* convert

* subgraph

* deprecate

* subgraph APIs

* All docstrings for convert/subgraph/transform

* almost all funcs under dgl namespace

* WIP: DGLGraph

* done graph query

* message passing functions

* lint

* fix merge error

* fix test

* lint

* fix

Co-authored-by: Quan Gan <coin2028@hotmail.com>
2020-08-20 23:26:49 +08:00
Quan (Andy) Gan
4f1da61b58 [Doc] fix inconsistencies in minibatch user guide (#2032) 2020-08-17 12:43:43 +08:00
Quan (Andy) Gan
1f7b219594 [Doc] User guide section 5 and 6 (#2029)
* [Doc] User guide section 5 and 6

* oops

* fix
2020-08-17 09:47:01 +08:00
Quan (Andy) Gan
cd48435206 [Transform] Docstring and subframes (#1962)
* update knn graph docs

* more docs

* [Doc] transform module docstrings

* remove copy_ndata and copy_edata

* fix

* lint

* fix

* fix

* fix

* clean up docstrings

* fix docstring

* dtype specifications

* addresses comments

* fix

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2020-08-13 10:41:43 +08:00