◐ Shell
clean mode source ↗

Add support for multithreaded training in the neural net example by WilliamTambellini · Pull Request #2454 · arrayfire/arrayfire

Conversation

@WilliamTambellini

Add support for multigpu parallel training in the neural net example

Enhance the neural net example with multigpu training in parallel.

@9prady9

The updated example looks good. I have made some cmake changes.

@WilliamTambellini

Cool tks. Feel free to merge/modify your way.

9prady9

9prady9 previously approved these changes Mar 28, 2019

@9prady9

I ran it on multiple(two: GTX 1060, AMD Spectre R7) devices, works without any issues. This change demonstrates how to use multiple devices but not so much on how to distribute training data across multiple devices. How difficult would be such an example to implement ?

@WilliamTambellini

how to distribute training data across multiple devices. How difficult would be such an example to implement ?
That will be worth it to do as soon as
#2463
done.
That example at least shows how to do multigpu multimodels training.

@WilliamTambellini

That item would allow to also compare speed of mutiple vs single gpus execution.
Distruibuted single model training is out of scope here.
Review please ?

@WilliamTambellini WilliamTambellini changed the title Add support for multigpu training in the neural net example Add support for multithreaded training in the neural net example

Apr 14, 2020

Labels

2 participants

@WilliamTambellini @9prady9