Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [hardware]

For questions related to data science and its overlap with computer hardware. This may include GPUs, processing times, cloud computing, TPUs, etc.

31 questions
5
votes
1 answer

Reducing the GPU memory usage when the model is already small enough

I trained a model and froze it into a PB (protocol buffer) file and a directory of some variables, and the total size is about 31M. We deployed it using a GPU card and followed this answer and set the per_process_gpu_memory_fraction to a very little…
Lerner Zhang
  • 496
  • 3
  • 10
5
votes
1 answer

GPU performance is about 50% slower than benchmarks

Running this benchmark I get 50% slower performance than the author on practically all deep learning sub problems (SINGLE precision and on TRAINING only): I tested this on a GeForce 1080 GTX Ti and am using PyTorch 1.0.1 with Cuda 10.0.13 (cudnn…
Muppet
  • 777
  • 1
  • 7
  • 13
3
votes
1 answer

Performance of four GTX 1080 Ti's versus one Tesla V100 for Deep Neural Network training

While this may be slightly off-topic, this question does pertain to data science and machine learning. I want to train a VGG16 model on Imagenet from scratch. For this purpose, I am looking into either buying four to six GTX 1080 Ti's or one Tesla…
arao6
  • 141
  • 4
2
votes
0 answers

Will GPU optimized model run on TPU?

There is a project which contains models in DLC format (Snapdragon Neural Processing Engine - SNPE) that I guess are optimized for the Qualcomm Snapdragon 820 chipset (see second link). The project newly also introduced models in Keras format. My…
Kozuch
  • 121
  • 4
2
votes
1 answer

How to estimate machine learning training speed on different hardware

I need to put together a proposal for buying a better computer for machine learning. Is there any good way to estimate the general training speeds of computer hardware? Basicly, I want to be able to say that if we purchase a certain computer it in…
Matthew L
  • 21
  • 1
2
votes
1 answer

General equation for getting an idea of the scale of a machine learning project

I'm writing an application for a project where we intend to teach a model to predict one aspect of an environment (traffic safety) using a database with 10 images (about 300x300px and, say, 256 colors) for each of either 100 000 or 15 million…
Henrik
  • 123
  • 3
2
votes
0 answers

Will crypto currency mining hardware work fine for machine learning?

I've found that because of recession in crypto mining business a lot of mining rigs are available on sale in pretty reasonable prices. For around $1000 we can buy used machine. Will rig like this work fine for machine learning: 6x NVIDIA GTX 1070…
Łukasz W.
  • 121
  • 2
2
votes
1 answer

Are there any reports on Hardware errors affecting experiments?

I recently wrote this as a list of what I have seen / can think of as problem sources that make it hard to reproduce (replicate?) an experiment. I think I have seen most of them, except for hardware errors. My thought was this: A typical computer…
Martin Thoma
  • 18,630
  • 31
  • 92
  • 167
2
votes
2 answers

Which desktop hardware is best for DL?

I will be building my home Deep Learning workstation. Right now, I'm digging for some time about the best HW to use for home conditions. The workstation will be used for my work as a developer, but I want to use it to learn and experiment with DL…
Jaroslav Štreit
  • 121
  • 3
1
vote
1 answer

How do data types influence hardware (CPU / GPU / TPU) performance?

I am currently dealing with a relatively big data set, for which I have some memory usage concerns. I am dealing with most of the different data types : floats, integers, Booleans, characters strings for which some were changed to factors. From a…
Lucas Morin
  • 2,513
  • 5
  • 19
  • 39
1
vote
1 answer

Is it true more CPU core is better for deep learning?

I just started to learn the deep learning in my free time. I was hoping to buy a laptop where I want to implement some small(alexnet) to medium(GoogleNet) networks maybe something bigger. I searched for the GPU. Everyone is suggesting minimum RTX…
Fazla Rabbi Mashrur
  • 153
  • 5
1
vote
0 answers

Which PC hardware would you recommend to invest in for movement ecology studies in R (x,y,t data analysis)?

I mean all possible work with tagging data: GIS, tagging data pre-processing, visualisation, different types of modelling, simulations and modern analysis. I think it will be about 40 tagged animals and maximum 30-40 thousand total locations to work…
Sultan
  • 11
  • 1
1
vote
0 answers

Hardware for deep learning

Disclaimer: I am very new to using stackexchange so bear with me. I am trying to gain experience using neural networks and would like to do a few projects involving them. Right now I am trying to train on the cifar10 dataset and built a quick CNN…
valentinocc
  • 11
  • 1
1
vote
1 answer

What will the required time to process 500GB of images using NVIDIA GEFORCE 930M GPU

I have an image dataset of size 500GiB, and my system specs are NVIDIA GEFORCE 930M, 12GB of RAM and Intel Core i5. I have the following questions: Is it possible such a large dataset to be used in my local machine? If yes, How much time will be…
Tomonso Ejang
  • 113
  • 4
1
vote
0 answers

What video card is necessary for resnet34 64 batches?(How much memory)

I have an old nvidia gt240 and I was considering buying gt 730. However, despite being 7 years older, the gt240 is faster. Do I need at least 4g memory? Also, what card would you recommend?
Goking
  • 23
  • 4
1
2 3