Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [google-cloud]

13 questions
8
votes
2 answers

Joining tables from different locations in Bigquery

I have been trying to join two tables from different datasets that are in different locations but in the same project. However, I keep getting the error: dataset not found in US location. The datasets' locations are US and us-east1 Here is what I…
shivanshu dhawan
  • 178
  • 1
  • 9
7
votes
3 answers

How to setup and run Conda on Google Colab

I am interested in using Google Colab for data modeling. How do I install conda, create an environment and run python in a notebook? I did some searching and found some helpful hints, but had several issues with this. I can only get a partially…
Donald S
  • 1,889
  • 3
  • 7
  • 28
3
votes
1 answer

Comparing rows in Data Studio

I am using Data Studio for a project and I am connecting to my BigQuery table. My table contains following columns: Date Store_name Footfall I'd love to compare the footfall of two stores using Data Studio but apparently I can't do that! Any hints…
helloworld
  • 171
  • 3
2
votes
0 answers

Local RTX 2080 is 3x faster than V100 on GCP?

I have a gaming rig with an i9 CPU, 32GB RAM and RTX 2080, and I have a GCP VM with 4 vCPU, 52 GB RAM and V100. I try to train the same dataset using the same toolchain on both machines and these are my ETA's: GCP VM: 16 days Gaming rig: 5 days How…
vaid
  • 121
  • 1
1
vote
1 answer

Lower performace with same script on google cloud vs laptop

So I want to test a lot of hyperparameters for an xgboost classification model and also do cross validation for all of these. To do this I use a gridsearch. To speed up the process I want to use as many cpu cores as possible, so I set the n_jobs…
JohnDoe
  • 11
  • 1
1
vote
0 answers

Recommendation Systems User Profile Streaming Data on GCP

I have a recommendation system that recommends articles to different users. I am planning to provide the recommendations in an off-line fashion. Where I already have a table in BigQuery which has the recommendations and an API call returns the…
m2rik
  • 321
  • 1
  • 9
1
vote
1 answer

How do I change the location of Google BigQuery

So, I'm trying to use Google BigQuery for the first time for a project of mine, and I'm a bit confused. The documentation isn't helping much, and it looks like all the Google employees are gone thanks to the current epidemic, judging by the blogpost…
nick012000
  • 263
  • 2
  • 9
1
vote
0 answers

Does Google Document AI Form Parser learn from Human In The Loop?

I've just started using Document AI's Form Parser Processor to extract fields from some forms I have. They are about 40 pages long, always follow the same format, and generally seem pretty easy to parse as the tool got it about 90% right straight…
Robert1er
  • 11
  • 2
1
vote
0 answers

How to save hugging face fine tuned model using pytorch and distributed training

I am fine tuning masked language model from XLM Roberta large on google machine specs. When I copy the model using gsutil and subprocess from container to GCP bucket it gives me error. Versions Versions torch==1.11.0+cu113 …
MAC
  • 277
  • 2
  • 9
0
votes
1 answer

How many images can be trained in Google Colab?

I am using the ResNet50 pretrained model to train my images using TensorFlow. I have 70k images and upgraded to Google Colab Pro, but still I am facing a memory error. So how many images I can train in Google Colab? And how much RAM is needed for…
Bala venkatesh
  • 361
  • 3
  • 10
0
votes
1 answer

Google DataFlow

I'm trying to build a Google dataflow pipeline through one of the posts in Medium. https://levelup.gitconnected.com/scaling-scikit-learn-with-apache-beam-251eb6fcf75b However, it seems like I'm missing one of the project argument and it throws the…
Cassie.L
  • 103
  • 2
0
votes
0 answers

Which GPU instance to opt for in Google Cloud?

I am looking to rent a GPU instance in Google Cloud for casual deep learning model training purposes and wondered about the differences between the available Nvidia Tesla versions which are Nvidia Tesla T4 Nvidia Tesla P4 Nvidia Tesla V100 Nvidia…
mausamsion
  • 1,237
  • 1
  • 9
  • 13
0
votes
0 answers

Why does Vertex AI's Confusion Matrix data decreases as I increase confidence threshold?

This is a binary classification AI. To me, it does not make sense for the total data in the Matrix to decrease. After all, the system only has 4 options (True Positive, True Negative, False Positive, and False Negative), right?
2 False
  • 1