Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [relational-dbms]

7 questions
19
votes
6 answers

The data in our relational DBMS is getting big, is it the time to move to NoSQL?

We created a social network application for eLearning purposes. It's an experimental project that we are researching on in our lab. It has been used in some case studies for a while and the data in our relational DBMS (SQL Server 2008) is getting…
ePezhman
  • 293
  • 1
  • 4
9
votes
1 answer

Relational Data Mining without ILP

I have a huge dataset from a relational database which I need to create a classification model for. Normally for this situation I would use Inductive Logic Programming (ILP), but due to special circumstances I can't do that. The other way to tackle…
user697110
  • 259
  • 2
  • 5
1
vote
0 answers

Pushing down Group By clause

I've studied this exercise in class But I cannot figure out why, when I push down the Group By clause, I can remove RLCode attribute from GroupBy. Does this action change the meaning of query tree?
Lorenzoi
  • 25
  • 4
0
votes
1 answer

Storing Big Matrix in DataBase

I have a mysql database with the following format: id string 1 foo1... 2 foo2... .. ... There are >100k entries in this db. What I want to do is for each string, compare it to each other string and store some metric of the…
masotann
  • 171
  • 1
  • 6
0
votes
1 answer

Do DBMS decrease Memory requirements?

I finished my Economics thesis using RStudio, but my script was very slow due to massive RAM consumption during the process. My Case I had a massive dataset (stock prices in daily frequency for 10 years, ~700 stocks i.e. $3500\times700$) and I was…
Commissar Vasili Karlovic
  • 135
  • 4
0
votes
2 answers

Data Analysis Process

How do you feed data from a data warehouse to Python for ad-hoc analysis? My day-to-day work is to answer ad-hoc questions, and 95% of the data I need is in our data warehouse. I often query data from our warehouse to CSV file(s), then use Python to…
Bunny Eat Data
  • 1
  • 2
0
votes
0 answers

Best way to store "small" data

I have a small dataset consisting of around 200 measurements of different light sources. The light is measured with a broadband and an IR diode, and the resulting voltage is sampled it with 4 megasamples/second. All the measurements have a length of…
ilja
  • 1
  • 1