Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [concept-drift]

9 questions
4
votes
3 answers

What techniques are used to analyze data drift?

I've created a model that has recently started suffering from drift. I believe the drift is due to changes in the dataset but I don't know how to show that quantitatively. What techniques are typically used to analyze and explain model (data)…
Connor
  • 597
  • 1
  • 15
3
votes
2 answers

Is it possible to detect drift with real time predictions?

I have been reading up on detecting data drift and concept drift, I have found this library but it seems all the methods here detect concept drift and take input as if the prediction was correct or not. (Requiring ground truth) is this the correct…
iiphiizy
  • 31
  • 1
3
votes
2 answers

Predictive modeling when output affects future input

Assume I have a model which predicts the outcome of the number of icecreams sold in a store. The model is trained on data for the last 5 years while keeping the last year as a validation set and has produced very good results. We now put the model…
CutePoison
  • 450
  • 2
  • 8
2
votes
1 answer

Dealing with historic data drift

I'm trying to predict a continuous target in an industrial context. The problem I'm facing is that the some of the predictors have changed over time, for example the pressure in the machine was increased. This influenced some of the other…
David So
  • 21
  • 3
2
votes
1 answer

What is the differenc between Real concept drift, virtual concept drift and feature drift

As far as I know, the real concept drift is caused by changes in the decision boundary while virtual drift occurs because of changes in data distribution. Some researchers mention that virtual drift can be denoted as feature change. Is my…
Imen F
  • 21
  • 3
2
votes
0 answers

Detecting Data Drift in Audio Data

For a give set of audio files collected from an industrial process via a microphone, I have extracted suitable features and fed them into a neural network for training a binary classifier as depicted below. The model has been performing quite well…
TwinPenguins
  • 4,157
  • 3
  • 17
  • 53
1
vote
1 answer

What are the advantages of model drift vs concept drift in online learning?

I have asked this question here but I'm also posting it here to get a better insight: https://stats.stackexchange.com/questions/602282/what-are-the-advantages-of-model-drift-vs-concept-drift-in-online-learning Let's say I have a simple linear…
Ash
  • 130
  • 4
1
vote
1 answer

What is the difference between Covariate Shift, Label Shift, Concept Shift, Concept Drift, and Prior Probability Shift?

As a beginner in MLOps, I was overwhelmed by some confusing definitions. As far as I understand, when we have a classifier or regressor with y = f(X) function: Covariate Shift is changing the distribution of independent variables (X), Label Shift…
Mohsen Mahmoodzadeh
  • 43
  • 1
  • 5
0
votes
0 answers

How to visualize a data drift?

I want to show that my data distribution changes between data windows. Is it enough to visualize the mean and variance for every window? Is there any other solution? thank you
Imen F
  • 21
  • 3