Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [density-estimation]

The construction of an estimate, based on observed data, of an unobservable underlying probability density function (pdf).

13 questions
3
votes
3 answers

How to convert regression into classification?

So I have a regression problem with bunch of features X, and labels in the amount (price $). How can I convert it to classification problem? I have read about convert label from continuous to categorical possibly thesholding at some points for…
Nauman Akram
  • 101
  • 1
  • 5
2
votes
1 answer

Simple example of Parzen window (kernel density estimation)

I am confused about the Parzen Window question. Suppose we have two training data points located at 0.5 and 0.7, and we use 0.3 as its rectangle window width. How do we estimate its probability density? According to the definition, the probability…
rj487
  • 195
  • 2
  • 5
1
vote
0 answers

Why exactly KNN is outperforming Parzen by a huge margin in classificaton task

I'm trying to implement a Naive Bayes classifier, which uses either of hypercubic Parzen window or KNN to estimate a density function. The data I'm using is Fashion MNIST. The steps I take are that first I zero center the vectorized data and divide…
Farhood ET
  • 123
  • 10
1
vote
0 answers

MLE for Poisson conditioned on multivariate Gaussian?

I am writing some Python code to fit 2D Gaussians to fluorescent emitters on a dark background to determine the subpixel-resolution (x, y) position of the fluorescent emitter. The crude, pixel-resolution (x, y) locations of the pixels are stored in…
olympiader
  • 11
  • 1
1
vote
0 answers

How to evaluate KDE against histogram?

I am currently testing some approaches for density estimation, and I think the basic approach of histograms may not be the best option to me and KDE is certainly a good alternative to go. While ago I found a very interesting tutorial by Jake…
Adelson Araújo
  • 280
  • 1
  • 6
1
vote
0 answers

Learn smoothly varying mean and variance of a variable over a 2d domain

For a problem which I am working on at the moment, I'm interested in learning how the mean and variance of some response variable y changes with two independent variables x1 and x2 - i.e. for each coordinate in (x1, x2)-space I wish to have an…
A. White
  • 11
  • 2
1
vote
0 answers

Test independence based on Kernel Density Estimation

I am working on a problem where I have a dataset of $X$ is dataset with $(X, Y, T, K)$ four attributes, I'd like to test if $P(X, Y, T)P(K) = P(X, Y, T, K)$, that is if $X, Y, T$ is independent of $K$. I have two questions: Is it possible to use…
Dogemore
  • 121
  • 3
0
votes
2 answers

logistic regression or density estimation for binary dependent variable and binary (or categorical) features

I have a binary dependent variable $t$ and categorical features. We can even simplify to binary features since I can one-hot encode the categorical variables. In practice the one-hot encoding induces collinearity in the binary features so for…
andins
  • 56
  • 9
0
votes
1 answer

how can i interpret kernel density plots from classification?

all, i have a classification problem where i am predicting likelihood of client defaulting on loan. i plotted the predicted probabilities from my model, and then plotted against the label '1' for default or 0 for non-default. it is cut out here but…
Maths12
  • 496
  • 5
  • 14
0
votes
0 answers

Evaluating models which classify on rolling time intervals

TLDR: I am trying to predict the probability of an incident occurring within a specific time interval. I have data from multiple years, and I know the exact time of year that incidents occur. I have created a baseline model that takes in a time…
zsakib_
  • 1
0
votes
0 answers

What does KDE plot tell to me?

What the KDE plot tells to me? How can I evaluate if my model is good by looking at the graph? For example I have this KDE plot of the residuals(it's x_pred-y_pred) of a machine learning evaluation of a regression problem. How it has to be if the…
SimoneA
  • 41
  • 3
0
votes
1 answer

Connecting timeseries quantities to CDF

In the following paper, [Ponce-Flores, M., Frausto-Solís, J., Santamaría-Bonfil, G., Pérez-Ortega, J., & González-Barbosa, J. J. (2020). Time series complexities and their relationship to forecasting performance. Entropy, 22(1), 89.][1] several…
Omar Shehab
  • 1
  • 3
0
votes
0 answers

Function for KDE-style distribution generation for sampling

I have some points in pytorch and I would like to sample from a distribution that resembles these points. I noticed that the seaborn kde plots seem to draw out/define a distribution graphically and I was wondering if there was a way to do something…
nighthawk
  • 45
  • 2