Questions tagged [diffusion]

6 questions
2
votes
2 answers

Edit friendly DDPM noise space

I was reading this paper, "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". In page no. 4, they have mentioned that in DDPM, noise maps of consecutive steps are highly correlated while their edit friendly noise maps of consecutive…
shi.inu
  • 120
  • 10
1
vote
0 answers

Common sense fixes to a buggy diffusion model that won’t overfit one sample?

hope this question is in the right place. I’m working with a toy diffusion model to generate points e.g learning a Swiss roll which to me is a basic use case that I wanted to start with. My model is generally sensible and I’ve implemented both a…
0
votes
0 answers

Learning target of Denoising Diffusion Probabilistic Model

I am trying to understand the learning target of DDPM. Trying to understand $D_{KL}(q(x_{1:T}|x_0)||p_\theta(x_{1:T}|x_0)$ in following line. $$ -\log p_\theta(x_0) <= -\log p_\theta(x_0) + D_{KL}(q(x_{1:T}|x_0)||p_\theta(x_{1:T}|x_0)) $$ $x_0$ is…
0
votes
0 answers

Diffusion models on Data from a uniform distribution

Can Diffusion models learn data sampled from a uniform random distribution?
0
votes
0 answers

How many parameters are necessary before stable diffusion "works"?

Stable diffusion is essentially removing entropy from noisy images. If you have $n$ latent dimensions, and add Gaussian noise independently to each dimension, then the added entropy is on the order of $n\log\sigma$, where $\sigma$ is the variance of…
0
votes
0 answers

How to generate synthetic feature instead of synthetic image using Diffusion-based generative Model?

Is it possible to pass some extracted features from the pre-trained ResNet model to a diffusion model for training and further generate synthetic features instead of images like GAN or VAE? P.S. I tried to do so but it yielded some garbage output.