Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [markov]

16 questions
10
votes
2 answers

How do scientists come up with the correct Hidden Markov Model parameters and topology to use?

I understand how a Hidden Markov Model is used in genomic sequences, such as finding a gene. But I don't understand how to come up with a particular Markov model. I mean, how many states should the model have? How many possible transitions? Should…
ABCD
  • 3,510
  • 2
  • 18
  • 30
7
votes
1 answer

What's a good Python HMM library?

I've looked at hmmlearn but I'm not sure if it's the best one.
dirtysocks45
  • 243
  • 2
  • 3
  • 6
6
votes
1 answer

HMMLearn Predict Next Observed Event

From my understanding you can use the transition matrix to predict the probability of going from the last predicted hidden state(state t), to the t+1 hidden state. My confusion is how in code format do I go from the hidden state predicted at time…
Femi
  • 61
  • 1
5
votes
1 answer

What is the relationship between Markov Random Fields and Conditional Random Fields?

In Neural networks [3.8] : Conditional random fields - Markov network by Hugo Larochelle it seems to me that a Markov Random Field is a special case of a CRF. However, in the Wikipedia article Markov random field it says: One notable variant of a…
Martin Thoma
  • 18,630
  • 31
  • 92
  • 167
3
votes
2 answers

How can I predict the post popularity of reddit.com with hidden markov model(HMM)?

If I get some posts on reddict.com, how can I predict whether this post will (trending/hot/popular) in the future or not? I would like to use the hidden markov model to predict it, but I don`t know how to define the hidden states and observation…
OOO
  • 39
  • 2
3
votes
1 answer

Why is it an advantage "that Markov chains are never needed" to obtain gradients?

In the original GAN (Generative Adversarial Network) paper, Generative adversarial networks by I. Goodfellow, J. Pouget-Abadie, M. Mirza et. al. they state an advantage of the GAN is "that Markov chains are never needed, only backprop is used to…
p1unge
  • 33
  • 3
2
votes
2 answers

Which predictive model is appropriate?

I'm completely lost when trying to choose the type of predictive model for my problem. Is it autoregressive model, nonlinear time series, Markov Chain or other? Can someone please give me some advise? 78, 18, 51, 89, 19, 43, 62, 28, 94,…
howardpotts
  • 41
  • 1
  • 3
2
votes
1 answer

Undestanding Bayesian network with OpenMarkov

I downloaded OpenMarkov software for probabilistic graphical models and tried it on mtcars dataset. The mtcars.csv data looks like this: In OpenMarkov GUI, I went to Tools > Learning and loaded mtcars.csv dataset. I then adjusted preprocessing…
rnso
  • 1,558
  • 3
  • 16
  • 34
1
vote
0 answers

global independence vs local independence in markov network

I could not understand the local independence and global independence of a markov network. Please help me understand with a simple graph
prog
  • 145
  • 1
  • 4
1
vote
1 answer

Order images in the correct order

This is a captcha where you have to select the side that makes more sense. I am trying to use machine learning trying to break it. My approach is to use Google's vision AI to extract keywords from those images and then use a markov chain and…
Jan Moritz
  • 71
  • 6
1
vote
0 answers

How can one be assured that generative models are not memorizing dataset, and that they will generate an unique image outside of dataset?

If all GAN can do is capture the probability distribution of the dataset, then shouldn't they be similar to handing out images from the dataset? How can we verify that the images that they generate are unique images outside of the dataset?
TheMightyBarbarian
  • 73
  • 6
1
vote
0 answers

Training HMMs using the EM algorithm

How would I train an HMM using the EM algorithm so the transition matrix is upper diagonal?
ealiaj
  • 205
  • 2
  • 6
0
votes
2 answers

Simple Markov Chains Memoryless Property Question

I have a sequential data from time T1 to T6. The rows contain the sequence of states for 50 customers. There are only 3 states in my data. For example, it looks like this: T1 T2 T3 T4 T5 T6 Cust1 C B C A A C My transition…
mlgal55
  • 43
  • 1
  • 4
0
votes
0 answers

Application of HMM to model contest selection behaviour in fantasy sports

I am working on a research project wherein i have to model contest selection behaviour as a function of immediate gain, immediate loss, cumulative gain, cumulative loss. The contest choices are 1,2,and 3. And 0 is a state where the participant did…
apurva jha
  • 1
0
votes
0 answers

For a node in an undirected graph - does the node affect itself if its markov blanket is known?

Consider the following Markov Random Field. Question 1: Which of the following nodes will have no effect on H given the Markov Blanket of H? Question 2: Will node H itself have any effect on itself, given the Markov Blanket of H? If yes, then why,…
Deepak Tatyaji Ahire
  • 101
  • 2
1
2