First hitting time python

from numpy import *

hit_idx = (0,4)

# Define a graph by edge list
edges = [[0,1],[1,2],[2,3],[2,4]]

# Create adj. matrix
A = zeros((5,5))
A[zip(*edges)] = 1
# Undirected condition
A += A.T

# Make the final state an absorbing condition
A[hit_idx[1],:] = 0
A[hit_idx[1],hit_idx[1]] = 1

# Make a proper Markov matrix by row normalizing
A = (A.T/A.sum(axis=1)).T

B = A.copy()
Z = []
for n in xrange(100):
    Z.append( B[hit_idx] )
    B = dot(B,A)

from pylab import *
plot(Z)
xlabel("steps")
ylabel("hit probability")
show()

Source: stackoverflow.com

Similar codes

0 vote150 views1 answer
How to count to 1billion in python
Python
0 vote152 views1 answer
Python, importing other scripts from other directories
Python
0 vote148 views1 answer
Add a string to each element of a list python
Python
0 vote206 views1 answer
Iniciar servidor en Django
Python Django
0 vote183 views1 answer
Create a colun in pandas using groupby
Python
1 vote160 views1 answer
Replace all spacec column with underscore in pandas
Python
2 votes156 views2 answers
Dice rolling app in python
Python
0 vote162 views2 answers
Knapsack problem using greedy method in python
Python
0 vote161 views1 answer
Save to xlsx in python
Python
0 vote140 views1 answer
Propositional logic python
Python