Topics in Discrete Stochastic Processes on Graphs with Application to Computer Science