Markov Chains : The Strange Math That Predicts Almost Anything

Discover how Markov chains predict real systems, from Ulam and von Neumann’s Monte Carlo to PageRank, so you can grasp ...

How Clear Probabilistic Models Can Strengthen Intelligent Systems in an Uncertain World

Software engineer Sai Bhargav Yalamanchi notes that mathematical tools helping practitioners interpret uncertainty have ...
IEEE

Semi-Infinitely Constrained Markov Decision Processes and Provably Efficient Reinforcement Learning

Abstract: We propose a novel generalization of constrained Markov decision processes (CMDPs) that we call the semi-infinitely constrained Markov decision process (SICMDP). Particularly, we consider a ...
IEEE

Semi-Supervised Robust Hidden Markov Regression for Large-Scale Time-Series Industrial Data Analytics and its Applications to Soft Sensing

Abstract: Hidden Markov models (HMMs) for time-series data analysis are attracting wide interests in industries due to their ability to model the extensively existing dynamics and non-Gaussianities.