Skip to main content

AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS.

Publication ,  Journal Article
Bobbio, A; Trivedi, KS
Published in: IEEE Transactions on Computers
January 1, 1986

An approximation algorithm for systematically converting a stiff Markov chain into a nonstiff chain with a smaller state space is described. After classifying the set of all states into fast and slow states, the algorithm proceeds by further classifying fast states into fast recurrent subsets and a fast transient subset. A separate analysis of each of these fast subsets is made and each fast recurrent subset is replaced by a single slow state while the fast transient subset is replaced by a probabilistic switch. After this reduction, the remaining small and nonstiff Markov chain is analyzed by a conventional technique. The algorithm produces asymptotically exact results with respect to the aggregation of fast transient states, while for fast recurrent subsets the asymptotic accuracy depends on the degree of coupling between the fast subset and the remaining states. The algorithm is illustrated using two examples.

Duke Scholars

Published In

IEEE Transactions on Computers

DOI

ISSN

0018-9340

Publication Date

January 1, 1986

Volume

C-35

Issue

9

Start / End Page

803 / 814

Related Subject Headings

  • Computer Hardware & Architecture
  • 4606 Distributed computing and systems software
  • 4009 Electronics, sensors and digital hardware
  • 1006 Computer Hardware
  • 0805 Distributed Computing
  • 0803 Computer Software
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Bobbio, A., & Trivedi, K. S. (1986). AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS. IEEE Transactions on Computers, C35(9), 803–814. https://doi.org/10.1109/TC.1986.1676840
Bobbio, A., and K. S. Trivedi. “AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS.IEEE Transactions on Computers C–35, no. 9 (January 1, 1986): 803–14. https://doi.org/10.1109/TC.1986.1676840.
Bobbio A, Trivedi KS. AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS. IEEE Transactions on Computers. 1986 Jan 1;C–35(9):803–14.
Bobbio, A., and K. S. Trivedi. “AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS.IEEE Transactions on Computers, vol. C–35, no. 9, Jan. 1986, pp. 803–14. Scopus, doi:10.1109/TC.1986.1676840.
Bobbio A, Trivedi KS. AGGREGATION TECHNIQUE FOR THE TRANSIENT ANALYSIS OF STIFF MARKOV CHAINS. IEEE Transactions on Computers. 1986 Jan 1;C–35(9):803–814.

Published In

IEEE Transactions on Computers

DOI

ISSN

0018-9340

Publication Date

January 1, 1986

Volume

C-35

Issue

9

Start / End Page

803 / 814

Related Subject Headings

  • Computer Hardware & Architecture
  • 4606 Distributed computing and systems software
  • 4009 Electronics, sensors and digital hardware
  • 1006 Computer Hardware
  • 0805 Distributed Computing
  • 0803 Computer Software