Survey of Stochastic-Based Computation Paradigms

Abstract

Effectively tackling the upcoming “zettabytes” data explosion requires a huge quantum leap in our computing power and energy efficiency. However, with the Moore's law dwindling quickly, the physical limits of CMOS technology make it almost intractable to achieve high energy efficiency if the traditional “deterministic and precise” computing model still dominates. Worse yet, the upcoming data explosion mostly comprises statistics gleaned from uncertain, imperfect real-world environment. As such, the traditional computing means of first principles modeling or explicit statistical modeling will very likely be ineffective to achieve flexibility, autonomy, and human interaction. The bottom line is clear: given where we are headed, the fundamental principle of modern computing-deterministic logic circuits can flawlessly emulate propositional logic deduction governed by Boolean algebra-has to be reexamined, and transformative changes in the foundation of modern computing must be made. This paper surveys some of the most important works on stochastic-based computing. We specifically focus on four important research areas: (1) random number generation, (2) stochastic computing, (3) stochastic electronics, and (4) emerging device technology and its potential application in stochastic computing. All these research works share two distinctive features. First, they embrace and exploit quantum-induced randomness as an invaluable information carrier, not the “villain of correct computation” to be suppressed. Second, the theoretical foundation underpinning most of these works are based on neither the Boolean algebra in digital circuit nor the nonlinear amplifying and filtering in analog circuit. Instead, it tightly brings together the algorithmatic essence of computing and the quantum-induced randomness through the powerful framework of stochastic-based computing transformation.