In this paper, we review the current state of the art in stochastic modeling for spoken dialogue system design. We discuss acoustic modeling of speech units for automatic speech recognition and language modeling of linguistic units for natural language processing. We point out some of the emerging stochastic modeling techniques and show the similarity between language modeling and acoustic modeling. Finally, we address search and decision issues related to the integration of knowledge sources for automatic speech recognition and natural language processing.