Abstract: In the healthcare sector, the number of patients has increased by a significant amount in the last decade which has resulted in overcrowding of hospitals and clinics. Using machine learning (ML) in this domain has proven very useful for both doctors and patients. This research mainly focuses on designing an algorithm for appointment scheduling for doctor’s which helps them prioritize patients based on their medical conditions and history which will give them an idea of which patient needs attention on a priority basis. The study implements various machine learning algorithms such as K-means clustering, which clusters patients into three classes of priority, Markov’s Decision Process (MDP) is used to define the problem and Q-Learning is used to solve it. Using these techniques the research aims to develop a system which automatically books an appointment with a doctor based on inputs given to certain questions related to their medical conditions.