To optimize weather research and forecasting (WRF) model, a sensitivity analysis has been performed for test thunderstorm events to determine the best combination of cumulus physics (CU) and data source options to be used for simulating thunderstorms over Bangladesh. Six combinations for three cumulus physics options namely, Kain-Fritsch Scheme (KF) (CU-1), Betts-Miller-Janjic Scheme (BMJ) (CU-2) and Grell-Dévényi (GD) Ensemble Scheme (CU-3) and two different data sources namely, National Center for Environmental Prediction (NCEP) Final Analysis (FNL) and the Global Forecast System (GFS) data have been used for this purpose. WRF model has been run on a single domain of 9 km horizontal resolution utilizing the combinations of these cumulus physics and six hourly GFS/FNL datasets for 48 h; from 0000 UTC of 14 May 2017 to 0000 UTC of 16 May 2017 and from 0000 UTC of 29 March 2018 to 0000 UTC of 31 March 2018 as initial and lateral boundary conditions for test event-1 and test event-2 respectively. Model simulated output for rainfall, relative humidity; mean sea level pressure and temperature have been compared with the observed data of Bangladesh Meteorological Department (BMD). Then absolute error of each simulated parameter has been calculated. On the basis of root mean square error (RMSE) for each parameter, better cumulus physics and data source combination has been selected. It is found that, CU-1 and GFS dataset combination exhibits less RMS error in 4 sections out of 12 sections for event-1 and in 5 sections out of 12 sections for event-2. So, it may be expected that Cu_1 and GFS dataset combination may be used for simulating thunderstorm over Bangladesh. After finalizing model physics options and data sets, another test case of TS has been simulated and different parameters are analyzed for justification of WRF setup. It is found that WRF model captured MSLP, temperature and relative humidity very well. But in case of rainfall the simulated value is much smaller than the observed value. For more accuracy more case studies may be carried out including for fair weather days as well as severe TS days.