Magnetic Resonance Imaging (MRI) is increasingly being used in treatment planning due to its superior soft tissue contrast, which is useful for tumor and soft tissue delineation compared to computed tomography (CT). However, MRI cannot directly provide mass density or relative stopping power (RSP) maps, which are required for calculating proton radiotherapy doses. Therefore, the integration of artificial intelligence (AI) into MRI-based treatment planning to estimate mass density and RSP directly from MRI has generated significant interest. A deep learning (DL) based framework was developed to establish a voxel-wise correlation between MR images and mass density as well as RSP. To facilitate the study, five tissue substitute phantoms were created, representing different tissues such as skin, muscle, adipose tissue, 45% hydroxyapatite (HA), and spongiosa bone. The composition of these phantoms was based on information from ICRP reports. Additionally, two animal tissue phantoms, simulating pig brain and liver, were prepared for DL training purposes. The phantom study involved the development of two DL models. The first model utilized clinical T1 and T2 MRI scans as input, while the second model incorporated zero echo time (ZTE) MRI scans. In the patient application study, two more DL models were trained: one using T1 and T2 MRI scans as input, and another model incorporating synthetic dual-energy computed tomography (sDECT) images to provide accurate bone tissue information. The DECT empirical model was used as a reference to evaluate the proposed models in both phantom and patient application studies. The DECT empirical model was selected as the reference for evaluating the proposed models in both phantom and patient application studies. In the phantom study, the DL model based on T1, and T2 MRI scans demonstrated higher accuracy in estimating mass density and RSP for skin, muscle, adipose tissue, brain, and liver. The mean absolute percentage errors (MAPE) were 0.42%, 0.14%, 0.19%, 0.78%, and 0.26% for mass density, and 0.30%, 0.11%, 0.16%, 0.61%, and 0.23% for RSP, respectively. The DL model incorporating ZTE MRI further improved the accuracy of mass density and RSP estimation for 45% HA and spongiosa bone, with MAPE values of 0.23% and 0.09% for mass density, and 0.19% and 0.07% for RSP, respectively. These results demonstrate the feasibility of using an MRI-only approach combined with DL methods for mass density and RSP estimation in proton therapy treatment planning. By employing this approach, it is possible to obtain the necessary information for proton radiotherapy directly from MRI scans, eliminating the need for additional imaging modalities.