The physical properties of URhSn with quasi-kagome structure are studied using single-crystalline samples via electrical resistivity, magnetic susceptibility, heat capacity, thermal expansion, and high-field magnetization measurements. Remarkable magnetic anisotropy is found in the ferromagnetic (FM) state below ${T}_{\mathrm{C}}=16\phantom{\rule{4pt}{0ex}}\mathrm{K}$ as well as in the ordered state between ${T}_{\mathrm{C}}$ and ${T}_{\mathrm{O}}=54\phantom{\rule{4pt}{0ex}}\mathrm{K}$, where the easy and hard magnetization directions are the hexagonal [0001] and $[10\overline{1}0]$ axes. In the paramagnetic state, the magnetic susceptibility shows a Curie-Weiss behavior; the Weiss temperatures are positive and negative for [0001] and $[10\overline{1}0]$, respectively, indicating the presence of both FM and antiferromagnetic (AFM) correlations. The entropy release for $5f$ electrons is approximately $R\phantom{\rule{0.16em}{0ex}}\mathrm{ln}3$ at ${T}_{\mathrm{O}}$. The thermal expansion coefficient is strongly anisotropic around ${T}_{\mathrm{O}}$ between the hexagonal basal plane and the [0001] axis, indicating its remarkable anisotropic magnetoelastic response and uniaxial stress dependences. Interestingly, the magnetic field response of the higher-temperature ordered state is unusual: ${T}_{\mathrm{O}}(H)$ increases and the heat-capacity jump is enhanced with the magnetic field for $H\phantom{\rule{0.16em}{0ex}}||\phantom{\rule{4pt}{0ex}}[0001]$. Based on the established thermodynamic evidence for the second-order transition at ${T}_{\mathrm{O}}(H)$, a plausible scenario is the occurrence of a canted AFM ordering or a conical state under magnetic fields, which is stabilized when coupled with field-induced magnetic moments along the [0001] axis. Another possibility is the occurrence of quadrupole ordering at ${T}_{\mathrm{O}}(H)$.