This paper presents a method for detecting damage in irregular 2D and 3D continuum structures based on combination of wavelet transform (WT) with fuzzy inference system (FIS) and particle swarm optimization (PSO). Many damage detection methods study regular structures. This method studies irregular structures and doesn\'t need response of healthy structures. First the damaged structure is analyzed with finite element methods, and damage response is obtained at the finite element points that have irregular distance, secondly the FIS, which is optimized by PSO is used to obtain responses at points, having equal distance by response at those points that previously obtained by the finite element methods. Then a 2D (for 2D continuum structures) or a 3D (for 3D continuum structures) matrix is performed by equal distance point response. Thirdly, by applying 2D or 3D wavelet transform on 2D or 3D matrix that previously obtained by FIS detail matrix coefficient of WT is obtained. It is shown that detail matrix coefficient can determine the damage zone of the structure by perturbation in the damaged area. In order to illustrate the capability of proposed method some examples are considered.