We propose and analyze an unfitted finite element method of arbitrary order for solving elliptic problems on domains with curved boundaries and interfaces. The approximation space on the whole domain is obtained by the direct extension of the finite element space defined on interior elements, in the sense that there is no degree of freedom locating in boundary/interface elements. We apply a non-symmetric bilinear form and the boundary/jump conditions are imposed in a weak sense in the scheme. The method is shown to be stable without any mesh adjustment or any special stabilization. The optimal convergence rate under the energy norm is derived, and \(O(h^{-2})\)-upper bounds of the condition numbers are shown for the final linear systems. Numerical results in both two and three dimensions are presented to illustrate the accuracy and the robustness of the method.