This paper first improves Chen and Hsieh’s definition of generalized fuzzy numbers, which makes it the generalization of definition of fuzzy numbers. Secondly, in terms of the generalized fuzzy numbers set, we introduce two different kinds of orders and arithmetic operations and metrics based on the λ-cutting sets or generalized λ-cutting sets, so that the generalized fuzzy numbers are integrated into a partial ordering set, a semi-ring and a complete non-separable metric space. Again, through two isomorphism theorem, the relationship between generalized fuzzy number space and fuzzy number space is established. Finally, as an application of generalized fuzzy numbers, the concept of continuous generalized fuzzy number-valued functions is introduced. And it is pointed out that many results of trapezoidal generalized fuzzy numbers can also be extended to generalized fuzzy numbers.