Irregular geographic spatio-temporal-field data have been rapidly accumulating; however, data organizations and operations for different irregular types are often segregated, leading to systematic drawbacks, such as interface expansion difficulty and high coupling codes in GIS implementations. The paper proposes a unified approach to organizing and operating irregular geographic spatio-temporal-field data. The proposed approach has two components, namely ‘concepts and definitions’, and ‘logical model’. The first component introduces the concept of primitive elements, which are formal sets of data points, to serve as the smallest building blocks in the data organization. We define the corresponding primitive elements for three prevalent irregularity types (including sparse, imbalanced, and heterogeneous). The second component utilizes object-oriented programming to support the implementation of various operators. Additionally, we develop the layered architecture to decouple data organization, operation, and visualization to assure low coupling among layers. For demonstrations, we conduct case studies to show the effectiveness of our approach. Additionally, we conduct experiments to new irregularity types and illustrate the flexibility and scalability of our approach. Comparisons with classic tensor methods and spatio-temporal analysis methods show that our approach has more comprehensive supports for different data types.