Many applications, including the image search engine, image inpainting, hyperspectral image dimensionality reduction, pattern recognition, and time series prediction, can be facilitated by considering the given discrete data–set as a point-cloudP{\mathcal P}in some high dimensional Euclidean spaceRs{\mathbb R}^{s}. Then the problem is to extend a desirable objective functionfffrom a certain relatively smaller training subsetC⊂P\mathcal {C}\subset {\mathcal P}to some continuous manifoldX⊂Rs{\mathbb X}\subset {\mathbb R}^{s}that containsP{\mathcal P}, at least approximately. More precisely, when the point cloudP{\mathcal P}of the given data–set is modeled in the abstract by some unknown compact manifold embedded in the ambient Euclidean spaceRs{\mathbb R}^{s}, the extension problem can be considered as the interpolation problem of seeking the objective function on the manifoldX{\mathbb X}that agrees withffonC\mathcal {C}under certain desirable specifications. For instance, by considering groups of cardinalityssof data values as points in a point-cloud inRs{\mathbb R}^{s}, such groups that are far apart in the original spatial data domain inR1{\mathbb R}^{1}orR2{\mathbb R}^{2}, but have similar geometric properties, can be arranged to be close neighbors on the manifold. The objective of this paper is to incorporate the consideration of data geometry and spatial approximation, with immediate implications to the various directions of application areas. Our main result is a point-cloud interpolation formula that provides a near-optimal degree of approximation to the target objective function on the unknown manifold.