In this paper, we investigate a duality between Hermitian and almost Kähler structures on the tangent manifold TM induced by pairs of conjugate connections on its base, affine Riemannian manifold M. In the context of information geometry, the classical theory of statistical manifold (which we call S-geometry) prescribes a parametrized family of probability distributions with a Fisher-Rao metric g and, using the Amari-Chensov tensor, a family of dualistic, torsion-free connections ∇(α), known as α-connections on M. Here we prescribe an alternative geometric framework (which we call P-geometry or partially flat geometry) by treating such parametrization as affine coordinates with respect to a flat connection ∇, and considering its g-conjugate connection ∇⁎ which is curvature-free but generally carries torsion. Under P-geometry, the triplet (g,∇,∇⁎) on M leads to a pair of complex and almost Kähler structures on TM, in “mirror correspondence” to each other. Such complex-to-symplectic correspondence is reminiscent of mirror symmetry in string theory. We discuss the statistical meaning of mirror correspondence in terms of reference duality and representation duality in (various generalizations of) contrast/divergence functions characterizing proximity of probability distributions within a parametric statistical model.