We consider the moduli space of vector bundles of rank n and degree ng over a fixed Riemann surface of genus g⩾2 with the explicit parametrization in terms of the Tyurin data. The ‘non-abelian’ theta divisor consists of bundles such that h1⩾1 . On the complement of this divisor we construct a non-abelian (i.e. matrix) Cauchy kernel explicitly in terms of the Tyurin data. With the additional datum of a non-special divisor, we can construct a reference flat holomorphic connection which also depends holomorphically on the moduli of the bundle. This allows us to identify the bundle of Higgs fields, i.e. the cotangent bundle of the moduli space, with the affine bundle of holomorphic connections and provide a monodromy map into the GLn character variety. We show that the Goldman symplectic structure on the character variety pulls back along this map to the complex canonical symplectic structure on the cotangent bundle and hence also on the space of connections. The pull-back of the Liouville one-form to the affine bundle of connections is then shown to be a logarithmic form with poles along the non-abelian theta divisor and residue given by h 1.