This paper presents a finite element model of a railway crossing panel for use in multibody simulations (MBS). It is a two-layer track model with rails and sleepers represented by beam elements that use linear bushings for rail fastenings and non-linear bushings for ballast. The model is calibrated and validated to measurement data from a comprehensively instrumented switch and crossing demonstrator installed in the Austrian railway network as a part of the European research programme Shift2Rail. The validation concerns the capability of the model to capture the structural response of the crossing panel under traffic loading after calibration of physical track parameters to realistic values. The structural response is measured in the form of displacements, strains, and sleeper-ballast contact forces. It is shown that the developed model can represent the measured track responses well and that it was necessary to account for a varying sleeper-ballast gap distribution along the crossing transition sleeper to obtain good agreement. The calibration uses Latin hypercube samples to explore the parameter space in a sensitivity analysis before a parameter optimisation is performed using a gradient-based method on a response surface built from a polyharmonic spline.