Fast, high-fidelity, and quantum nondemolition (QND) qubit readout is an essential element of quantum information processing. For superconducting qubits, state-of-the-art readout is based on a dispersive cross-Kerr coupling between a qubit and its readout resonator. The resulting readout can be high fidelity and QND, but readout times are currently limited to the order of 50 nanoseconds due to the dispersive cross-Kerr of magnitude 10 megahertz. Here, we present a readout scheme that uses the quarton coupler to facilitate a large (greater than 200 megahertz) cross-Kerr between a transmon qubit and its readout resonator. Full master equation simulations of the coupled system show a 5-nanosecond readout time with greater than 99% readout fidelity and greater than 99.9% QND fidelity. The quartonic readout circuit is experimentally feasible and preserves the coherence properties of the qubit. Our work reveals a path for order of magnitude improvements of superconducting qubit readout by engineering nonlinear light-matter couplings in parameter regimes unreachable by existing designs.