The frequency spectra and polarization states of terahertz waves can convey significant information about physical interactions and material properties. Compact and miniaturized on-chip platforms for effective capturing of these quantities are being extensively investigated because of their promising potential for paramount applications of terahertz technology such as in situ sensing and characterization. Here, we present a metamaterial-graphene hybrid device that integrates the functions of photodetection, wavelength, and polarization selectivity into a monolithic architecture. Leveraging the ultrahigh design freedom of metamaterial optical properties and the electronically controllable hot-carrier-assisted photothermoelectric effect in graphene, our detector shows resonantly enhanced photoresponse at two specific target wavelengths with orthogonal polarizations. We demonstrate its versatile capabilities for spectrally selective and polarization resolved imaging on a single-chip platform that is free from advanced optical components. Our strategy is beneficial to the future development of multifunctional, compact, and low-cost terahertz sensors.