In recent years, space debris has become a threat for satellites operating in low Earth orbit. Even by applying mitigation guidelines, their number will still increase over the course of the century. As a consequence, active debris removal missions and on-orbit servicing missions have gained momentum at both academic and industrial level. The crucial step in both scenarios is the capability of navigating in the neighborhood of a target resident space object. This problem has been tackled many times in literature with varying level of cooperativeness of the target required. While several techniques are available when the target is cooperative or its shape is known, no approach is mature enough to deal with uncooperative and unknown targets. This paper proposes a hybrid method to tackle this issue called Coarse Model-Based Relative Navigation (CoMBiNa). The main idea of this algorithm is to split the mission into two phases. During the first phase, the algorithm constructs a coarse model of the target. In the second phase, this coarse model is used as a reference for a relative navigation technique, effectively shifting the focus toward state and inertia estimation. In addition, this paper proposes a strategy to leverage the structure of the selected navigation method to detect and reject outliers. To conclude, CoMBiNa is tested on a simulated environment to highlight its benefits and its shortcomings, while also assessing its applicability on a limited-resource single-board computer.