The widespread use of smartphones and mobile data in the present-day society has exponentially led to the interaction with the physical world. The increase in the amount of image data in web and mobile applications makes image search slow and inaccurate. Landmark recognition, an image retrieval task, faces its challenges due to the uncommon structure it possesses, such as, buildings, cathedrals, castles or museums. These are shot from various angles which are often different from each other, for instance, the exterior and interior of a landmark. This paper makes use of a Convolutional Neural Networks (CNN) based efficient recognition system that serves in navigation, to organize photo collections, identify fake reports and unlabeled landmarks from historical data. It identifies landmarks correctly from a variety of images taken at different viewpoints as well as distances. An appropriate CNN architecture helps to provide the best solution for the currently selected dataset.