Electrochemical based discharge machining (ECDM) removes the material by utilizing the thermal heating of the sparks followed by the chemical action. The tool feed method in ECDM controls the geometrical accuracies since gravity assisted and constant tool feed results in tool contacts that further deteriorates the micro-hole geometry. Moreover, high number of thermal cracks are produced with these tool feed methods.The present study investigates the adaptive tool feed system that withdraws the tool in upward direction when its contact with the work material is observed. Adaptive tool feed results in minimum tool contact and enhances the geometrical accuracies of the micro-holes. Hole circularity error (HCE) is taken as the response parameters for investigating the geometrical accuracies. The microscopy images reported a significant improvement in the geometry of the micro-holes machined with adaptive tool feed when compared to other tool feed methods. An improvement of 43.7% in HCE is acquired with the application of adaptive tool feed at 40 V. Moreover, the effect of input parameters on geometrical characteristics in terms of HCE is also discussed. The present study successfully reports the geometrical improvement of micro-holes in ECDM.