The use of VHHs (Variable domain of the Heavy-chain of the Heavy-chain-only antibodies) as disease-modifying biomolecules in neurodegenerative disorders holds promises including targeting of aggregation-sensitive proteins. Exploitation of their clinical values depends however on the capacity to deliver VHHs with optimal physico-chemical properties for their specific context of use. We described previously a VHH with high therapeutic potential in a family of neurodegenerative diseases called tauopathies. The activity of this promising parent VHH named Z70 relies on its binding within the central region of the Tau protein. Accordingly, we carried out random mutagenesis followed by yeast two-hybrid screening to obtain optimized variants. The VHHs selected from this initial screen targeted the same epitope as VHH Z70 as shown using nuclear magnetic resonance spectroscopy and had indeed improved binding affinities according to dissociation constant values obtained by surface plasmon resonance spectroscopy. The improved affinities can be partially rationalized based on three-dimensional structures and NMR data of three complexes consisting of an optimized VHH and a peptide containing the Tau epitope. Interestingly, the ability of the VHH variants to inhibit Tau aggregation and seeding could not be predicted from their affinity alone. We indeed showed that the in vitro and in cellulo VHH stabilities are other limiting key factors to their efficacy. Our results demonstrate that only a complete pipeline of experiments, here described, permits a rational selection of optimized VHH variants, resulting in the selection of VHH variants with higher affinities and/or acting against Tau seeding in cell models.