One thing has nothing to do with the other, If you are deficient in your main hormone as a male and you are simply replacing that deficiency you should not discontinue your therapy because of a perceived cosmetic benefit ( Which I do not think is true, putting you body in a stressed low T status could definitely be more detrimental to your health and hair).
Getting dialed in on TRT is hard enough for a lot of people and if you happen to do so and got symptom resolution I think you should count yourself lucky and not mess with your hormonal system any further.
What is you Free T, SHBG and E2?