It is good to be a scholar, and it is good to be a doctor. Society needs people do to all the different jobs, or else it wouldn't function. Ideally, it is good for you to do the job that you are most talented at and most committed to.
It is narrated that the Prophet (S) said: ‘Knowledge is of two categories:
knowledge of religions and knowledge of the physical body.’ So this narration celebrates and values both kinds of knowledge (religious and medical).
(Of course there are other important jobs and fields of study as well!)
As you know, there are many narrations from the Prophet (S) and Ahl al-Bayt (A) about various medical ailments, so it was clearly a subject that was important to them. So inshallah you are also following in their footsteps by being a doctor.