Yes, it is Makrouh (disliked and harmful) to sleep between Fajr and sunrise and also between Asr and Maghrib.
Sleeping between Fajr and sunrise drives away Barakat and makes the income less, as we read in many Hadeeths.(النوم بين الفجر وطلوع الشمس يطرد الرزق)
Sleeping between Asr and Maghrib harms the mental and psychological health. The Hadeeth states: Who sleeps after Asr, should not blame but himself. (من نام بعد العصر فلا يلومن الا نفسه)