Is there a way I can hide the album if there is no image present inside it ?

manual unpublish is the way but I have a huge gallery and was thinking if thres is any way I can not dispaly if there is no image.

You can code it via the object model checking if there are images or albums in it and then unpublishing it. That should happen before the loop though as you otherwise confuse the pagination etc. Need to go through all albums of course which might be overload.