It depends.
A ssd does not get hot, and is relatively light so tape will work.
A hard drive, particularly a 3.5" hard drive is quite heavy.
It also gets hot and needs some ventilation.
If you can secure the drive with a couple of screws to the bottom of the case you should be ok.
If you absolutely know the case will not be moved or jostled, you could even just lay the drive on the bottom.