There are lots of man made cave structures in Bamiyan both immediately around the Buddhas and in other parts of the province.
Photo essay: Nowruz trip to Bamiyan, Afghanistan