We did not have any data connectivity at the place we were staying. So, googling it was ruled out. Somehow I persuaded Rajveer, the driver of our hired Innova to explore it together. He agreed to take the narrow lanes through Jahazpur basti (like a slum- having small houses or huts of economically weaker sections of the society) to the Dargah (I later found it to be Dargah Gazi Sarkar Ra).
We passed by a bastion of the fortress. Picture.
We entered the door only to find a man lighting some Agarbattis on the mazar मज़ार (grave) of some departed soul buried there. We asked him if there was a way to the Fort. He said "you are already standing in one part of the fort and this is the Dargah". He then pointed to an abandoned water tank of the olden days.
"There is no path, but you can follow the fallen walls and stones and find your way up to the Fort", he replied. However, he cautioned us to be careful.