I will donate all my FRIH$ to anyone who performs just a simple task for me..
The task is..
Find me a software, program or anything that can browse websites and search even the pages that have not been given in the sitemap, links corner.. more better known as hidden pages.. i hope u understand..
ALL MY FRIH$ FOR THE PERSON WHO DOES THIS TASK!!!!
Well you can do it in theory by just trying random file names starting with a.html... b.html ...aa.html ... ab.html etc etc
However, this would
1.) Take years (literally)
2.) Probably get your IP banned very quickly as it would look like a DDOS attack.
Also, you have to wonder why you would need to do this. The whole point is that you can't find it!
This isn't really possible unless you know the directory structure of the site. I know that with programs you can see all of the links on a page and that might give you a clue to the directory structure, but other than that I can't think of any program that would actually dig through the site and show you the directory structure of the site. Note: you can definitely get the directory structure of the site by means that are not legal.
Any idea how to get the directory structure of the Site.. legal or illegal... if you do then please do tell me...
Hey, I didn't mean to discourage you. Don't give up. There may be a way to do this that I am not aware of. Something just came to mind now, you might try searching for something like a "crawler". Google "crawls" the internet every now and then to update their cache and add results to their searches. Maybe there is software that will do the same thing for a single website and present you with the directory structure. So for the time being try googling "site crawler" (or something of the same sort). Report back if you find anything that helps.
ANY idea how to get the directory structure LEGALLY!!
Crawlers work by following links, therefore they will not be any use to you here.
thanks a lot.. will google for a crawler.. will post if i find anythin useful.!!