Web Directory Mapping

Is there a program or something that you can use to map the directories and contents of a website from the client side other than when they leave out the index…. or by looking at robots.txt?

Other than trying to brute-force directory paths, and then filenames in valid directories, I know of no other way. I'm sure someone out there has written a program to do it, though.

Edit: Oh, and the .htaccess file on Apache servers contains file permissions, also, I believe. That might help…

there's webspiders or whatever-they're-called's here on HBH, go to the download section.

NOTE: these do not work on some sites, so don't make it a habit of relying on them. They won't work, as far as I know, here on HBH challenges.

However, they could come in handy somewhere down the line, so why not get one? or two? :)

I think there's a pretty quick and easy firefox extension called Spiderzilla.

good idea :)

also, the extension "Hackbar" doesn't work with the new version of FF, do you know of anything similar for the new version?

Are you sure?

https://addons.mozilla.org/en-US/firefox/addon/3899

hackbar is sick… so is Fire Encrypter and webmasters tool bar

nvm, got it, I just downloaded the new version of FF and when I downloaded hackbar, for some reason it said that it like, wasn't compatible with the new version of FF. xD

Zephyr_Pure wrote: Edit: Oh, and the .htaccess file on Apache servers contains file permissions, also, I believe. That might help…

Last thing I checked, .htaccess files and such aren't accessible via a browser or something similar..

The_Cell wrote: Last thing I checked, .htaccess files and such aren't accessible via a browser or something similar..

I've seen them retrieved using Google hacking. Not sure how reliable that is, though. A properly secured site shouldn't give up the .htaccess so easily.

IntelliTamper maps out websites.

intellitamper sucks ass. ive got it, it cant even find common dirs like /admin, only ones that are hyperlinked to :/

Are you sure you know how to use it + the directories exist?

Worked for me when i tested it.

yup, a site i played about with a while ago, i knew it had a /admin dir, ran intellitamper on it and it found index.php. woooow clever intellitamper :|

cool program " intellitamper" never tried it before but

heres one that I like … NStealth

check it out.

Thanks everyone there a few good suggestions here I'll have to check out.

IntelliTamper worked great for me just now thx mate for the program :) I have a bunch of dir now ;)

i needed a spider once and got a "free" version of blackwidow. its very outdated so i don't know how it evolved but the version i have here suits most of the tasks that require such a thing.. plus it's very windows like. =)

i needed a spider once and got a "free" version of blackwidow. its very outdated so i don't know how it evolved but the version i have here suits most of the tasks that require such a thing.. plus it's very windows like. =)