Web site "crawl" - GM Forum - Buick, Cadillac, Chev, Olds, GMC & Pontiac chat


Lounge For casual talk about things unrelated to General Motors. In other words, off-topic stuff. And anything else that does not fit Section Description.

Reply
 
 
 
Thread Tools Search this Thread
Old 01-01-2007, 08:57 PM   #1
Junior Member
Thread Starter
 
Join Date: Mar 2003
Location: Purgatory
Posts: 0
Thanks: 0
Thanked 0 Times in 0 Posts
vital49 is on a distinguished road
Default Web site "crawl"

I'm trying to find the "hidden" pages behind a webpage, that appears to be blank, but resolves to a blank page. I have a suspicion the site is being used, but not the main index page. Does anyone know of a way to "crawl" the site? A true site crawl only reveals links to other pages within the domain name. I don't think there are links on this site...only standalone HTML pages from the URL. Anyone know how to find these pages?
vital49 is offline   Reply With Quote
Old 01-02-2007, 09:35 PM   #2
Junior Member
Thread Starter
 
Join Date: Mar 2003
Location: Purgatory
Posts: 0
Thanks: 0
Thanked 0 Times in 0 Posts
vital49 is on a distinguished road
Default

Anyone? I really want to accomplish this!
vital49 is offline   Reply With Quote
Old 01-02-2007, 10:24 PM   #3
Senior Member
True Car Nut
 
Join Date: Jan 2006
Location: NEBF:06,07 | NYBF:06,07 | ONBF:06,07 | CNBF:06 & more............
Posts: 8,029
Thanks: 0
Thanked 0 Times in 0 Posts
bandit is on a distinguished road
Default

This is one link i found

http://monkey.org/~provos/crawl/

looking for more...
bandit is offline   Reply With Quote
Old 01-02-2007, 10:29 PM   #4
Junior Member
 
Join Date: Aug 2005
Posts: 0
Thanks: 0
Thanked 0 Times in 0 Posts
wjcollier07 is on a distinguished road
Default

i do know frontpage has a feature where you can download an entire website..but umm, i'm not sure if thats kinda what you mean...it downloads every page from the root.
wjcollier07 is offline   Reply With Quote
Old 01-03-2007, 06:01 AM   #5
Senior Member
Posts like a Camaro
 
Join Date: Jan 2006
Location: Riverside, CA
Posts: 1,137
Thanks: 0
Thanked 0 Times in 0 Posts
chr0mius is on a distinguished road
Default

wget on linux :P
chr0mius is offline   Reply With Quote
 
 
Reply

Related Topics
Thread Thread Starter Forum Replies Last Post
Buick created a Web site before there was even a Web SignOfZeta General GM Chat 5 03-25-2012 02:45 PM
Web site and video PontiacDad Lounge 2 08-24-2003 03:49 PM
I'm building a web site THOFFMANN General GM Chat 10 02-18-2003 06:16 PM
To lazy to crawl under the car, & it's cold out, so tell brminder Performance, Brainstorming & Tuning 3 02-13-2003 10:18 PM


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -4. The time now is 02:52 AM.


We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.