Software Listing: Web Crawler

	Files Crawler | License: Freeware |
	Files Crawler is a file search application. It lets you search tons of files and download music, videos, images, documents and software. Files Crawler is actually performing its search at Google. As Google allows us to search for more than just Web pages, due to its special indexing method of directory listing. Directory listing of Websites, is actually what allows Google to see all sort of files usually hidden from us. Files Crawler tweaks the search results using advanced operators, and the final results are downloadable music video software and many other files. Files Crawler allows you to add your own search tweaks. Publisher: SpeedApps Inc| Date: 17-12-2007 | Size: 745 KB
	-

	Visual Web Spider | License: Shareware |
	Visual Web Spider is a software for collecting relevant websites on the Internet. It is a website crawler, fully automated, multithreaded web robot. It helps you to populate your database of websites,or find relevant information for research purposes. Our program allows you to extract URLs and metadata (title, keywords, description) matching your keywords from more then 7 billions web pages, directories and search engines. Visual Web Spider supports multithreading implementation and allows for up to 50 simultaneous crawling threads.. Publisher: Newprosoft.com| Date: 10-09-2005 | Size: 487 KB
	-

	LAN Crawler | License: Shareware |
	Helps you maintain a list of files and locations in the network. You can use this tool in combination with a diff utility in order to determine changes in file availability on your network.. Publisher: idevtm.com| Date: 15-01-2002 | Size: 707 KB
	-

	GluedOn | License: Shareware |
	GluedOn keeps your computer on the Internet by simulating activity. This keeps your dial-up ISP from terminating your connection due to inactivity. GluedOn is a crawler, and includes many options. Proxy server support is included. GluedOn can be minimized to the system tray for easy access. Full documentation is included. GluedOn is adware supported, so it is 100% free! Get your money's worth from your ISP! FREE!. Publisher: RoadSide Software, LLC| Date: 29-05-2003 | Size: 883 KB
	-

	ADP | License: Shareware |
	Astanda Directory Project [ADP] is a directory, search engine, and spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by Smarty template engine, ADP can run in both dynamic and static modes. Proper full text boolean search with keyword relevance can chew on gigabytes of data. Astanda.com runs the latest ADP version with default ADP template. Feel free to test out the features, add some links, and post a message in the forum if you find any bugs or have any suggestions. Publisher: Astanda.com| Date: 16-12-2006 | Size: 181 KB
	-

	Crawler Smileys | License: Freeware |
	Express Your Thoughts & Emotions - Crawler Smileys makes expressing yourself more fun! Insert smileys directly into your messages with a single click. Enjoy over 2,500 wonderfully animated smileys. Access a collection of over 4,600 eCards. Extremely easy to use. Works with AIM, MSN Messenger, Yahoo!® Messenger, ICQ, Google Talk and most webmail services. When words just aren't enough. Browse our huge gallery of smileys and pick the one that best expresses your thought or emotion. Our gallery includes the most popular smiley categories: Love, Holidays, Classic, Emotions, Seasons, Animals, Sports & more. Publisher: CRAWLER, LLC| Date: 21-12-2007 | Size: 2653 KB
	-

	Crawler Parental Control | License: Freeware |
	Crawler Parental Control Free for home and office use, Crawler Parental Control monitors and controls user activity on your computer. Easy to use and intuitive, the program lets you control Web browsing, set access rights to software, hide folder content, schedule time limits and much more. It optionally comes with free 100% safe Crawler Toolbar that offers a unique combination of search results from Google, Yahoo! and MSN. Crawler Toolbar features integrated Web Security Guard alerts to help prevent you from entering potentially dangerous websites that may cause adware, viruses, spyware or spam infections. Publisher: CRAWLER, LLC| Date: 13-04-2007 | Size: 7560 KB
	-

	Web Security Guard | License: Freeware |
	Web Security Guard alerts help prevent you from entering potentially dangerous websites that may cause adware, viruses, spyware or spam infection. Available for free for home and office use, it uses a proprietary system to classify websites ranging from safe to dangerous and draws upon a growing database of website ratings. Web Security Guard comes with Crawler Toolbar that offers a unique combination of search results from Google, Yahoo! and MSN with a single click. Crawler Toolbar is 100% safe, contains no malicious software and does not facilitate pop-up ads. Additionally, Crawler Toolbar offers many functions such as spyware & adware protection, popup blocker, download manager, Radio & MP3 player, RSS reader, email notifier and much more. Publisher: CRAWLER, LLC| Date: 18-04-2007 | Size: 5696 KB
	-

	Crawler 3D Fireplace Screensaver | License: Freeware |
	You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Replace your plain cursor with an animated cursor from our huge gallery! Beautify your desktop with incredible wallpapers from our huge gallery covering popular subjects for everyone. Customize buttons to access frequently used programs, like Word, Excel, or Crawler features, like popup blocker, skins and games. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 5287 KB
	-

	Crawler 3D Tropical Aquarium Screensaver | License: Freeware |
	Download this amazing 3D screensaver and liven up your desktop with our brand new 3D tropical aquarium full of colorful moving coral fishes allowing you to feed them and knock at the glass to make them move! Download and add new fishes & backgrounds from our huge gallery! You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Replace your plain cursor with an animated cursor from our huge gallery! Beautify your desktop with incredible wallpapers from our huge gallery covering popular subjects for everyone. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 5983 KB
	-

	Keyword Crawler | License: Freeware |
	Online website keyword tools: explore your website as searchengine. Count and display broken and internals links. Get Google pagerank for each file and generate a SiteMaps file in XML format. Keyword Crawler could also calculate word density in pages and display the metas.. Publisher: webkeysoft| Date: 15-08-2005 | Size: 399 KB
	-

	Sekhol Finder | License: Shareware |
	A search engine reports that many thousands of pages contain the keywords you just entered. That is fine, but the first returned pages are just better advertised and probably not of big interest. Especially if you are looking for the best sources of information. On the other hand, it is hardly possible to check by clicking and viewing the reported thousands. The search engine will not allow you go too far, usually further then first 1000 , anyway. As a result, the most precious information remains hidden and not accessible. Sekhol Finder is designed to solve this problem. It combines web crawler functionality with advanced keywords text search and logical analysis of a document layout. Publisher: Sekhol Technologies| Date: 25-05-2004 | Size: 2200 KB
	-

	Crawler 3D Earth Screensaver | License: Freeware |
	Download FREE 3D Earth screensaver and take a journey around the planet Earth! Real cloud animation allows you to watch storms and hurricanes. Receive weather forecasts, explore foreign countries, zoom in and out and rotate the globe. 3D Earth presents real Moon & Sun positions and includes International Space Station! You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 9102 KB
	-

	Sitemap Writer | License: Freeware |
	Sitemap Writer is a light version of Sitemap Writer Pro. This is a handy tool that helps you to create and edit sitemaps for your websites. Sitemap Writer is an XML editor for sitemap files Features and Benefits: 1) Easy to use - just enter your URLs (you don't even need to know the XML syntax); 2) Full conformity of generated XML file with the sitemap protocol http://www.sitemapwriter.com/faq.php (tested for Google, Yahoo!, Ask.com and Moreover.com); 3) Generated sitemaps version 0.90; 4) HTML site map export; 5) Import and export URL list (in *.txt format); 6) Merging different sitemaps; 7) Auto checking of duplicate URLs; 8) URL parameters changing with right click (fast edit); 9) URL copy, paste and duplicate; 10) URL Find/Replace; 11) Search engines notification (submit sitemap directly to Google, Yahoo!, Ask. Publisher: Emergency Soft| Date: 12-08-2007 | Size: 517 KB
	-

	Sitemap Writer Pro | License: Shareware |
	Professional XML sitemap generator program will help you easily create XML sitemaps. Sitemap Writer Pro includes built in site crawler for adding URLs into the XML sitemap, FTP manager, search engine notification tool (Yahoo!, Google, Ask.com, MSN (Live.com) and Moreover.com), Sitemap index file editor, HTML site map export tool and Google CodeSearch sitemap export tool. Sitemap Writer Pro can convert HTML sitemaps and RSS 2.0 feeds to XML sitemap. Features and Benefits: 1) Easy to use - just use Crawler or enter your URLs, you don't even need to know XML syntax; 2) Integrated multithread Crawler that will crawl your site and add all your URLs into XML sitemap file (you can add your own extensions or exclusions); 3) Full conformity of generated XML file with XML sitemap protocol (tested for Google, Yahoo!, Ask. Publisher: Emergency Soft| Date: 02-24-2008 | Size: 732 KB
	-

	EmailGrabber | License: Shareware |
	Automatically search web sites for emails. Simply provide a starting web site or starting keywords and let emailgrabber do the rest. Emailgrabber will crawl the web site and collect all email addresses it finds. It will also follow every link. Specify the web sites you want to visit to allow emailgrabber to stay on top of your goal or block web sites you don't want it to visit. Merge email addresses from multiple source files, removing duplicates. Export email addresses gathered using the most suitable delimiter. Save your search session so you can resume it later. Free Lifetime Updates - when you buy emailgrabber you not only get the latest version, but every update we release, whether it is an update for the version you own or a future version. Publisher: EmailGrabber| Date: 30-04-2007 | Size: 2054 KB
	-

	BrowserObject .NET Control Free Edition | License: Freeware |
	BrowserObject is a server component detecting Web Browser capabilities such as supported technologies and version that is running on the clients. It performs browser detection to retrieve Web Browser name, version, JavaScript, Plug ins, screen resolution, IP address, cookies, language, client time and many more in real time in the Web server. The detection features of BrowserObject .NET Control Free Edition are Session Cache, Browser Name, Search Engine Crawler, Email Crawler, Alpha Version, Beta Version, Background Sound, Authenticode Update, Character Height Available, Character Width Available, Banned User Agent, Netscape Gold, Syndication Reader, Mouse Over, CDF Supported, PNG Supported, Font Size Supported, IP Address, URL Referrer, Win16, Win32, Win64, Gecko ActiveX Supported. Publisher: BrowserObject.com| Date: 1-70-2008 | Size: 2001 KB
	-

	Auto Web Browser | License: Freeware |
	Auto Web Browser saves a lot of time when you are looking for something on the Internet. No need for numerous clicking, waiting for pages download and closing annoying pop-ups. Just enter the words describing what you want to find. The Auto Web Browser will consult the search engines from a user defined list, download the pages to your computer, filter and analyze them and then it will automatically surf further, downloading other potentially interesting pages using the links from the meaningful part of the relevant documents. Web crawling reveals many interesting pages, that cannot be found easily if you use search engines only. Publisher: Sekhol Technologies| Date: 28-10-2004 | Size: 2500 KB
	-

	Web Snatch Internet Picture Ripper | License: Shareware |
	This picture ripper can download and save thousands of pictures from the Internet in a very short time. Don't click all those thumbnails ever again! Works better than other picture hunter spider programs because you can watch a slide show while downloading images from thumbnail gallery post web sites. This web crawler lets you save favorite pictures and view a slide show of them later. Use this downloader as a web browser companion to Windows IE because Web Snatch automatically grabs the current web page URL your viewing and gets it ready for you! This picture finder program uses T-Sort Technology to automatically capture images from the net. Publisher: Wolfgang Software| Date: 28-06-2005 | Size: 2265 KB
	-

	A Web Picture Snatch Internet Ripper | License: Shareware |
	This picture ripper can download and save thousands of pictures from the Internet in a very short time. Don't click all those thumbnails ever again! Works better than other picture hunter spider programs because you can watch a slide show while downloading images from thumbnail gallery post web sites. This web crawler lets you save favorite pictures and view a slide show of them later. Use this downloader as a web browser companion to Windows IE because Web Snatch automatically grabs the current web page URL your viewing and gets it ready for you! This picture finder program uses T-Sort Technology to automatically capture images from the net. Publisher: Wolfgang Software| Date: 15-04-2005 | Size: 1789 KB
	-

	Fax Spider | License: Shareware |
	Harvest fax numbers from the net using this Fax Spider, which finds fax numbers that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of fax numbers an hour, which makes scanning for vulnerabilities easy! Built-in search engine that harvests "Starting Pages" from Google and Yahoo to find highly targeted fax numbers! Displays State and City information about each fax number found. Fully automated fax and website harvesting! Scans up to 10 webpages simultaneously! Closes non-responsive web connections after 10 seconds and moves on to the next website! Closes extremely slow connections after 30 seconds and moves on to the next website! Database integration for easy sorting, exporting, and protecting your data! Automatically prevents collection of duplicate fax numbers! In-program exporting of fax numbers to three different list formats! Automated searching lets you enter multiple search terms and automatically skip to the next search after a specified number of websites have been scanned! Displays statistics of all pages scanned, websites found, and fax numbers found! Preview windows display the next 20 websites queued for scanning, and the last 20 fax numbers found! Stop and Resume scanning with the click of a button, you can even resume after shutting down the program! Does not Contain any Adware, Spyware, or other Third Party Software. Publisher: Rebrand Software, LLC| Date: 22-07-2004 | Size: 3495 KB
	-

	Email Spider | License: Shareware |
	Harvest email addresses from the net using this Email Spider, which finds email addresses that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of email addresses an hour, which makes scanning for vulnerabilities simple! Defeats "email protection" scripts that attempt to hide email addresses from email spiders! The only spider software with a built-in search engine that harvests "Starting Pages" from Google and Yahoo to find highly targeted email addresses! Fully automated email and website harvesting, scan your website for vulnerabilities in just seconds! Scans up to 10 webpages simultaneously! Closes non-responsive web connections after 10 seconds and moves on to the next website! Closes extremely slow connections after 30 seconds and moves on to the next website! Database integration for easy sorting, exporting, and protecting your data! Automatically prevents collection of duplicate emails In-program exporting of email addresses to three different email list formats! Automated searching lets you enter multiple search terms and automatically skip to the next search after a specified number of websites have been scanned! Displays statistics of all pages scanned, websites found, and emails found! Preview windows display the next 20 websites queued for scanning, and the last 20 emails found! Stop and Resume scanning with the click of a button, you can even resume after shutting down the program! Can play sounds whenever an email is found, whenever skipping to the next search, and when scanning is complete. Publisher: Rebrand Software, LLC| Date: 22-07-2004 | Size: 3453 KB
	-

	Badger Browser | License: Freeware |
	The Badger Browser is a image/video search tool, which give you a safer and faster way to search for multimedia on the web. It's features include:a web image search tool, web video search, web site image crawler, popup window blocker, hands free slideshow image viewing, and a download accelerator.. Publisher: Zacado Enterprises| Date: 10-12-2002 | Size: 488 KB
	-

	EScrambler - Webmaster Antispam Utility | License: Freeware |
	Email address code scrambler. Fight spam. Your spam problem comes from spam crawler robots. They crawl your site to add your email addresses their spam lists. Make your email addresses invisible to spam crawlers. Hide your mail addresses from robots in plain sight. Visitors to your web pages can read and click on your email addresses the same way they do now. Robots will not find them. Stay off spam lists. Search engine friendly. Easy to use.. Publisher: InnerPeace.Org| Date: 04-10-2002 | Size: 9 KB
	-

	Xtreeme Search Engine Studio | License: Demo |
	Creating a search engine for your web site does not have to be difficult! Search Engine Studio automatically indexes your web site (with a HTTP crawler, an FTP / local disk scanner, or using an XML file) and then creates a professional, ultra fast search engine for your website (as a binary CGI script or PHP script) or an offline search for CD-ROM / DVD distributions. No installation on server required thanks to a built-in highly optimized database engine! The difference between Search Engine Studio and other search engine generators is that it uses its own highly optimized database engine so there is absolutely no installation required on the server. Publisher: Xtreeme GmbH| Date: 16-03-2006 | Size: 5182 KB
	-

	GSA Clip Spider | License: Shareware |
	With this program you can download all the movie clips from a webserver automatically (with or without sublinks). It's very easy to use and gives you amazing results within seconds. This download manager for movies searches all your favorit web links, spiders, parses, grabs, extracts and crawls all the movies you would have downloaded by hand.. Publisher: GSA| Date: 27-05-2008 | Size: 3633 KB
	-

	Newz Crawler | License: Shareware |
	NewzCrawler is a web news reader & browser which provides access to a news content from various sources: Syndicated news given in XML-based formats (RSS, ATOM, RDF, BackSlash, ScriptingNews etc.); Usenet (NNTP) newsgroups; Web pages (HTML). NewzCrawler gathers news content from each source channel and displays it in a number of views: News List, News Balloon and News Ticker. NewzCrawler's user interface is similar to an ordinary MS Outlook Express-like user interface. It supports many back-end headline syndication file formats and embeds web browser for extra fast news surfing.. Publisher: ADC Software| Date: 05-09-2004 | Size: 1407 KB
	-

	InSearch | License: Shareware |
	This is advanced internet search tool. That help you find exact what you need. Use internet engines Google,Yahoo,Yandex and many other for find links, after that go to all links and correct all finded information. Many times you try to find somthing and just sink in porno links. If you try to find somthing, try use this tool it's easy and very fast. You can use unregistred version for 30 days trial period, after this time you must register this product or uninstall it from your system. Please visit product page for vew added features.. Publisher: Saturn7| Date: 12-06-2005 | Size: 574 KB
	-

	Guest book Crawler | License: Shareware |
	There are millions of guest books at the web! Imagine, that only a little part of them have your link. The software enables you to post to many guest books. You are searching in search engines for guest books and the software is submitting the link. You must care for the submission of every link, if you do it manually. You can set the software to auto pilot. You start it and wait how many links the software submits. Do it smooth! The software has a database, which collects your submission. It will not submit within one month your text again to a website. You are not a spammer! Google and other search engines rank your website according to link popularity. Publisher: Julia Oswald| Date: 17-11-2004 | Size: 396 KB
	-

	Web Link Extractor | License: Shareware |
	Web Link Extractor is a powerful link extractor utility. It extracts Link Text and Link URL from the web pages you specify. And put the result into a Text/CSV file that you can open with NotePad or Excel. Key Features: * Easy fuzzy matching for URL You may use URL fuzzy matching, for example: http: //www.yahoo.com/groups/*/member/*.htm * Filters for Link URL or Link Text You may specify the min length of link text You may specify the keywords that the link URL must include or exclude You may specify the keywords that the link text must include or exclude * Support Next Pages It may craw the pages with Next Page link one by one until the last page * Output Link URL or Link Text The output data could be link URL,link text or both of them. Publisher: Web Data Miner| Date: 29-08-2006 | Size: 724 KB
	-

Page: 1 | 2 |