Software Listing: Website Crawler

	Visual Web Spider | License: Shareware |
	Visual Web Spider is a software for collecting relevant websites on the Internet. It is a website crawler, fully automated, multithreaded web robot. It helps you to populate your database of websites,or find relevant information for research purposes. Our program allows you to extract URLs and metadata (title, keywords, description) matching your keywords from more then 7 billions web pages, directories and search engines. Visual Web Spider supports multithreading implementation and allows for up to 50 simultaneous crawling threads.. Publisher: Newprosoft.com| Date: 10-09-2005 | Size: 487 KB
	-

	Files Crawler | License: Freeware |
	Files Crawler is a file search application. It lets you search tons of files and download music, videos, images, documents and software. Files Crawler is actually performing its search at Google. As Google allows us to search for more than just Web pages, due to its special indexing method of directory listing. Directory listing of Websites, is actually what allows Google to see all sort of files usually hidden from us. Files Crawler tweaks the search results using advanced operators, and the final results are downloadable music video software and many other files. Files Crawler allows you to add your own search tweaks. Publisher: SpeedApps Inc| Date: 17-12-2007 | Size: 745 KB
	-

	Keyword Crawler | License: Freeware |
	Online website keyword tools: explore your website as searchengine. Count and display broken and internals links. Get Google pagerank for each file and generate a SiteMaps file in XML format. Keyword Crawler could also calculate word density in pages and display the metas.. Publisher: webkeysoft| Date: 15-08-2005 | Size: 399 KB
	-

	Web Security Guard | License: Freeware |
	Web Security Guard alerts help prevent you from entering potentially dangerous websites that may cause adware, viruses, spyware or spam infection. Available for free for home and office use, it uses a proprietary system to classify websites ranging from safe to dangerous and draws upon a growing database of website ratings. Web Security Guard comes with Crawler Toolbar that offers a unique combination of search results from Google, Yahoo! and MSN with a single click. Crawler Toolbar is 100% safe, contains no malicious software and does not facilitate pop-up ads. Additionally, Crawler Toolbar offers many functions such as spyware & adware protection, popup blocker, download manager, Radio & MP3 player, RSS reader, email notifier and much more. Publisher: CRAWLER, LLC| Date: 18-04-2007 | Size: 5696 KB
	-

	LAN Crawler | License: Shareware |
	Helps you maintain a list of files and locations in the network. You can use this tool in combination with a diff utility in order to determine changes in file availability on your network.. Publisher: idevtm.com| Date: 15-01-2002 | Size: 707 KB
	-

	GluedOn | License: Shareware |
	GluedOn keeps your computer on the Internet by simulating activity. This keeps your dial-up ISP from terminating your connection due to inactivity. GluedOn is a crawler, and includes many options. Proxy server support is included. GluedOn can be minimized to the system tray for easy access. Full documentation is included. GluedOn is adware supported, so it is 100% free! Get your money's worth from your ISP! FREE!. Publisher: RoadSide Software, LLC| Date: 29-05-2003 | Size: 883 KB
	-

	ADP | License: Shareware |
	Astanda Directory Project [ADP] is a directory, search engine, and spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by Smarty template engine, ADP can run in both dynamic and static modes. Proper full text boolean search with keyword relevance can chew on gigabytes of data. Astanda.com runs the latest ADP version with default ADP template. Feel free to test out the features, add some links, and post a message in the forum if you find any bugs or have any suggestions. Publisher: Astanda.com| Date: 16-12-2006 | Size: 181 KB
	-

	Email Spider | License: Shareware |
	Harvest email addresses from the net using this Email Spider, which finds email addresses that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of email addresses an hour, which makes scanning for vulnerabilities simple! Defeats "email protection" scripts that attempt to hide email addresses from email spiders! The only spider software with a built-in search engine that harvests "Starting Pages" from Google and Yahoo to find highly targeted email addresses! Fully automated email and website harvesting, scan your website for vulnerabilities in just seconds! Scans up to 10 webpages simultaneously! Closes non-responsive web connections after 10 seconds and moves on to the next website! Closes extremely slow connections after 30 seconds and moves on to the next website! Database integration for easy sorting, exporting, and protecting your data! Automatically prevents collection of duplicate emails In-program exporting of email addresses to three different email list formats! Automated searching lets you enter multiple search terms and automatically skip to the next search after a specified number of websites have been scanned! Displays statistics of all pages scanned, websites found, and emails found! Preview windows display the next 20 websites queued for scanning, and the last 20 emails found! Stop and Resume scanning with the click of a button, you can even resume after shutting down the program! Can play sounds whenever an email is found, whenever skipping to the next search, and when scanning is complete. Publisher: Rebrand Software, LLC| Date: 22-07-2004 | Size: 3453 KB
	-

	Fax Spider | License: Shareware |
	Harvest fax numbers from the net using this Fax Spider, which finds fax numbers that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of fax numbers an hour, which makes scanning for vulnerabilities easy! Built-in search engine that harvests "Starting Pages" from Google and Yahoo to find highly targeted fax numbers! Displays State and City information about each fax number found. Fully automated fax and website harvesting! Scans up to 10 webpages simultaneously! Closes non-responsive web connections after 10 seconds and moves on to the next website! Closes extremely slow connections after 30 seconds and moves on to the next website! Database integration for easy sorting, exporting, and protecting your data! Automatically prevents collection of duplicate fax numbers! In-program exporting of fax numbers to three different list formats! Automated searching lets you enter multiple search terms and automatically skip to the next search after a specified number of websites have been scanned! Displays statistics of all pages scanned, websites found, and fax numbers found! Preview windows display the next 20 websites queued for scanning, and the last 20 fax numbers found! Stop and Resume scanning with the click of a button, you can even resume after shutting down the program! Does not Contain any Adware, Spyware, or other Third Party Software. Publisher: Rebrand Software, LLC| Date: 22-07-2004 | Size: 3495 KB
	-

	Guest book Crawler | License: Shareware |
	There are millions of guest books at the web! Imagine, that only a little part of them have your link. The software enables you to post to many guest books. You are searching in search engines for guest books and the software is submitting the link. You must care for the submission of every link, if you do it manually. You can set the software to auto pilot. You start it and wait how many links the software submits. Do it smooth! The software has a database, which collects your submission. It will not submit within one month your text again to a website. You are not a spammer! Google and other search engines rank your website according to link popularity. Publisher: Julia Oswald| Date: 17-11-2004 | Size: 396 KB
	-

	Crawler Smileys | License: Freeware |
	Express Your Thoughts & Emotions - Crawler Smileys makes expressing yourself more fun! Insert smileys directly into your messages with a single click. Enjoy over 2,500 wonderfully animated smileys. Access a collection of over 4,600 eCards. Extremely easy to use. Works with AIM, MSN Messenger, Yahoo!® Messenger, ICQ, Google Talk and most webmail services. When words just aren't enough. Browse our huge gallery of smileys and pick the one that best expresses your thought or emotion. Our gallery includes the most popular smiley categories: Love, Holidays, Classic, Emotions, Seasons, Animals, Sports & more. Publisher: CRAWLER, LLC| Date: 21-12-2007 | Size: 2653 KB
	-

	Crawler Parental Control | License: Freeware |
	Crawler Parental Control Free for home and office use, Crawler Parental Control monitors and controls user activity on your computer. Easy to use and intuitive, the program lets you control Web browsing, set access rights to software, hide folder content, schedule time limits and much more. It optionally comes with free 100% safe Crawler Toolbar that offers a unique combination of search results from Google, Yahoo! and MSN. Crawler Toolbar features integrated Web Security Guard alerts to help prevent you from entering potentially dangerous websites that may cause adware, viruses, spyware or spam infections. Publisher: CRAWLER, LLC| Date: 13-04-2007 | Size: 7560 KB
	-

	Zoom Search Engine | License: Shareware |
	Zoom is a package for web developers to add an industrial-strength custom search engine to their website in a matter of minutes. No complicated server-side setup procedures, just index and upload from the convenience of your own Windows computer. Features include: "Google-like" context descriptions, wildcard and exact phrase searching, spider & offline indexing, statistic reports, sort by date options, spelling suggestions, DOC/PDF/XLS/PPT files, and more. Visit our website for a full list of features. Available for PHP, ASP, or JavaScript platforms. A free edition is available for smaller websites and a professional version available for larger websites. Publisher: WrenSoft| Date: 10-03-2005 | Size: 1453 KB
	-

	Stealth SEO | License: Shareware |
	To get traffic you need to get a top ranking with the search engines. Being listed outside of the top 20 doesn't get you much traffic at all, if any. Have you tried many different ways to get all of your sites listed at the top of search engines and you still don't even show up at all. Well, I have a solution for you. Make sure you bookmark this site right now! Once you take a look around for the best SEO software, I am sure will will come back to place an order. This SEO software is the 1st of its kind. Search engine optimization (SEO) is not as easy as it seems. Search engines change the way that they rank websites all of the time. Publisher: Bessling Company| Date: 28-02-2005 | Size: 539 KB
	-

	Crawler 3D Fireplace Screensaver | License: Freeware |
	You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Replace your plain cursor with an animated cursor from our huge gallery! Beautify your desktop with incredible wallpapers from our huge gallery covering popular subjects for everyone. Customize buttons to access frequently used programs, like Word, Excel, or Crawler features, like popup blocker, skins and games. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 5287 KB
	-

	Crawler 3D Tropical Aquarium Screensaver | License: Freeware |
	Download this amazing 3D screensaver and liven up your desktop with our brand new 3D tropical aquarium full of colorful moving coral fishes allowing you to feed them and knock at the glass to make them move! Download and add new fishes & backgrounds from our huge gallery! You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Replace your plain cursor with an animated cursor from our huge gallery! Beautify your desktop with incredible wallpapers from our huge gallery covering popular subjects for everyone. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 5983 KB
	-

	Sekhol Finder | License: Shareware |
	A search engine reports that many thousands of pages contain the keywords you just entered. That is fine, but the first returned pages are just better advertised and probably not of big interest. Especially if you are looking for the best sources of information. On the other hand, it is hardly possible to check by clicking and viewing the reported thousands. The search engine will not allow you go too far, usually further then first 1000 , anyway. As a result, the most precious information remains hidden and not accessible. Sekhol Finder is designed to solve this problem. It combines web crawler functionality with advanced keywords text search and logical analysis of a document layout. Publisher: Sekhol Technologies| Date: 25-05-2004 | Size: 2200 KB
	-

	Crawler 3D Earth Screensaver | License: Freeware |
	Download FREE 3D Earth screensaver and take a journey around the planet Earth! Real cloud animation allows you to watch storms and hurricanes. Receive weather forecasts, explore foreign countries, zoom in and out and rotate the globe. 3D Earth presents real Moon & Sun positions and includes International Space Station! You can use also a free customizable Crawler Toolbar that has games, ecards, fun ball, download manager, WSG, and more! Enjoy screensavers like 3D aqua marine, 3D aqua tropical, 3D fire, 3D earth, and 2D slideshow. Enliven your browser with colorful IE browser skins, choose from over 2,000. Publisher: CRAWLER, LLC| Date: 10-09-2007 | Size: 9102 KB
	-

	A1 Sitemap Generator | License: Shareware |
	Create text, HTML, RSS and XML sitemaps (Yahoo, Google etc.) to help search engines crawl and index your website. Near-endless website scanning options. Configure amount of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and read timeout values, removal of session IDs, scanning of javascript and css files, proxy setup, website login, and various other options. Alias paths during scan .Scan websites from multiple start paths, useful for websites not fully crosslinked. Scan local and online websites on internet, localhost, LAN, CD-ROM and disks. Scan static and dynamic websites such as portals, online stores, blogs and forums. Publisher: Micro-Sys| Date: 10-11-2008 | Size: 2184 KB
	-

	Website Monitoring Expert | License: Shareware |
	Get the power and freedom to monitor your website with just three clicks. Website Monitoring Expert is an automated multithreaded tool that keeps a close and constant watch over your website. It can monitor different types of Internet services, including Website, Secure Website(HTTPS), Mail server and FTP server. When your website is detected inaccessible, loads improperly or responds excessively slow, Website Monitoring Expert will send an immediate notification to you. It can even run previously specified applications automatically! You define the interval of time that Website Monitoring Expert provides you with real-time reports and charts, allowing you to easily understand and evaluate your website's performance. Publisher: allapp| Date: 11-09-2005 | Size: 1260 KB
	-

	Falcove Web Vulnerability Scanner | License: Shareware |
	SELF HACKING? WHY? Self Hacking is the efforts of a web-site owner(personal or corporate) in order to audit and penetrate into his/her web site. By using Falcove, web-site owners can see whether their web site(s) are hackable or vulnerable to attacks. Falcove gives you the opportunity of auditing your web site(s) as they are already audited by external hackers on your behalf. But this time, you will be the only master of your website. The aim is simple; be proactive, not reactive. In order to be proactive you need to find vulnerabilites before hackers do and take the necessary precautions to implement the corrective actions. Publisher: BuyServers Ltd.| Date: 28-02-2007 | Size: 4195 KB
	-

	Sitemap Writer | License: Freeware |
	Sitemap Writer is a light version of Sitemap Writer Pro. This is a handy tool that helps you to create and edit sitemaps for your websites. Sitemap Writer is an XML editor for sitemap files Features and Benefits: 1) Easy to use - just enter your URLs (you don't even need to know the XML syntax); 2) Full conformity of generated XML file with the sitemap protocol http://www.sitemapwriter.com/faq.php (tested for Google, Yahoo!, Ask.com and Moreover.com); 3) Generated sitemaps version 0.90; 4) HTML site map export; 5) Import and export URL list (in *.txt format); 6) Merging different sitemaps; 7) Auto checking of duplicate URLs; 8) URL parameters changing with right click (fast edit); 9) URL copy, paste and duplicate; 10) URL Find/Replace; 11) Search engines notification (submit sitemap directly to Google, Yahoo!, Ask. Publisher: Emergency Soft| Date: 12-08-2007 | Size: 517 KB
	-

	Sitemap Writer Pro | License: Shareware |
	Professional XML sitemap generator program will help you easily create XML sitemaps. Sitemap Writer Pro includes built in site crawler for adding URLs into the XML sitemap, FTP manager, search engine notification tool (Yahoo!, Google, Ask.com, MSN (Live.com) and Moreover.com), Sitemap index file editor, HTML site map export tool and Google CodeSearch sitemap export tool. Sitemap Writer Pro can convert HTML sitemaps and RSS 2.0 feeds to XML sitemap. Features and Benefits: 1) Easy to use - just use Crawler or enter your URLs, you don't even need to know XML syntax; 2) Integrated multithread Crawler that will crawl your site and add all your URLs into XML sitemap file (you can add your own extensions or exclusions); 3) Full conformity of generated XML file with XML sitemap protocol (tested for Google, Yahoo!, Ask. Publisher: Emergency Soft| Date: 02-24-2008 | Size: 732 KB
	-

	NetAdjust Website Monitor | License: Shareware |
	NetAdjust Website Monitor is a software utility to monitor your web site and alert you when it goes down. To business owners: - Can you trust when webhosting companies claim 99.99% uptime? - Are you sure your website/business is up and running right now? - Do you know which impression your visitors get when they find your website is offline? - Do you know that paying $10-$20 more for reliable webhosting will cost you less than a few hours web site down time which practically means "shop closed"? To webhosting companies: Monitor your servers 24/7 and get notified immediately whenever a server goes down. Publisher: NetAdjust| Date: 31-12-2004 | Size: 1162 KB
	-

	EmailGrabber | License: Shareware |
	Automatically search web sites for emails. Simply provide a starting web site or starting keywords and let emailgrabber do the rest. Emailgrabber will crawl the web site and collect all email addresses it finds. It will also follow every link. Specify the web sites you want to visit to allow emailgrabber to stay on top of your goal or block web sites you don't want it to visit. Merge email addresses from multiple source files, removing duplicates. Export email addresses gathered using the most suitable delimiter. Save your search session so you can resume it later. Free Lifetime Updates - when you buy emailgrabber you not only get the latest version, but every update we release, whether it is an update for the version you own or a future version. Publisher: EmailGrabber| Date: 30-04-2007 | Size: 2054 KB
	-

	webALERT | License: Shareware |
	Is your website Working Right Now? Relax and let your PC watch your website every minute of the day! WebALERT runs in the background from your System Tray accurately testing 3 critical website parameters to insure that your website is online and running smoothly. Tests server response, checks DNS resolution and verifies HTTP visibility. If any problems occur you are notified immediately and your websites “downtime” is measured. Simply enter your website address and select a monitoring frequency and then sit back and relax. A quick glance at your computers System Tray will always let you know the status of your website. Publisher: Lone Wolf Software| Date: 17-07-2007 | Size: 5212 KB
	-

	Falcove Web Vulnerability Scanner & Penetration Tool 2 in 1 | License: Demo |
	By using FALCOVE Web Vulnerability Scanner & Penetration Tool 2 in 1, web-site owners can see whether their web site(s) are hackable or vulnerable to attacks. FALCOVE gives you the opportunity of auditing your web site(s) as they are already audited by external hackers on your behalf. But this time, you will be the only master of your website. The aim is simple; be proactive, not reactive. In order to be proactive you need to find vulnerabilites before hackers do and take the necessary precautions to implement the corrective actions. SQL SERVER PENETRATION MODULE makes FALCOVE different from other Web Vulnerability Scanners in the Information Security area. Publisher: ST Information Technologies Ltd.| Date: 01-12-2005 | Size: 1157 KB
	-

	BrowserObject .NET Control Free Edition | License: Freeware |
	BrowserObject is a server component detecting Web Browser capabilities such as supported technologies and version that is running on the clients. It performs browser detection to retrieve Web Browser name, version, JavaScript, Plug ins, screen resolution, IP address, cookies, language, client time and many more in real time in the Web server. The detection features of BrowserObject .NET Control Free Edition are Session Cache, Browser Name, Search Engine Crawler, Email Crawler, Alpha Version, Beta Version, Background Sound, Authenticode Update, Character Height Available, Character Width Available, Banned User Agent, Netscape Gold, Syndication Reader, Mouse Over, CDF Supported, PNG Supported, Font Size Supported, IP Address, URL Referrer, Win16, Win32, Win64, Gecko ActiveX Supported. Publisher: BrowserObject.com| Date: 01-11-2008 | Size: 2001 KB
	-

	Xtreeme Search Engine Studio | License: Demo |
	Creating a search engine for your web site does not have to be difficult! Search Engine Studio automatically indexes your web site (with a HTTP crawler, an FTP / local disk scanner, or using an XML file) and then creates a professional, ultra fast search engine for your website (as a binary CGI script or PHP script) or an offline search for CD-ROM / DVD distributions. No installation on server required thanks to a built-in highly optimized database engine! The difference between Search Engine Studio and other search engine generators is that it uses its own highly optimized database engine so there is absolutely no installation required on the server. Publisher: Xtreeme GmbH| Date: 16-03-2006 | Size: 5182 KB
	-

	Eduinfo InstaHelp | License: Freeware |
	Eduinfo InstaHelp is a free service that provides webmasters with Live Website Monitoring and Enables the visitoors to chat with the webmaster whenever he is online. This serviceis aimed at small websites whose webmasters work from home.The service has two parts 1. A small 5 line javascript code which must be embedded on each page of the website. 2.A small ( < less Than 300 KB) operator software. Publisher: Tsunami Corporation| Date: 30-05-2002 | Size: 290 KB
	-

Page: 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 |