save info as I browse

Use this forum to post questions relating to WinGate, feature requests, technical or configuration problems

Moderator: Qbik Staff

save info as I browse

Postby miller » Nov 18 07 1:31 pm

hello

is there a tool that will monitor all the webpages I visit and it will save specific text/links/files?
the problem is that most of similar programs (web spiders, etc) require you to enter a starting web
address, then specify retrieval options and then let the program do the job
I want an integrated solution to do this within my browser "as I browse"

first, I need something that will "monitor" every webpage I visit, as I browse the net
this monitoring has to be very accurate ofcourse, which means it must not miss any webpage even the webpages that are partially loaded etc

by "monitoring webpages" I mean to grab the text, links and files of every webpage I visit
by "the text of the webpage", I mean the text that is highlighted/selected when we click ctrl+A in a webpage (included any other "hidden" text, etc)
by "the links of the webpage", I mean the links that are grabbed when we hit ctrl+alt+L in Opera or any other method that shows all the links of the webpage (included any "hidden" links, javascript links, etc)
by "the files of the webpages", I mean the files that are included in the folder that is created when we save a webpage which created an html file and a folder (and any other hidden files, embedded files, etc)

as far as I know (and if you know something else, please inform me) the available methods that can monitor web browser traffic are these:
javascript can monitor webpages as I browse the net (opera, for example, has this javascript function: document.addEventListener('DOMContentLoaded',function() { where it does things when the webpages are loaded)
internet connection sniffer can monitor webpages as I browse the net, that can sniff urls
web proxy can monitor webpages as I browse the net, as it works as a cache proxy

then I need to apply filters to specify which of the text, links and files are useful and then we need to save the filtered information

any help would be much appreciated

thank you
miller
 
Posts: 1
Joined: Nov 18 07 1:29 pm

Postby adrien » Nov 19 07 9:18 am

THe log files in WinGate already will be storing a history of all the URLs requested (whether partial or not). Data where cachable (you need to be careful to honour the cache control mechanisms built into HTTP) will be in WinGate's cache.

But it sounds more like you want a browser plugin? Could be an idea to float to the mozilla firefox forums.
adrien
Qbik Staff
 
Posts: 5448
Joined: Sep 03 03 2:54 pm
Location: Auckland


Return to WinGate

Who is online

Users browsing this forum: Bing [Bot] and 14 guests

cron