miCRoSCoPiC^eaRthLinG
Dec 1 2005, 06:06 PM
| | Hi guys, Am trying to come up with a Javascript function that can load a given URL and fetch part/whole of the web page and hand it over to my parser. Any ideas on how to do it ?
One way I figured is to use XMLHttpRequest - but you need the server-end to respond by sending the required data to you in XML format. What if the page I want to extract data from is just an ordinary static page ... say I know the required data is a word that can be found at second paragraph of a page.. So how do I go about getting that page and extracting that info.
Any help will be much appreciated 
Regards, m^e |
Comment/Reply (w/o sign-up)
vizskywalker
Dec 1 2005, 11:28 PM
Umm.. easiest way I know of to do this is to use sockets, which is networking, and not one of javascripts strong suits. May I inquire as to why it is important that it be javascript? ~Viz
Comment/Reply (w/o sign-up)
miCRoSCoPiC^eaRthLinG
Dec 2 2005, 06:46 AM
Because it's for a firefox extension - I need to be able to connect to a certain Asta page and extract a "certain" info  lol.. See the thing is javascript has a really cool XML Client Service - a class known as XMLHttpRequest - which is extremely painless, as it's asynchronous. That means it will connect to the server on a separate thread, without slowing down the main code. It even has a callback delegate, which receives the reply upon termination of the request.. but anyway, for that you need something at the server end that serves the data in XML format. What I'm looking for here is any other alternative by which I can fetch a page and extract certain info out of it.
Comment/Reply (w/o sign-up)
vizskywalker
Dec 2 2005, 11:28 AM
Cool, I'll keep an eye out on one condition, that you write an in depth firefox extension tutorial when you get a chance  . ~Viz
Comment/Reply (w/o sign-up)
miCRoSCoPiC^eaRthLinG
Dec 2 2005, 07:26 PM
Cool - will do so. And actually - forget about the JS Code. When I went to sleep last night I had a dream of an alternative ( I know it's weird - people dream real sweet dreams - and I dream coding solutions .. and when I wake up in the morning - THEY WORK.. I get most of my solutions in dream). Anyways - I wrote of a XML-RPC script using PHP - that'd serve the data in XML format and was able to read it off using the XMLHttpRequest class of JavaScript. So... the Firefox Credits Reporting System Extension is FINISHED and FULLY WORKING. It's under thorough testing now.. hopefully I'll be able to release it simultaneously for Astahost and Trap17 within 4-5 days. Only feature that hasn't been implemented yet - is auto-refreshing of credits at a preset duration. Right one, it refreshes upon a single click with the left mouse button. Other than that you obviously have to set your own username password into it - otherwise it won't fetch credits. This user/pass combo is stored in the central Mozilla PasswordManager Safe  So no worries about that.. this part took a while to figure out. Earlier they're getting saved in plaintext to prefs.js - which of course is visible to everyone. Upon finishing this extension I realized how poorly documented (and explained) are extension tutorials. I couldn't find a SINGLE GOOD one on the net - ultimately I had to rip apart every possible extension and study them whole night till I started seeing light. Other than that the Mozilla Extension API references helped to a certain extent - although their Examples are by far few and poor. I gave the extension FOUR Distinct States - i.e. it's got this Astahost Icon (also Trap17) .. converted to appropriate format+colors by twitch/guy .. Sneak PreviewsThe basic idea is: Credits 30+ : BLUE  15 <= Credits < 30 : GREEN  1 < Credits < 15 : AMBER  Credits <= 1 : RED  Any bright ideas, any UI considerations - let me know for sure, and I'll see if it can be incorporated using my limited knowledge 
Comment/Reply (w/o sign-up)
vizskywalker
Dec 2 2005, 08:34 PM
Cool, suggestion, add a mod mode to it so mods and Admins can eneter someone's username to view their credit count. That will make it easier to diagnose credit problems maybe, and speed up credit checking for applications. ~Viz
Comment/Reply (w/o sign-up)
vujsa
Dec 4 2005, 06:39 AM
One additional state should be added. - Error / Unknown / Unavailable In the event auxilary credit display script which I assume you are using is offline, your scipt may be very upset about it. I didn't program the credit checker for the Free Web Hosting application script to deal with that well and it has caused a bit of a stir. vujsa
Comment/Reply (w/o sign-up)
Similar Topics
Keywords : Javascript Fetching Data Webpages- JavaScript: Hide And Show Any Element With CSS
- From the simple way to the more advanced way (Javascript & CSS) (9)
Welcome everyone, this is my first post. The first thing you need to know is... CSS
has two special attributes, the first one is " display " and the second is " visibility ". The
difference between these two goes like this. " display ": has many properties or values, but the
ones we need are "none" and "block". "none" is like a hide value, and "block" is like show. If you
use the "none" value you will totally hide what ever html tag you have applied this css style. If
you use "block" you will see the html tag and it's content. very simple. " visibi...
Getting Screen Resolution using Javascript.
- (10)
Is it possible to get the screen resolution of the users moniter using only javascript. No other
external stuff, just pure javascript. I guess most of the people using JAVA for this. I also got
some scripts regarding this which used SCREEN.WIDTH function or something, but they did not seem to
work out. Any possible solutions. BTW, is it possible to get the resolution using PHP ( I guess it
is not ) ......
Javascript: Text To Texbox And Back To Text
- (3)
i need some help i want to create a thing where when some one double clicks a certain text it
changes into a texbox where they can edit the text and the they double click and it changes into the
test they just typed in. I have found this function in javascript that does some of it but i needs
to be simplified CODE "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> Span to
Text Box - Demo - DOM /* © John Davenport Scheuer */ function exchange(el){ var
nodeI=el.parentNode, inputC=document.createElement('input'), text=el.innerHTML; el.style.f...
Best Way To Learn Javascript
- I would very much like to know. (11)
Well, I know HTML, I know CSS, so the next step is learning Javascript. I have heard that it is sort
of an easier way to do things than PHP, though I would very much like to learn PHP as well. So, I
thought that if I learnt Javascript, I might find it easier to learn PHP when I get to that point.
The problem though is actually finding out the best way to learn Javascript. I have been to
websites and things, but every time I read through the tutorials and articles and things, I
didn't learn anything. It when in one ear and out the other, you could say. So, that is wh...
Vertical Marquee Using JavaScript
- by The JavaScript Source (1)
Hi, i find this script and hope that will be useful for somebody. Text scrolls from bottom to top,
pauses, then scrolls up and out of view. A link can be added, opening in a new window. Configuration
is simple. First copy the following code in a new file and name it vertical.js CODE /* This
script and many more are available free online at The JavaScript Source ::
http://javascript.internet.com Created by: Mike Hudson :: http://www.afrozeus.com */ /* To change
the values in the setupLinks function below. You will notice there are two arrays for each of Titles
and L...
Javascript: Browser Detection Script
- Detect your visitors browser (2)
If you want to detect your visitors browser, sebd them a message and redirect them use this script:
CODE var browserName=navigator.appName; if (browserName=="Netscape") { alert("Hi Netscape
user!") window.location = "netscape.html" } else { if (browserName=="Microsoft Internet
Explorer") { alert("Hi Microsoft Internet Exlorer User!"); window.location = "MIE.html" }
else { alert("What are you browsing with?"); window.location = "unkown.html" } } //-->
...
Javascript: Disable Mouse Right-click In Browser
- (17)
just copy and paste this on to your html site in the head tag CODE /* */ var message="Hey
YOU!\nStop Stealing my pictures or\nFACE THE PUNISHMENT!" function click(e) { if (document.all)
{ if (event.button == 2) { alert(message); return false; } } if (document.layers) { if (e.which ==
3) { alert(message); return false; } } } if (document.layers) {
document.captureEvents(Event.MOUSEDOWN); } document.onmousedown=click; // --> ...
Javascript Question
- Vertical Scroll Box (6)
Alright well I've been working and modifying this template for about a year now I think and
I've started used JavaScript in it (bad to use templates I know, but I can't design them
x_x). So I'm trying to put a vertical scroll box in my side events panel to save space, but it
won't recognize the script. It takes the horizontal one I have as you can see if you look at
the site, but not the vertical. Actually it won't take anything in that little panel. So my
question really is, what could cause a javascript code to not work on a certain webpage ...
JavaScript: Simple Dropdown Menu
- Simple Dropdown Menu (5)
This simple dropdown menu is flexible enough to be used in various ways. It can be placed and
modified in the webpage as is....
12 Javascript Image Galleries
- (0)
I Need Help With Javascript.
- help plz (7)
Well, I want to learn to code in JavaScript, but when I try to view the page in Firefox, it
dosen't work. Can anyone tell me why its not working? Do i need to use a different browser?...
Include Function For Javascript
- (7)
I've been working on an include function for javascript. It works just fine in Firefox and IE,
but for some reason, it doesn't result in the loading of the scripts for Safari. The code is as
follows: CODE function include(url) { // Include Guard var scripts =
document.getElementsByTagName("script"); for (var index = 0; index if (scripts.src == url) {
return; } } // Inclusion var head =
document.getElementsByTagName("head").item(0); var script =
head.appendChild(document.createElement("script")); script.type = "text/javascrip...
JavaScript Frames & Querystring
- (4)
Hi, I actually want to create a HTML page which has the capablity of reading a QueryString
(x.html?querystring=test) and then using a hidden frame pass on the data to an ASP Script on another
server. For obtaining the QueryString i use the following:- CODE function
getQueryVariable(variable) { var query = window.location.search.substring(1); var vars =
query.split("&"); for (var i=0;i var pair = vars .split("="); if (pair == variable) {
return pair ; } } } alert( getQueryVariable("QueryString") ); Now my
problem is to cre...
Create And Import JavaScript Modules For A Large Script
- (2)
I have one main script which defines an object. I then have several other script files that define
functions for that object. I have tried using the following setup to import the functions: HTML
code snippet: Javascript code snippet: import Object.functionName; This works fine for
Mozilla Firefox, but causes an error in Internet Explorer which causes the object to be undefined.
I would like to know how better to import the functions into the main javascript (preferably without
needing to add the module script to the html file) that works in both Firefox a...
Ever Needs To Find Out A Table Height Or With With JavaScript
- Well stop looking, here is the answer (CSS and JS) (2)
Welcome everybody to this litle tutorial. by v.DragonEyE.n09 Introduction: Using
javascript you can find the height and width of a table, cell, div, image, etc.. the more simple way
is to ask for this... QUOTE id= "myElement" border= "0" cellpadding=
"0" cellspacing= "0" style= " height : 300px ; width
: 450px ; " > some
fake text and images for the example some fak...
How To Create A Popup Window With Javascript?
- (19)
Please help me! I want to in popup massage suggest to visitors of my site to make my site their home
page . Please note that I have some script code that visitors most click on a text to make my site
their home page . Every one that can help me please send an email to soleimanian@noavar.com...
javascript vs java
- (12)
in my opinion javascript is better then java becasue java requires more programing experecense then
javascript and i think to that javascript is more reliable then java in some ways...
Add Text To Textarea
- I suppose it uses DOM and JavaScript?? (6)
I am working on a web "application" thing that allows you to click a button to add text to a
textarea. Similar to this forum when you click the BOLD button and it puts in {b}{/b} with the
square brackets. I want a similar function like that. Also, I want it to add wherever the cursor is,
not at the end. And after adding the thing, the cursor should be in between the tag or whatever that
was added. All the extra stuff are extra priorities. For now I would like to get something that
inserts text on click. The thing I came up with is: HTML html > head > text/javasc...
Javascript Changes Aren't Working.
- (6)
The link is where I got it from, the code is my attempt at changing it, which has the identical
javascript, but it doesn't work. Can anyone fix it for me?
http://code.google.com/edu/client/samples/dhtmltest.html CODE example body {font: 14px
arial; color: #000066;} #mytext {position: absolute; top: 100px; left: 400px; font: 24px arial;
font-weight: 900; } var texttop = 100; var textleft = 400; function vanish(flag) { var myObj
= new getObj('myText'); myObj.style.visibility = (flag) ? 'hidden' :
'visible' } function m...
Javascript Help Needed : Alert(z) Works Fine But Document.write Not
- please (2)
hi all, I am facing problem in my javascript, any kind of help would be apreciated CODE
function basicFiles(){ //var Z = ""; for (i = 0; i var x =
document.Form.regionlist.options .value; var y = document.Form.regionlist.options
.text; var Z = "regions" + " " + " = " + y + ", "; alert(Z);
} } this works well but the following returns only errors CODE
function basicFiles(){ //var Z = ""; for (i = 0; i var x =
document.Form....
Fun With Javascript And Forms
- Lets have some fun with javascript! (2)
I will post here every week with new and exciting things to do in javascript! After i finish 10 of
them , ill do Ajax(real-time) - 1.Alerting and documenting Forms Ever seen those dynamic sites
where if you hove your mouse or type something bad..etc , it popups up or dynamically gets written
onto the page? Well i am here to teach or rather help with all that stuff! Step 1:Get notepad out
and make a form CODE Text displays here: Step 2: Add the javascript Bit CODE
function onKeyDown() { document.GetElementById('r').innerHTML=document....
Problem With Javascript Alert();
- (9)
Hi Everyone, i just need to know that this javascript code is formatted correctly: (A piece of
code that it's written BESIDE an HTML code.) CODE My body contents |||Always keeps
telling me that this was incorrect. ...
Javascript: How Do I Create Embedded Pop-up Windows?
- (7)
The post title summarises my query - how do I create pop-up windows that are embedded inside a page?
Broadly, there are two kinds of JavaScript pop-ups.. one is that ultra annoying one, which pops
out a new instance of a browser window and displays something there (usually an ad) - made infamous
by all the warez and porn sites. Second one, which has come to be quite well-known of late is the
kind you see in recent versions of WordPress (in the Visual Editor) as well as LightBox based
galleries. Here a small window (or rather a div) pops-up embedded in the middle of t...
Javascript: Simple Slidedown Menu
- Simple Slidedown Menu (2)
This is a simple slidedown from the top menu. It can be placed on the Webpage as is. To modify it
to a slideout menu, simply change the style and postion of the menu....
Problems With Dynamically Loading Javascript
- As well as dynamically inserting HTML (2)
Hello, I have started to try to create a JavaScript application (or rather, AJAX, but the
JavaScript is the part I'm having trouble with). I have come across a roadblock, though. I try
to load an external JavaScript file by editing the innerHTML of a div tag to contain <script
src="URL" type="text/javascript"> (with a real URL). The problem is that it is not loading. I have
used FireBug to check the dynamic HTML status, I get the following (with code removed): CODE
<script type="text/javascript"> <script src="source/main_login.js" typ...
JavaScript Off Redirect Script
- How to redirect a browser when Javascrip (2)
Hi, here's a trick that will redirect a browser when JavaScript is turned off. Why not redirect
the ones that have JavaScript? It's because less than 10% of browsers have JavaScript turned
off; therefore, is better to redirect less than 10% of visitors than over 90%. Simply paste this
code into the HEAD section of your HTML document. CODE /* Created by: Will Bontrager ::
http://www.willmaster.com/ */ //--> Best regards,...
Dynamicdrive: Good Site For JavaScript Codes
- (5)
If anyone needs Javascript codes or similar items for their web page a great place to go is
http://www.dynamicdrive.com . They have hundreds of codes that are good. I would reccomend them for
all your javascript needs....
Calling Of Functions Between Mulitple External Javascript Files
- How do I use an external script to call a function from another script (2)
I have a page that requires many Javascript functions. In order to make the coding easier to read
and edit, I decided to seperate them into 3 Javascript files. Two files will each do a specific job.
One file will have the shared functions that both other 2 files will need to use. They are all
linked to a page using three tags. The difficult part is that after the page calls a function in
one of the special code files, that Javascript file will need to call the functions located in the
common Javascript file. The file will call several functions, and it will an argumen...
Downloads With Javascript?
- (7)
Hi! I want to let people download .mp3's. But i don't want them tio have to right-click and
"Save as". Is there a way with Java Script? Cheers!' Jens...
Unobtrusive Javascript Image Rollovers
- really cool & useful.. (0)
i find this really cool..gr8 piece of code. image rollovers Create image rollovers for your
navigation without hardcoding any JavaScript into the HTML code on your Web pages. Easy to
implement, even for beginners, and works across all browsers. Degrades nicely for visitors with
JavaScript turned off. CODE img {border: none;} ul {list-style-type:none;} ul li
{display:inline;} function isDefined(property) { return (typeof property !=
'undefined'); } var rolloverInitialized = false; function rolloverInit() { if
(!rolloverInitialized && isDe...
Looking for javascript, fetching, data, webpages
|
See Also,
*SIMILAR VIDEOS*
Searching Video's for javascript, fetching, data, webpages
|
advertisement
|
|