Computers & Technology :: Extracting Data from an AJAX-enabled Web Site
Before starting, you must tell Visual Web Ripper the changes that will occur on the website. To keep data from being extracted prematurely, VWR will need to wait for the callback to finish.
VWR will render AJAX in three steps, unless told otherwise
1.Clicks on the selected link or web form button
2.Waits for the Wait Element and/or its container to change. This step will be completed automatically if the content doesn't exist.
3.Waits for the Wait Element to appear on the web page.
A lot of web sites use transition words to tell users that content is being loaded (e.g. "Loading..."). VWR will assume this is the change and extract that as data. To counter this, utilize a Wait Script.
Sometimes an AJAX callback will result in no change either to the entire web page or to the content that preloads. If either of these scenarios arises, click the appropriate checkbox(es): Wait is optional and/or Optional wait applies only to the first link in a list.
VWR is all-seeing, including hidden content, so no separate AJAX action template is necessary. Switch to browser mode to find what you need.
AJAX was built for content that appears after a page rendering. In this scenario, go to Options, click Misc, and check Wait for element.
Iframes are tricky, since they look like AJAX callbacks to VWR. Use the Keep loading webpage until manual stop button on the toolbar to work around this issue.
Though AJAX sites can present hurdles when doing web mining, combining a powerful extraction tool such as Visual Web Ripper with the knowledge of how to navigate through it puts the target data within reach.
Click here for more info.