Web Crawler - Crawling Web 2.0 Applications

Crawling Web 2.0 Applications

  • Sheeraj Shah provides insight into Crawling Ajax-driven Web 2.0 Applications.
  • Interested readers might wish to read AJAXSearch: Crawling, Indexing and Searching Web 2.0 Applications.
  • Making AJAX Applications Crawlable, from Google Code. It defines an agreement between web servers and search engine crawlers that allows for dynamically created content to be visible to crawlers. Google currently supports this agreement.
  • Relevant research on crawling Web 2.0 Applications:

1. Model based crawling of Rich Internet Applications - Software Security Research Group - University of Ottawa and IBM Research Labs

2. Crawljax Crawljax is an open source Java tool for automatically crawling and testing modern (Ajax) web applications.

3. SPCI Project - Delft University of Technology

Read more about this topic:  Web Crawler

Famous quotes containing the words crawling and/or web:

    As I stand over the insect crawling amid the pine needles on the forest floor, and endeavoring to conceal itself from my sight, and ask myself why it will cherish those humble thoughts, and hide its head from me who might, perhaps, be its benefactor, and impart to its race some cheering information, I am reminded of the greater Benefactor and Intelligence that stands over me the human insect.
    Henry David Thoreau (1817–1862)

    Any newspaper, from the first line to the last, is nothing but a web of horrors.... I cannot understand how an innocent hand can touch a newspaper without convulsing in disgust.
    Charles Baudelaire (1821–1867)