Web Crawler - Crawling Web 2.0 Applications

Crawling Web 2.0 Applications

  • Sheeraj Shah provides insight into Crawling Ajax-driven Web 2.0 Applications.
  • Interested readers might wish to read AJAXSearch: Crawling, Indexing and Searching Web 2.0 Applications.
  • Making AJAX Applications Crawlable, from Google Code. It defines an agreement between web servers and search engine crawlers that allows for dynamically created content to be visible to crawlers. Google currently supports this agreement.
  • Relevant research on crawling Web 2.0 Applications:

1. Model based crawling of Rich Internet Applications - Software Security Research Group - University of Ottawa and IBM Research Labs

2. Crawljax Crawljax is an open source Java tool for automatically crawling and testing modern (Ajax) web applications.

3. SPCI Project - Delft University of Technology

Read more about this topic:  Web Crawler

Famous quotes containing the words crawling and/or web:

    You know, Frank, I’m beginning to get a new perspective on this crawling little animal known as man. Why a dog or a cat or a bird is cleverer than any human. They sense me immediately. But these shrewd detectives of yours—. Take away one of man’s senses and you render him helpless.
    Lester Cole (1904–1985)

    There she weaves by night and day
    A magic web with colours gay.
    Alfred Tennyson (1809–1892)