Web Crawler - Crawling Web 2.0 Applications

Crawling Web 2.0 Applications

  • Sheeraj Shah provides insight into Crawling Ajax-driven Web 2.0 Applications.
  • Interested readers might wish to read AJAXSearch: Crawling, Indexing and Searching Web 2.0 Applications.
  • Making AJAX Applications Crawlable, from Google Code. It defines an agreement between web servers and search engine crawlers that allows for dynamically created content to be visible to crawlers. Google currently supports this agreement.
  • Relevant research on crawling Web 2.0 Applications:

1. Model based crawling of Rich Internet Applications - Software Security Research Group - University of Ottawa and IBM Research Labs

2. Crawljax Crawljax is an open source Java tool for automatically crawling and testing modern (Ajax) web applications.

3. SPCI Project - Delft University of Technology

Read more about this topic:  Web Crawler

Famous quotes containing the words crawling and/or web:

    “But see, amid the mimic rout
    A crawling shape intrude!”
    —Edgar Allan Poe (1809–1849)

    “The delicate, invisible web you wove
    The inexplicable mystery of sound.”
    —T.S. (Thomas Stearns)