Web scraping the pages that need rendering is often called web scraping dynamic web pages. This is where Selenium shines. Selenium is one of the oldest and perhaps the most widely known tool. Selenium ...

Web scraping involves two broad categories of web pages—pages that need rendering and pages that do not need rendering. Web scraping the pages that need rendering is often called web scraping dynamic ...

Many web testing libraries do just that, including open source tools such as Selenium, Canoo WebTest, WebDriver, and the recent Selenium-WebDriver integration, Selenium 2.