Tutorial - Scrape a List of URLs

Overview

This app allows you to collect data from various web pages by inputting multiple URL links. This application is particularly useful for sites where details can't be accessed directly from a list page, or where pop-ups obstruct navigation. With this tool, you can efficiently gather information from similar types of URLs in one go.

How to Use

1. Download the app from Octoparse AI appstore

2. Launch the app in your list.

   1.  Parameter Description

      1. URL_List: Enter the list of URLs you want to scrape, with each link on a new line. For example:

             https://www.goodreads.com/book/show/2657.To_Kill_a_Mockingbird

             https://www.goodreads.com/book/show/61439040-1984

             https://www.goodreads.com/book/show/4671.The_Great_Gatsby

             https://www.goodreads.com/book/show/42844155-harry-potter-and-the-sorcerer-s-stone

             https://www.goodreads.com/book/show/170448.Animal_Farm

      

   2. Click Run application

3. Output

   The app will loop through the provided URLs and collect the specified data, saving it for your review.

   

Note

Do not use the mouse or keyboard while the app is running to avoid interruptions.

Support

Encounter obstacles but don't know how to resolve them when executing the app?

Please contact our support team at support@octoparse.ai to find the way out!