Tutorial-Scrape Detail Page

Overview

This app demonstrates how to scrape article titles and links from a list of articles, then visit each article's page to collect the author's name. In the Octoparse AI client, you can double-click the app to enter the editor interface and see how the entire workflow is set up.

How to Use

1. Download the app from Octoparse AI app store.

2. Launch the app in your list.

   1.Variable Description

        To assign a value to a variable, double-click its name in the right sidebar and open the editing interface.

1. ExportTo: Specifies the file path where the collected data will be saved. Choose a location on your computer where you want to store the output file.
2. Results: This data table stores the scraped data. You can customize the table name and edit the column names to suit your needs.

   2. Click "Run"

3. Output

This app will scrape data from the list page, then click on each article's link to collect data from the article's detail page. The collected results will be saved in the file path specified in the ExportTo variable.

Notes

• Do not use the mouse or keyboard while the app is running to avoid interruptions.
• You might see a login pop-up while running the app. You can either close it manually or log in beforehand.
• Octoparse AI is only compatible with Windows.

Troubleshooting

Encounter obstacles but don't know how to resolve them when executing the app?

Please contact our support team at [email protected] to find the way out!

To help us better understand your issue, follow the steps below to export your running logs: