Definition and Usage
This command retrieves cloud data from an Octoparse task. It allows you to fetch either partial data or all unexported data from specified Octoparse tasks, with options to control the data retrieval using offset and count parameters.
Parameter Values
Input parameters
Parameter | Description | Possible Values | Required | Options / Notes |
Octoparse account | Select an access token obtained by "Log in to Octoparse" |
| Yes | Must be authenticated before using this command |
Task ID | Enter Octoparse task ID(s) to check (separate multiple IDs with ";") |
| Yes | Multiple task IDs can be specified by using semicolon as separator |
Data type | Select the type of data to get | Partial data; All unexported data | Yes |
|
Set offset | Get data by offset |
| No | Optional checkbox to enable offset-based data retrieval |
Offset | Set offset |
| No | Only available when "Set offset" is checked |
Data count | Specify how many rows of data to retrieve |
| Yes | Defines the maximum number of data rows to fetch |
Set as exported | Mark retrieved data as exported to avoid fetching it again in future runs |
| No | Optional checkbox |
Store task data into | Store the retrieved data into a new variable |
| Yes | Output variable name |
Error handling
Parameter Name | Description |
Throw error & stop | When an error occurs, the action will trigger an error and stop the execution of the entire app. |
Retry command | If an error occurs, the action will retry the command in an attempt to resolve the issue and continue the process. |
Ignore error & continue | When an error occurs, the action will be ignored, and the workflow will continue without interruption. |
Variables produced
This action produces a variable that contains the retrieved task data from Octoparse.
Using Variables in Conditions
Fields marked with {x} icon support variable insertion. You can use previously defined variables in these fields, such as using a variable to dynamically set the Task ID or Data count. When using variables, ensure that the variable type matches the expected input type for the field.
Notes
Before using this command, ensure you have successfully logged in to Octoparse using the "Log in to Octoparse" command.
The "Set as exported" option is useful for incremental data extraction workflows, as it prevents retrieving the same data in subsequent runs.
When working with large datasets, consider using the offset and data count parameters to retrieve data in manageable chunks.
Task IDs can be found in your Octoparse account dashboard or task management interface.
The output data format will match the structure defined in your Octoparse task configuration.