Skip to content

Configuring a Flow

On the Flows pages, you can configure the flows involved in the Scenario. You have to run an initial load when the target database is empty, then, to keep the data warehouse aligned with the sources, you should schedule periodical incremental loads to load all the changes which occur in the source database.

If you have selected the "Auto-generate" option when you have created the Scenario, a flow server containing a flow for each source of the project is automatically generated.

Accessing Flows

Depending on the page from which you access flows, the operations you can perform on them vary. There are two ways to access flows:

  • From within the "Scenario" page, where you can perform all operations on flows, including creating new ones.
  • From the "Solution" page, where you cannot create new flows but only run or edit existing flows.

From the Scenario page

  1. Select the solution on the "Solutions" page, open the Solution" and select the "Flows" tile.

From the Solution page

  1. Select the solution on the "Solutions" page and click "Open Solution".
  2. Click the "Scenarios" tile, select the Scenario and click "Open Scenario".
  3. Click "Open Server" on the Flow Server.

Creating a Flow

  1. In the "Flows" tab, click "Create Flow" and insert a name for the Flow.
  2. From the "Project Flow" drop-down list, select one of the available sources among those you have created during the Project configuration. This list only shows the sources that have not been associated with a Flow yet.
  3. Click "Save".

Creating a Flow schedule

A flow schedule is used to plan an incremental data load.

  1. On the "Flows" page, click "Open Flow".
  2. Click "Create Flow Schedule".
  3. Insert a name for the Flow Schedule.
  4. In the "Frequency" area, select the frequency (Daily, Weekly, Monthly) with which the ETL execution occurs and insert the number of days, weeks or months in the "Recurs Every" field.
  5. In the "Daily Frequency" area, select the Frequency Mode, which can be either "Once At" or "Every".
  6. In the "Occurs Every" field, insert the number of hours or minutes and then set an interval, with the relative start and end time.
  7. In the "Duration" area, set a start date and (optional) an end date.
  8. Click "Save".
  9. To physically enable the running of scheduled incremental flows, do the following:
    • Download the solution configuration from the cloud and upload it on Opcenter Intelligence Connect Cloud.
    • Deploy the Environment in Opcenter Intelligence Connect Cloud.

Important recommendation

It is strongly recommended that you avoid the overlap between data loads from any source to the data warehouse or a smart view. To this purpose, it is advisable to distribute over time the start of each flow. The flows can be totally or partially executed in parallel only if disk speed, RAM and CPU are sufficient to manage the requested operations, including data reading from clients. To optimize your configurations, you should monitor the working environment for a few weeks. 

Example: if the flow duration is 3 minutes and you want to run 4 flows, schedule each flow every 16 minutes (using the "Occurs Every" parameter) and distribute the start time of each flow within the defined time interval in order to prevent overlapping (e.g. at 00.00, 00.04, 00.08 and 00.12).

If you have configured a schedule during the creation of the project, a default flow schedule is created and displayed after you have created a flow. The procedure below can only be used for creating flow schedules other than the auto-generated flow.

Editing a Flow

Follow this procedure to either edit a Flow and to configure additional parameters.

Please be extremely careful when you are setting the "Time window tolerance" parameter. Only advanced users should perform this operation.

  1. On the "Flows" page, select a flow.
  2. Click "Edit Flow".
  3. In the "Standard" tab, you can modify the Flow details.
  4. In the "Advanced" tab, you can change the default values for the following parameters:
    • "Chunk Size". For each entity, within the time window considered by the Flow execution, the system divides the records into chunks of the configured size. Default value: 500000.
    • "Time window tolerance". Only for incremental Flows. This parameter influences the determination of the upper bound of the Flow execution time window. The value is calculated as the current time (now) minus the configured delay. It is expressed in seconds. Default value: 60.
  5. Click "Save".

Last update: October 26, 2026