Connectors → SAP ERP

About SAP ERP

SAP ERP is an enterprise resource planning system that is built for businesses of all sizes. SAP ERP has modules specific to industries, from manufacturing to retail. The software supports and integrates almost every functional area of a business process from procurement of goods and services, sale and distribution, finance, accounting, human resource, manufacturing, production planning to logistics and warehouse management.

About the SAP ERP Connector

The SAP ERP Connector loads data into Incorta from the SAP ERP Tables, Views, Advanced Business Application Programming (ABAP) Core Data Services (CDS) Views and HANA CDS Views.

The Connector is built using the SAP Java Connector (JCo) library, and uses a Remote Function Call (RFC) enabled Function Module program to perform the following activities:

  • Receive Requests
  • Generate Schema Definition
  • Extract Data from Tables
  • Log Extraction and Processing Status

Following are the SAP objects used to build the SAP ERP Connector function module:

Object Type Object Name
Class CL_ABAP_CHAR_UTILITIES
Class CL_ABAP_GZIP
Class CL_ABAP_MEMORY_UTILITIES
Class CL_ABAP_STRUCTDESCR
Class CL_ABAP_TABLEDESCR
Class CL_ALV_TABLE_CREATE
Class CX_ROOT
Class CX_SY_DYNAMIC_OSQL_SEMANTICS
Class CX_SY_DYNAMIC_OSQL_SYNTAX
Function Module BALW_BAPIRETURN_GET1
Function Module CCU_TIMESTAMP_DIFFERENCE
Function Module RZL_READ_DIR_LOCAL
Function Module DDIF_FIELDINFO_GET
Function Module SUSR_USER_CHECK_EXISTENCE
Function Module SYSTEM_CALLSTACK
Function Module RFC_GET_ATTRIBUTES
Structure CNVCMIS_A_20_DATA_0064
Structure CNVCMIS_A_20_DATA_0128
Structure CNVCMIS_A_20_DATA_0256
Structure CNVCMIS_A_20_DATA_0512
Structure CNVCMIS_A_20_DATA_1024
Structure CNVCMIS_A_20_DATA_2048
Structure CNVCMIS_A_20_DATA_3072
Structure CNV_10500_DATA_4096
Structure CNV_10500_DATA_8000
Structure EPSF
Table Types SYS_CALLST
Table Types TR_TABNAMES

The SAP ERP connector uses configuration parameters to manage table access control. Table access control can be done using the User Profile Authorization Groups method or using a list of table names maintained in a Z Table method.

SAP ERP Connector Compatibility

The SAP ERP connector has been developed and tested for the following SAP ERP Systems:

  • SAP ECC 6.0 EHP 7 - 702, 731, 740, 752
  • SAP S/4 HANA - 1503, 1511, 1605, 1610, 1709, 1809, 1909

The SAP ERP connector supports the following Incorta specific functionality:

Feature Supported
Incremental loading
Encryption at ingest
Performance Optimization
Webhook Callbacks

Deployment of the SAP ERP Connector

Deployment of the SAP ERP connector requires the completion of steps in both Incorta and SAP.

Deployment of the SAP ERP Connector in Incorta

Here are the steps to deploy the SAP ERP connector in Incorta:

  • Contact Incorta Support to obtain the latest version of the SAP ERP Connector ZIP file, and copy it to the Incorta server.
  • Either using the CMC or the shell scripts, stop the Analytics and Loader Services for the cluster.
  • Create the saperp directory in {path to IncortaNode}/extensions/connectors:
    mkdir -p {path to IncortaNode}/extensions/connectors/saperp
  • Unzip the SAP ERP Connector ZIP file from the current directory into the saperp directory:
    unzip sap-erp-*.zip -d {path to IncortaNode}/extensions/connectors/saperp
  • Create an extensions shortcut for the Loader Service:
    cd {path to IncortaNode}/services/{Loader GUID}/
    ln -s ../../extensions extensions
  • Create an extensions shortcut for the Analytics Service:
    cd {path to IncortaNode}/services/{Analytics GUID}/
    ln -s ../../extensions extensions
  • The default directory for the CMC is /home/incorta/IncortaAnalytics/cmc. Stop the CMC with the stop-cmc.sh shell script:
    ./stop-cmc.sh
  • Create an extensions shortcut for the CMC:
    cd {path to IncortaNode}/services/cmc/rm -rf extensions
    ln -s ../IncortaNode/extensions extensions
  • Either using the CMC or the shell scripts, start the Analytics and Loader Services for the cluster.
  • The default directory for the CMC is /home/incorta/IncortaAnalytics/cmc. Start the CMC with the start-cmc.sh shell script:
    ./start-cmc.sh

Deployment of the SAP ERP Connector in SAP

This section provides step by step information for importing binary transports containing Incorta’s development objects into the SAP instance. It is intended for SAP BASIS administrators or Incorta schema administrators with proper SAP transactions and SAP transport management access rights.

Installation User Profile

The following authorization objects are required for the SAP User in order to complete the import steps:

SAP Transaction Code SAP Transaction Description Authorization Object
CG3Z File Upload S_DATASET
STMS Transport Management System S_TRANSPRT, S_CTS_ADMI
SE10 Transport Organizer S_TRANSPRT, S_DATASET
STMS_IMPORT Transport Request Import ES_TRANSPRT, S_CTS_ADMI
AL11 Display SAP Directories S_ADMI_FCD
FILE Cross-Client File Names/Paths
SE16N General Table Display
SM30 Maintain Table View
SE11 ABAP Dictionary Maintenance S_DEVELOP
SU01 User Maintenance S_USER_GRP
SU53 Check User Authorization
Additional User Interface S_GUI
SM69 Operation System Commands

Extract User Profile

The extract user, INC_RFC, will be created as a communications data user type. The following authorization objects are required for the SAP User in order to complete the data extraction from Incorta:

Authorization Object Authorization Field Authorization Value
S_RFC RFC_TYPE FUGR, FUNC
S_RFC RFC_NAME RFCPING, SYST, ZINC_INTF_REL, ZINC_SAP_ERP_DATA_EXTRACTOR
S_RFC TACTVT 16 - Execute
S_TCODE TCD SE16, ZSE16
S_BTCH_ADM BTCADMIN A - Optional Check for Class A Jobs
B - Optional Check for Class B Jobs
C - Copy Another User’s Jobs
D - Authorization to Display Jobs from Other Clients
N - No Administrator Authorization
P - Authorization to Create Periodic Jobs
Y - Background Administrator Authorization
S_BTCH_JOB JOBACTION RELE
S_BTCH_JOB JOBGROUP *
S_DATASET PROGRAM SAPLZINC_INTF_REL
S_DATASET AACTVT 06, 33, 34
S_DATASET FILENAME *
S_LOG_COM COMMAND ZINC_CHMOD, ZINC_CHOWN, ZINC_COMPRESS, ZINC_TRANS_CF, ZINC_TRANS_SCP, ZINC_WINSCP_CMD
S_LOG_COM OPSYSTEM Linux, NT, Unix, Windows NT
S_LOG_COM HOST *
S_TABU_DIS DICBERCLS <Table_Authorization_Group>
S_TABU_DIS ACTVT 03 - Display
S_TABU_NAM ACTVT 03 - Display
S_TABU_NAM TABLE <Table_Name>
S_TABU_CLI CLIIDMAINT X – If the same user is used for table maintenance.
Note
  • <Table_Name> represents a complete list of table names. Wild card characters are not supported.
  • <Table_Authorization_Group> represents a complete list of authorization group names. Wild card characters are not supported.

SAP Function Module Installation Steps

The steps to install the SAP function module are as follows, with details for each step in the sections below:

Setup the SAP Function Module Transport Request

Download the Installation Files

Contact Incorta Support to obtain the SAP ERP Connector binary transport ZIP file. The ZIP file will contain two files:

  • CO file: The filename is in the format KXXXXXX.YYY
  • DATA file: The filename is in the format RXXXXXX.YYY
Note

XXXXXX is a six digit number and YYY is the source system ID.

Upload the Transport Files

Upload the CO and DATA transport files to the target application server.

Upload the CO File

Execute the SAP Transaction Code CG3Z in the SAP GUI to upload the CO file to the default CO transport request directory: /usr/sap/trans/cofiles

The Upload File: Parameters dialog requires the following information:

  • Source file on front end (e.g. /Incorta/Release1/Transport_Requests/K900012.ERP)
  • Target file on the application server (e.g. /usr/sap/trans/cofiles/K900012.ERP

Upload the DATA File

Execute the SAP Transaction Code CG3Z in the SAP GUI to upload the DATA file to the default DATA transport request directory: /usr/sap/trans/data

The Upload File: Parameters dialog requires the following information:

  • Source file on front end (e.g. /Incorta/Release1/Transport_Requests/R900012.ERP)
  • Target file on the application server (e.g. /usr/sap/trans/cofiles/R900012.ERP)
Import the Transport Request

Import the transport request with the following steps:

  • Execute the SAP Transaction Code STMS_IMPORT in the SAP GUI to import the transport request for the uploaded files.
  • Select the ExtrasOther RequestsAdd menu option to add a new transport request to the import queue.
  • In the Add Transport Request to Import Queue dialog:

    • Enter the transport request (e.g. ERPK900012) or select the lookup button to view the available transport request codes.
    • Select the green checkbox.
  • In the Add Transport Request confirmation dialog, select Yes.
  • Once the transport request is added, it is shown in the Import Queue. To import the transport request, select the transport request in the queue, and select Import Request (truck icon).
  • In the Import Transport Request dialog

    • Enter the Target Client (e.g. 100).
    • Select Options, and select the checkbox for each Import Option.
    • Select the green checkbox.
  • In the Start Import dialog, select Yes.
  • Once the transport is imported, the Import Queue Short Text for the request will be populated (e.g. Incorta SAP ERP Extraction connector RFC - RELEASE 1). Select the request to view the Import Log File. All objects should have been created with a valid return code.
Configure the SAP Function Module

Connection Properties

Connection properties are used to define the default settings or appropriate values for the Function Module(s). Connection properties are stored in a key value pair format. The ZINC_CONFIG_PROP table is used to store the connection properties. The table has three columns: Function Module, Property Name and Property Value. Connection properties are stored for a specific Function Module. Execute the SAP Transaction Code SM30 to view or change the connection properties.

Note

The connection properties and the values are development objects. These should be changed only if needed during development or initial integration.

Following are the ZINC_CONFIG_PROP connection properties and the respective default values:

Property Name Property Description Property Value
ZINC_CP_ASYNC_FILE_CLEAN_UP_METHOD Enter the file clean up method. Possible values are:
  • IMMEDIATE - Remove the data file, schema definition file and control file, if any, immediately
  • SCHEDULE - Clean the file up manually during testing
IMMEDIATE
ZINC_CP_ASYNC_FILE_TRAN_METHOD Enter the method used when extracting the data. The default value is ASYNC_FILE_UPLOAD_TO_INCORTA_SERVER_SCP. ASYNC_FILE_UPLOAD_TO_INCORTA_SERVER_SCP
ZINC_CP_AUTO_CLEANUP_FLAG Enable or disable the auto file clean up process. Possible values are Y and N. Y
ZINC_CP_BUILD Enter the date of the last build. 20201020
ZINC_CP_CHARACTER_ENCODING Enter the character encoding format used for data extraction. The default is utf-16le. utf-16le
ZINC_CP_CLEANUP_WINDOW_HOURS Enter how often the cleanup program should run. The default is 24. 24
ZINC_CP_COMPRESSION_ENABLED Enable or disable compression. The default value is N. Y
ZINC_CP_COMPRESSION_METHOD Enter the compression method to be used for extracted data. The default is GZIP. GZIP
ZINC_CP_COMPRESS_ENCODING Enter the character encoding format used for data compression. The default is iso-8859-1. iso-8859-1
ZINC_CP_DATE_FORMAT Enter how the date should be represented in the extraction. The default is YYYYMMDD. YYYYMMDD
ZINC_CP_DATE_FORMAT_BW Enter how the date should be represented in the Business Warehouse (BW) extraction. The default is YYYY.MM.DD. YYYY.MM.DD
ZINC_CP_DELETE_LOG Enable or disable the auto deletion process for log entries. Possible values are Y and N. Y
ZINC_CP_DELIMITER_CHARACTERS Enter the character or characters used for delimiting the columns. The default value is ,. ,
ZINC_CP_DEL_LOG_PERIOD Enter the number of days you wish to keep the log entries in the log tables for debugging and/or test purposes. The default is 90. 90
ZINC_CP_ENABLE_PARALLEL_PROCESSING* Enable or disable parallel processing. The default value is Y. N
ZINC_CP_ENABLE_TIMESTAMP_CHUNKING Enable or disable chunking using the timestamp field. The default value is Y. Y
ZINC_CP_ENCLOSING_CHARACTERS Enter the character or characters used for enclosing the column value when the delimiter is found in the column value. The default is “.
ZINC_CP_ENCRYPTION_ENABLED Enter or disable encryption.
ZINC_CP_ENCRYPTION_METHOD Enter the encryption method.
ZINC_CP_ESCAPE_CHARACTERS Enter the character or characters used to escape the delimiter occurrence in the column value. The default is “.
ZINC_CP_EXTRACTION_METHOD Enter how the data extraction and transfer will be done. The default is SYNCHRONOUS. SYNCHRONOUS
ZINC_CP_EXTRACTION_SELECTION Enter what types of extractions are allowed in the connector. The default is TABLE. TABLE
ZINC_CP_FILE_LAST_CLEANUP_TIMESTAMP Store the timestamp when the last cleanup occurred for the mirror files. The function module will update the timestamp when the file cleanup program has successfully completed. 20200406161645.3327320
ZINC_CP_FILE_LOCATION Enter where the extraction file will be stored. The file location is either a logical file path name or actual physical directory path. The default value is the logical file path name created in FILE t-code and the value is ZINC_INCORTA. ZINC_INCORTA
ZINC_JOB_SERVER_GRP Enter the background job server group allocation. The default is blank. ZINC_JOBSG
ZINC_CP_LOG_SELECTED_COLUMNS N
ZINC_CP_MIRROR_FILE_ENABLED Enable file generation for the data extraction. Possible values are N and Y. The default is N. N
ZINC_CP_MIRROR_FILE_STORE_HOURS Enter how many hours the file can be stored on the application server. The default is 8. 24
ZINC_CP_PARALLELPROCESSING_SERVERGROUP* Enter the server group for parallel processes. INCORTA
ZINC_CP_RELEASE Enter the current version of the connector. 4.4
ZINC_CP_REQUEST_TYPE Enter what types of requests are allowed in the connector. Possible values are:
GET_DATA
GET_SCHEMA
GET_SCHEMA_LIST
GET_TABLE_LIST
GET_COLUMN_LIST
SUBMIT_REQUEST
EXECUTE_REQUEST
SUBMIT_REQUEST_ORIG
EXECUTE_REQUEST_ORIG

The default is GET_DATA.
GET_DATA
ZINC_CP_ROW_DELIMITER_TYPECODE Enter the character or characters used for delimiting the rows. The default is CR_LF. CR_LF
ZINC_CP_SCHEMA_DISCOVERY_METHOD Enter what type of table access restriction is allowed for the connection. Supported possible methods are:
  • User Profile Authorization Groups – ZINC_AUTH_GROUPS
  • Custom Z Table List – ZINC_TAB_ACCESS
ZINC_AUTH_GROUPS
ZINC_CP_SCHEMA_TABLE_UPDATES Update the schema definition log tables with the latest table definitions and when they are executed. The default value is Y. Y
ZINC_CP_SELECT_PACKAGE_SIZE Enter the package size that is used when extracting the data. The default is 15000. 50000
ZINC_CP_STXL_LAST_LOAD_DATE 00000000
ZINC_CP_TIME_FORMAT Enter how the time should be represented in the extraction. The default is HHMMSS. HHMMSS
ZINC_CP_TRANSPORT_ENTRIES Enter the request number. S4HK900246
ZINC_CP_UNCOMPRESSED_DATA_PACKET_SIZE_MB Enter the package size in MB used when extracting the data in Uncompressed Mode. The default value is 100. 100

*These properties are available only for S4/Hana. The rest are available for all SAP versions.

Update the Schema Discovery Method

The following steps can be used to update the Schema Discovery Method:

  • Execute the SAP Transaction Code SM30 in the SAP GUI.
  • Enter the table name ZINC_CONFIG_PROP.
  • Select Display.
  • Select Edit (pen and glasses icon) to edit the table contents.
  • Select Save (floppy disk icon).

Setup and Configure the SAP Data Extraction User

Create the Data Extraction User

Execute SAP Transaction Code SU01 to create the INC_DE_USER user, which is used to access the SAP system for the data extraction.

  • In the User Maintenance: Initial Screen dialog, enter the user ID, INC_DE_USER, in User.
  • Select create (paper icon).
  • Enter the following Person properties for the Incorta Data Extract User:

    • Last name: INCORTA
    • First name: DATA EXTRACT USER
  • Select Logon Data and select a User Type of Communications Data.

    Note

    If the same user will be used to perform table maintenance or log into the SAP GUI, then select a User Type of Dialog.

  • Select the Defaults tab to change the defaults as necessary.
  • Select save (floppy disk icon).
Create the User Role and Assignment

Configure the Authorization Objects, Fields and Values for the INC_DE_USER.

Data Extraction Folder

Configure the Physical Folder

To configure the physical folder, perform the following steps:

  • Execute the SAP Transaction Code FILE.
  • Search for the logical file path: ZINC_INCORTA
  • Select the Assignment of Physical Paths to Logical Path option.
  • For the Physical Paths, choose the type of operating system (OS) used for the application server.
  • Double click the OS Name.
  • Enter the physical path to the folder (e.g. tmp/<FILENAME>).
Note
  • The physical path can be changed as desired.
  • At least 100GB is needed for auto growth in support of a full load.
  • The remove file feature has been implemented, which will clean up the folder automatically.

Setup the Logical Folder Content Display

To setup the logical content folder display, perform the following steps:

  • Execute the SAP Transaction Code AL11.
  • Select the Configure User Directories icon to create a new mapping.
  • In the User-Defined Directories dialog, enter the following information:

    • Name of Directory Parameter: DIR_INCORTA
    • Directory Name: /usr/sap/INCORTA_SAPDATAOUTPUT
    • Valid for Server Name: all
  • Select Save (floppy disk icon).

Verify the SAP Function Module Setup

To verify the SAP Function Module, perform the following steps:

  • Execute the SAP Transaction Code SE37.
  • In the Function Builder: Initial Screen dialog, enter the name of the main function module, ZINC_SAP_ERP_DATA_EXTRACTOR.
  • Select the Test/Execute icon.

Get Schema Request

  • In the Test Function Module: Initial Screen dialog, enter the following import parameter:

    • IN_REQUEST_TYPE: GET_SCHEMA_LIST
  • Select the Execute icon.
  • The output for GET_SCHEMA_LIST is captured in the OUT_SCHEMA_DEFINITION table. Select the OUT_SCHEMA_DEFINITION entries to see the contents of the table.

Get Data – Master or Lookup Table

  • In the Test Function Module: Initial Screen dialog, enter the following import parameters:

    • IN_REQUEST_TYPE: GET_DATA
    • IN_EXTRACTION_SELECTION: TABLE
    • IN_SELECTED_TABLE_NAME: T024
  • Select the Execute icon.
  • The output for GET_DATA is captured in the output table specified in the OUT_DYNAMIC_TABLE_SELECTED output parameter. For the selected table, T024, the output table is OUT_DYNAMIC_TABLE_WIDTH_1024.
  • Select the output table entries to see the contents of the extracted data.

Get Data – Transaction Table Stand Alone

  • In the Test Function Module: Initial Screen dialog, enter the following import parameters:

    • IN_REQUEST_TYPE: GET_DATA
    • IN_EXTRACTION_SELECTION: TABLE
    • IN_SELECTED_TABLE_NAME: BKPF
    • IN_SELECTED_TAB_FULLINC_FILTER: BKPF~CPUDT >= ‘20150101’ AND BKPF~CPUDT <= ‘20150131’
  • Select the Execute icon.
  • The output for GET_DATA is captured in the output table specified in the OUT_DYNAMIC_TABLE_SELECTED output parameter. For the selected table, BKPF, the output table is OUT_DYNAMIC_TABLE_WIDTH_2048.
  • Select the output table entries to see the contents of the extracted data.

Get Data – Transaction Table with Parent Table

  • In the Test Function Module: Initial Screen dialog, enter the following import parameters:

    • IN_REQUEST_TYPE: GET_DATA
    • IN_EXTRACTION_SELECTION: TABLE
    • IN_SELECTED_TABLE_NAME: BSEG
    • IN_PARENT_TABLE_NAME: BKPF
    • IN_PARENT_TABLE_JOIN_CONDT: BKPF~BUKRS = BSEG~BUKRS AND BKPF~BELNR = BSEG~BELNR AND BKPF~GJAHR = BSEG~GJAHR
    • IN_SELECTED_TAB_FULLINC_FILTER: BKPF~CPUDT >= ‘20150101’ AND BKPF~CPUDT <= ‘20150131’
  • Select the Execute icon.
  • The output for GET_DATA is captured in the output table specified in the OUT_DYNAMIC_TABLE_SELECTED output parameter. For the selected table BSEG, the output table is OUT_DYNAMIC_TABLE_WIDTH_5000.
  • Select the output table entries to see the contents of the extracted data.

Steps to connect SAP ERP and Incorta

To connect SAP ERP and Incorta, here are the high level steps, tools, and procedures:

Create an external data source

Here are the steps to create a external data source with the SAP ERP connector:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Data.
  • In the Action bar, select + NewAdd Data Source.
  • In the Choose a Data Source dialog, in Other, select SAP ERP.
  • In the New Data Source dialog, specify the applicable connector properties.
  • To test, select Test Connection.
  • Select Ok to save your changes.

SAP ERP connector properties

Here are the properties for the SAP ERP connector:

Property Control Description
Data Source Name text box Enter the name of the data source
SAP application server host text box Enter the SAP application server host
SAP system number text box Enter the SAP system number. The value is between 00 and 99.
SAP client text box Enter the SAP client number. This number is used to perform the RFC logon to SAP, binding the agent process with the account created during the transport import.
User ID text box Enter the SAP user ID
Password text box Enter the SAP password
BAPI Name text box Enter the Business Application Programming Interface (BAPI) name. The default is ZINC_SAP_ERP_DATA_EXTRACTOR.
Peak Limit text box Optionally enter the maximum number of active connections that can be created for a destination simultaneously. The default is 10.
Pool Capacity text box Optionally enter the maximum number of idle connections kept open by the destination. The default is 3.
Metadata Cache time in minutes text box Optionally enter the metadata cache time in minutes. The default is 60.
Extraction Method drop down list Select the extraction method. The options are:
  • Asynchronous
  • Synchronous
The default is Asynchronous.
Save File For Debugging toggle Enable this property to save a file for debugging
Enable Manual Column Selection toggle Enable this property to manually select the columns to extract data from

Create a schema with the Schema Wizard

Here are the steps to create an SAP ERP schema with the Schema Wizard:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Schema.
  • In the Action bar, select + New → Schema Wizard.
  • In (1) Choose a Source, specify the following:

    • For Enter a name, enter the schema name.
    • For Select a Datasource, select the SAP ERP external data source.
    • Optionally create a description.
  • In the Schema Wizard footer, select Next.
  • In (2) Manage Tables, in the Data Panel, first select the name of the Data Source, and then check the Select All checkbox.
  • In the Schema Wizard footer, select Next.
  • In (3) Finalize, in the Schema Wizard footer, select Create Schema.

Create a schema with the Schema Designer

Here are the steps to create an SAP ERP schema using the Schema Designer:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Schema.
  • In the Action bar, select + New → Create Schema.
  • In Name, specify the schema name, and select Save.
  • In Start adding tables to your schema, select SAP.
  • In the Data Source dialog, specify the SAP ERP table data source properties.
  • Select Add.
  • In the Table Editor, in the Table Summary section, enter the table name.
  • To save your changes, select Done in the Action bar.

SAP ERP table data source properties

For a schema table in Incorta, you can define the following SAP ERP specific data source properties as follows:

Property Control Description
Type drop down list Default is SQL Database
Data Source drop down list Select the SAP ERP external data source
Schema drop down list Select the SAP schema
Table drop down list Select the SAP table
Fixed Columns text box This property is only applicable if Manual Column Selection was enabled during the associated external data source creation. Enter the table fixed columns.
Selected Columns text box This property is only applicable if Manual Column Selection was enabled during the associated external data source creation. Enter the source table columns you would like to include. Leave this field empty if you need to include all the source table columns.
Use Parallel Process in SAP Function Module toggle This property is only applicable if Asynchronous was selected for the Extraction Method during the associated external data source creation. Enable this property to use parallel queries to load the data. Instead of using a single process for one SQL statement, in parallel queries the work is spread across multiple processes. This is useful where there is a lot of data in operations like full table scans of large tables.
Use Parallel Processing For Chunking in Asynchronous Method toggle This property is only applicable if Asynchronous was selected for the Extraction Method during the associated external data source creation. Enable this property to load data chunks (batches) in parallel. If disabled, the system will load data chunks sequentially (first chunk will be loaded first, then the second fetch, etc.).
Dependent Table toggle Enable this property to specify a dependent table
Dependent Schema drop down list Enable Dependent Table to configure this property. Select the dependent schema.
Dependent Table drop down list Enable Dependent Table to configure this property. Select the dependent table.
Join Condition text box Enable Dependent Table to configure this property. Enter the join condition between the source table and dependent table.
Extraction Filter text box Enter the filter to apply to the data extracted from the source table
Use Full Load Chunking toggle Enable this property to process the full data load in chunks
Chunking Column Type drop down list Enable Use Full Load Chunking to configure this property. Select the chunking column type. The options are:
  • Chunking by date or timestamp columns
  • Chunking by string or number column
Manage Full Load Column Selection (e.g. table~column1, table~column2) text box Enable Use Full Load Chunking to configure this property. Enter the specific columns to use for chunking.
Manage Full Load Start Date (format: yyyyMMdd, e.g. 20181225) text box Enable Use Full Load Chunking and select Chunking by date or timestamp columns as the Chunking Column Type to configure this property. Enter the full load start date.
Manage Full Load End Date (format: yyyyMMdd, e.g. 20181225) text box Enable Use Full Load Chunking and select Chunking by date or timestamp columns as the Chunking Column Type to configure this property. Enter the full load end date.
Manage Full Load Increment By text box Enable Use Full Load Chunking and select Chunking by date or timestamp columns as the Chunking Column Type to configure this property. Enter the full load increment quantity. The default is 30.
Manage Full Load Group Restriction text box Enable Use Full Load Chunking and select Chunking by string or number columns as the Chunking Column Type to configure this property. Enter the full load group restriction. The default is 100.
Incremental Load toggle Enable the incremental load configuration for the schema table
Incremental Load Type drop down list Enable Incremental to configure this property. Select the incremental load type. The options are:
  • Incremental Load by date or timestamp columns
  • Incremental Load by Static Filter
  • Chunking by string or number columns
Incremental Load Column Selection (e.g. table~column1, table~column2) text box Select Incremental Load by date or timestamp columns or Chunking by string or number columns as the Incremental Load Type to configure this property. Enter the specific columns to use for incremental loading.
Incremental Load Start Date (format: yyyyMMdd, e.g. 20181225) text box Select Incremental Load by date or timestamp columns as the Incremental Load Type to configure this property. Enter the incremental load start date.
Incremental Load End Date (format: yyyyMMdd, e.g. 20181225) text box Select Incremental Load by date or timestamp columns as the Incremental Load Type to configure this property. Enter the incremental load end date.
Incremental Load Increment By text box Select Incremental Load by date or timestamp columns as the Incremental Load Type to configure this property. Enter the incremental load increment quantity.
Incremental Load Static Filter text box Select Incremental Load by Static Filter as the Incremental Load Type to configure this property. Enter the incremental load static filter.
Incremental Load Get Chunking Group Value Filter text box Select Chunking by string or number columns as the Incremental Load Type to configure this property. Enter the incremental load get chunking group value filter.
Manage Incremental Load Group Restriction text box Select Chunking by string or number columns as the Incremental Load Type to configure this property. Enter the incremental load group restriction. The default is 100.
Packet size in MB text box Enter the packet size in MB. The default is 10.
Callback toggle Turn this option on to enable the Callback URL field
Callback URL text box This property appears when the Callback toggle is enabled. Specify the URL.

View the schema diagram with the Schema Diagram Viewer

Here are the steps to view the schema diagram using the Schema Diagram Viewer:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Schema.
  • In the list of schemas, select the SAP ERP schema.
  • In the Schema Designer, in the Action bar, select Diagram.

Load the schema

Here are the steps to perform a Full Load of the SAP ERP schema using the Schema Designer:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Schema.
  • In the list of schemas, select the SAP ERP schema.
  • In the Schema Designer, in the Action bar, select Load → Load Now → Full.
  • To review the load status, in Last Load Status, select the date.

Explore the schema

With the full load of the SAP ERP schema complete, you can use the Analyzer to explore the schema, create your first insight, and save the insight to a new dashboard.

To open the Analyzer from the schema, follow these steps:

  • In the Navigation bar, select Schema.
  • In the Schema Manager, in the List view, select the SAP ERP schema.
  • In the Schema Designer, in the Action bar, select Explore Data.

© Incorta, Inc. All Rights Reserved.