Tools → Data Manager

About the Data Manager

The Data Manager allows a tenant user with the necessary access permissions to search for, create, and manage external data sources, local data folders, and local data files.

Data Manager Access Permissions

A user that belongs to a group with the Schema Manager or the SuperRole role can access the Data Manager. To access the Data Manager for a given tenant, in the Navigation bar, select Data.

Data Manager Anatomy

The Data Manager consists of the following:

  • Action bar
  • Context bar
  • Search bar
  • List view

Action bar

By default, the Action bar shows the context title, either External Data Sources or Data (for Local Data Files). For Local Data Files, the Action bar title is a navigable folder path.

+ New in the Action bar opens the Add New menu. The Add New menu options are:

  • Add Data
  • Create Folder

Context bar

The Context bar consists of two tabs: External Data Source and Local Data Files. Tab selection determines the search context as well as the List view results.

The Search bar contains a search text box. Search for any part of a given search term. When the Context bar tab selection is External Data Sources, search returns a result list of zero or more external data sources. When the tab selection is Local Data Files, search returns a result list of zero or more local data folders and files.

The Search bar shows:

  • the number of items in the result list
  • the number of selected items in the result list with the option (x) to deselect the items
  • Share icon, use to open the Share dialog and assign or remove access right permission to all selected items
  • Delete icon, use to delete all selected items

List view

The List view shows all results for a given search term and search context. By default, the list view only show items where the given user has view access permissions to the items.

SuperUser

Only the SuperUser tenant administrator can view all items, regardless of access permissions to the objects.

The List view shows 20 items at a time. For lists with more than 20 items, the view contains page controls. The page controls allow the user to navigate up to 5 pages (100 items) forwards or backwards as well as to the first page or to the last page of items.

External Data Sources list view

External data source items appear in alphabetical, ascending order. For External Data Sources, the List view shows the following properties:

Property Control Description
Select All checkbox header control to add or remove all list view page items to a group for deletion or sharing
Select item checkbox select to add or remove and individual item to a group of zero or more items for deletion or sharing
Invalid Data Source icon shows a warning when the external data source was saved with incomplete or invalid properties
Data Source Connector icon a logo icon for the data source connector
Name text the name of the data source
Type text the name of the data source connector
Owner text the display name of the user creator
Test Connection button tests the data source connection and returns a notification panel result regarding the success or failure of the test (a failure includes the exception details)
Edit button opens the Edit Data Source dialog
Share button opens the Share dialog
Delete button opens the confirmation dialog for data source deletion

Local Data Files list view

By default, the Local data folder and file items appear in alphabetical, ascending order. To sort the items by the column values in either ascending or descending order, select a specific column header

For a given folder item, you can select the row, and navigate into the folder. The Action bar title shows a navigable folder path.

For Local Data Files, the list view shows the following properties:

Property Control Description
Select All checkbox header control to add or remove all list view page items to a group for deletion or sharing
Select item checkbox select to add or remove and individual item to a group of zero or more items for deletion or sharing
Folder or File icon icon for folder or file
Name text the name of the local data folder or file
Type text the file type (TXT, CSV, XLSX) or folder name of the local data folder or file
Permission text show access right permissions: View, Share, Edit
Owner text the display name of the user creator
Last Modified text date and time or period ago (seconds, minutes, hours, and days)
Share button opens the Share dialog
Delete button opens the confirmation dialog for data source deletion

Data Manager Actions for external data sources

With the Data Manager, you can perform the following actions for External Data Sources:

Create an external data source

Before creating an external data source, review References → Connectors → for specific property definitions, configurations, and implementation steps.

Validation Rules for a External Data Source name

An external data source name…

  • must be between 1 and 255 characters in length
  • must begin with an alpha character, lower or upper case
  • after the first alpha character, can contain zero or more alphanumeric characters in lower, upper, or mixed case
  • after the first alpha character, can contain zero or more underscore (_) characters
  • besides underscore (_), cannot contain special characters, symbols, and spaces

Here are the general steps to create an external data source:

  • In the Navigation bar, select Data.
  • In the Action bar, select + New → Add Data.

  • In the Choose a Data Source dialog, select a data source connector from one the following categories:

    • Database
    • Application
    • File System
    • Query Service
    • Data Lake
    • Streaming Data
    • Other
    • Custom
  • In the New Data Source dialog, specify the properties for the given data source connector.
  • To test the connection, optionally select Test Connection.
  • To save, select Ok.

Save anyway

You can create an External Data Source with invalid properties for the given data source connector. To save an external data source with invalid properties, select Save anyway.

View a list of external data sources

  • In the Navigation bar, select Data.
  • In the Context bar, select the External Data Source tab.
  • Review the list view of external data sources.

Search for an external data source

  • In the Navigation bar, select Data.
  • In the Context bar, select the External Data Source tab.
  • In the Search bar, enter a search term.
  • Review the list view of external data sources.

Test an external data source

  • In the list view of external data sources, select a given row.
  • Select Test Connection.

Edit an external data source

  • In the list view of external data sources, select a given row.
  • Select Edit.
  • In the Edit Data Source dialog, make the necessary configuration updates.
  • Optionally select Test Connection.
  • To save your changes, select Ok.

Share an external data source

  • In the list view of external data sources, select a given row.
  • Select Share.

In the Share dialog, you can:

  • remove an existing user or group.
  • modify an existing access permission for user or group.
  • add a new user or group with an access permission.

Delete an external data source

  • In the list view of external data sources, select a given row.
  • Select Delete (trash can).
  • In the dialog, select Delete.

Delete one or more external data sources

  • In the list view of external data sources, for each external data source that you want to delete, select the check box.
  • In the Search bar, next to Selected, select Delete (trash can).
  • In the dialog, select Delete.

Data Manager actions for local data folders and files

Using the Data Manager, you can perform the following actions for local data folders and files:

Create and upload one or more local data folders and or local data files, including subfolders and files

A folder can contain zero or more files with zero or more subfolders. Incorta preserves the hierarchy of folders. Incorta only uploads files with the following supported file extensions. After upload, Incorta will unzip compressed folders and files.

File Extension File Type Example Notes
.csv comma separated values sales.csv Can contain a header row
.tsv tab separated values sales.tsv Can contain a header row
.tab tab separated values sales.tsv Can contain a header row
.txt custom delimiter for separated values sales.txt Can contain a header row
.xlsx Microsoft Excel 2000 and above sales.xlsx Must be .xslx as .xsl is not supported. Supports Worksheet selection.
.gzip compressed file format for Linux and Unix sales.gzip Archive must contain a supported file type
.zip compressed file format for Mac OS and Windows sales.zip Archive must contain a supported file type

Header Row

A local data file can contain a header row. The Schema Wizard will use the first row as a header row. The Data Source dialog for a File System data source table has a header row property.

Here are the steps to create and one or more local data folders and/or local data files, including subfolders and files:

  • In the Navigation bar, select Data.
  • In the Action bar, select + New → Add Data.
  • In the Choose a Data Source dialog, in Data Files, select Upload Data Folder.
  • In the Upload Data Folder dialog, in Upload Options, optionally select Overwrite existing file.
  • Drag and drop one or more parent folders or one or more files to the Upload Data Folder dialog.
Note

The Upload Data Folder option and dialog allow you to upload both data files and folders.

Create a local data folder

A local data folder can contain zero or more files with zero or more subfolders. To create a local data folder, follow these steps:

  • In the Navigation bar, select Data.
  • In the Action bar, select + New → Create Folder.
  • In the Add Folder dialog, enter the local data folder Name.
  • Select Add to create the folder.

Validation Rules for a Local Data Folder name

A local data folder name…

  • must be between 1 and 255 alphanumeric characters in length
  • can contain contain special characters, symbols, and spaces except for: /, ?, *, :, ", <, > and |.

View a list of local data folders and files

  • In the Navigation bar, select Data.
  • In the Context bar, select the Local Data Source tab.
  • Review the list view of local data folders and files.

Search for a local data folder or file

  • In the Navigation bar, select Data.
  • In the Context bar, select the Local Data Source tab.
  • In the Search bar, enter a search term.
  • In the Search result dialog, select a local data folder or file.
  • Review the list view of local data folders and files.

Navigable folder path

When you select a folder from the Search result dialog, you navigate to that folder. The Action bar title shows a navigable folder path.

Share a local data folder or file

  • In the list view of local data folder or file, select a given row.
  • Select Share.

In the Share dialog, you can:

  • remove an existing user or group.
  • modify an existing access permission for user or group.
  • add a new user or group with an access permission.

Delete a local data folder or file

  • In the list view of local data folder or file, select a given row.
  • Select Delete (trash can).
  • In the dialog, select Delete.

Delete one or more local data folders or files

  • In the list view of local data file, for each local data file or folder that you want to delete, select the check box.
  • In the Search bar, next to Selected, select Delete (trash can).
  • In the dialog, select Delete.
Related Links
© Incorta, Inc. All Rights Reserved.