Data Source

Configure Data Source Connection

Expand the <//Solution : name / Data Sources> folder and select the Data Source to present the editor used to edit Data Sources.
The main goal here is to specify a connection to the source system.

The Procedure    
Right click the Data Sources Folder node. Click New Data Source.
Define the fields presented then click Finish.
Define and configure the connection.
The resulting Data Source connection can be tested by clicking on the Test Connection button.

Data Source - Right Click Options

New Data Source Table

Click to add a data source table definition to the solution.

New Folder

Click to add a folder.

New Script Click to open the form that allows for definition of a script.

Save As Template

Data Source Tables can be saved to the Template library for use in future projects. Select a Dimension Table and click. The displayed dialog gives the user the opportunity to either Save the Table as New or to Overwrite an existing Table.

Copy

A Data Source Table can be copied to clipboard by clicking.

Delete

Click to delete the selected Data Source Table. An "Are you sure?" dialog requiring a confirmation is displayed before the delete is performed.

Data Source - Command Buttons

Save

Click to save the information defined in the Details and the Column Mapping panes to the Solution database.

Reset

Click to undo any edits and or deletes and redisplays the original configuration as of the most recent Save.

Test Connection

Click to test and validate that a connection can be made to the Data Source. NB! For File and Excel connections thebutton only tests that access to the specified folder is OK.

Create Default PowerShell Script Click to create a default script meant to contain a library of functions to be used in source expressions or scripts either implicitly or via the {{EmbedDefaultScript}} macro.

Generate Table Type Folders

Click to generate folders grouping data source tables by Table type. (Only visible if data source has no existing folder structure)

Estimate Compression Savings Click to run a script that can help you identify the best candidates for page compression.

Main Settings

Name

Name of the Data Source Table

Main Filter

Define a data source wide main filter on the rows in each Data Source Table, i.e. the Where Clause. For example, the Main Filter: Company = 'CompanyX' will ensure only the rows for CompanyX are extracted from the source data. Users can override the main filter setting by either unchecking the 'Apply Main Filter' check box or removing the filter from a source SQL Expression.

Description

Optional

Comment

Optional

Source Connection Settings (Databases)

Connection

Shows source connection type (i.e. Oracle) and method (i.e. SSIS).
Change the connection settings by clicking the Edit link button.

Server Name 

Select from the pull down list the Server instance where the source database resides. This field can also be edited directly by clicking in the field and typing. If the Linked Server Connection Method is used, a new linked server registration can be added by clicking the link button. An existing linked server registration can be deleted by clicking thelink button and edited by clicking thelink button.

Database 

Enter or select from the pull down list the Source Database name.

Schema / Owner

Enter the database Schema name (dbo is the default for MSSQL). 

User name 

Enter the User name log in name (is the default).
If this is left blank for MSSQL, integrated security is used.
If the Linked Server Connection Method is used, you can specify advanced security settings via the Edit link button.

Password  Enter the Password log in name (is the default).
Timeout Enter the number of seconds to wait for a result from the source server when executing source queries (applies to import of metadata, previews, validations and transfers). 
Caution: Setting timeout to 0 is not recommended as it does not automatically free up resources when the source query does not return.
Row Limit Enter the maximum number of rows returned in data previews. 
Caution: Setting row limit to 0 is not recommended as data previews might consume a lot of system memory resulting in poor performance or "System out of memory" error messages.

Source Connection Settings (File (CSV, XML, JSON) and Excel (and MS Access) Source Types)

Connection

Shows source connection type (i.e. Oracle) and method (i.e. SSIS). 
Change the connection settings by clicking the Edit link button.

Folder

Enter or browse and point to the catalog containing the source files.

File type filter 

Enter a file type filter in the format of namefilter1.ext;namefilter2.ext. Example: *.csv;*.dat

Default File (only for File Source Type)

Useful for identifying row delimiter information. The invisible characters CR and or LF is added to the file to make for easier identification of correct row delimiter settings.

User name  Enter the User name log in name (is the default).
If this is left blank for MSSQL, integrated security is used.
If the Linked Server Connection Method is used, you can specify advanced security settings via the Edit link button.

Password 

Enter the Password log in name (is the default).

Column delimiter (only for File Source Type)

Select from the pull down list the Column Delimiter used in the delimited flat files.

Row Delimiter (only for File Source Type)

Select from the pull down list the Row Delimiter used in the delimited flat files.

Code page (only for File Source Type) Select from the pull down list the Code Page used in the delimited flat files.
Locale (only for File Source Type) Select from the pull down list the Locale used in the delimited flat files.
Text qualifier (only for File Source Type) Select from the pull down list the Text Qualifier used in the delimited flat files.
Header row Indicates if the files / worksheets has header rows.
Header row delimiter (only for File Source Type) Select from the pull down list the Header Row Delimiter used in the delimited flat files.
Header row count (only for File Source Type) Enter the number of rows used for headers. Usually 1.
Timeout Enter the number of seconds to wait for a result from the source server when executing source queries (applies to import of metadata, previews, validations and transfers). 
Caution: Setting timeout to 0 is not recommended as it does not automatically free up resources when the source query does not return.
Row Limit Enter the maximum number of rows returned in data previews. 
Caution: Setting row limit to 0 is not recommended as data previews might consume a lot of system memory resulting in poor performance or "System out of memory" error messages.
Skip SSIS (only for Excel Source Type)

Skip SSIS allows you to import Excel data without having to install Jet / ACE OLEDB Provider and/or Integration Services. Also 32-bit vs. 64-bit issues can be avoided by checking this option.

Note!
All columns are imported using the data type nvarchar(500). This may require using some string functions to import dates into a valid date format. See also Excel data source.

DW Connection Settings (Databases)

Use Separate DW Connection

Check to define a separate target data warehouse database.

Database 

Enter or select from the pull down list the Source Database name.

Schema

Enter the database Schema name (dbo is the default for MSSQL). 

User name

Enter the User name log in name (is the default).
If this is left blank for MSSQL, integrated security is used.
If the Linked Server Connection Method is used, you can specify advanced security settings via the Edit link button.

Password  Enter the Password log in name (is the default).
Timeout Enter the number of seconds to wait for a result from the source server when executing source queries (applies to import of metadata, previews, validations and transfers). 
Caution: Setting timeout to 0 is not recommended as it does not automatically free up resources when the source query does not return.
Row Limit Enter the maximum number of rows returned in data previews. 
Caution: Setting row limit to 0 is not recommended as data previews might consume a lot of system memory resulting in poor performance or "System out of memory" error messages.

 

Status

The Status pane displays the activity and status of updates from the Data Source to the Data Warehouse.

 

General

For Name, Description, Comments editing click here. 

For use of status tab click here. 

For shortcut keys click here.