CSV

A CSV (Comma Separated Values) file is a simple text file used to store data in a table format. Each line represents a row, and each value in the row is separated by a comma. It is commonly used for importing and exporting data between different applications like Excel, databases, and reporting tools.

Example Configuration

version: 1.0.1
encrypt_credentials: false
union_all_tables: true
add_dbname_column: false
use_snake_casing: true
plugins:
  extractors:
  - name: FileSystem
      connectorname: FileSystem
      schemaname:
      config:
      properties:
        storage: local
        type: csv
        filePath: C:\BoldServices\app_data\elt\connectors\products.csv
      metadata:
      select:

Configure the smartlife Data Hub to connect CSV

  1. Click the Data Hub icon on the Navigation Pane.

CSV Data Hub- smartlife BI

  1. Click Add Pipeline and provide the new pipeline’s name.

CSV Data Hub - smartlife BI

  1. Select the newly created pipeline and add the CSV template.

CSV Data Hub - smartlife BI

  1. Click the “Upload File” button to upload your CSV file.

CSV Data Hub - smartlife BI

  1. Copy the filepath and replace in filePath property.

CSV Data Hub - smartlife BI

CSV Data Hub - smartlife BI

  1. Click Save and choose the desired destination to save the pipeline.

CSV Data Hub - smartlife BI

  1. Creating a Pipeline in smartlife Data Hub automatically creates a Data Source in smartlife BI. The smartlife BI Data Source is a live data source to the destination database used in smartlife Data Hub. For more information on the relationship between smartlife Data Hub Pipeline and the associated Data Sources in smartlife BI , please refer to Relationship between smartlife Data Hub Pipeline and Associated Data Sources in smartlife BI.

CSV Data Hub - smartlife BI

Schedule Data Hub Job

  1. To configure interval-based scheduling, click on the schedules tab and select the created pipeline and click on the schedule icon and configure it.

CSV Data Hub - smartlife BI

CSV Data Hub - smartlife BI

  1. For on-demand refresh, click Run Now button.

CSV Data Hub - smartlife BI

  1. The Schedule history can be checked using the history option as well as logs.

CSV Data Hub - smartlife BI

  1. Click on Logs to see if the run is completed and data source is created in smartlife BI.

CSV Data Hub - smartlife BI

  1. Click Edit DataSource Option to view the created tables.