Description
With this manipulator you import tabular CSV data into a notebook.Application
To do any meaningful in a notebook you have to start with a data import. You are likely to start your notebook with this manipulator to import tabular data and start working with it.How to use
The importer dialog consists of three sections as shown in the image below.- Import type option.
- Selected files are displayed here
- Click this button to open a file/folder selection dialog
- Assign a name to the dataset which is created from the imported file(s). All other manipulators are going to refer to the imported dataset via this name.
Import Type
The import type in the top left of the Tabular importer drives the way the File Selection Dialog is configured which opens if you click the button Add/Edit datasets.Files | Select data on a file-by-file basis. This is the default mode. Read here how to select files. |
Folders | Enables to load files according to a file name pattern from a set of folders. This option even lets you import files recursively from a deeper folder structure. How to use the Folders option is explained in depth here. |
Data file requirements
The data files you select will need to follow certain requirements:- File format: CSV
- Decimal sign: dot (.)
- File encoding: utf-8
- Multiple files loaded together must all contain the same columns
Advanced Options
To show the advanced options click on Show/Hide Advanced Options in the bottom right part of the edit dialog. With these options you can control the following parameters:Column Separator |
For Spaces you can use any number of spaces between two columns. |
Header row | Here you can specify which line in your file is the header line with the column names. This settings becomes important if you have a longer header which includes additional meta-data like test-ID, testbench-ID, test operator, … The index is zero-based, meaning the first line in your file is row 0, the second line row 1, and so on. |
Data start row | This option lets you specify in which line your actual data body starts. This option is relevant if you have a longer header and your data line doesn’t start in the second line. Your data section doesn’t have to start in the line after the header; a gap between header and data section can be handled. The data start row also uses zero-based indexing and refers to the literal row number in the file. |
How Blank Rows Are Treated
Blank rows are treated as normal rows and counted in the row index.They are not skipped, collapsed, or automatically removed.
This ensures consistent and reproducible imports, but means you must account for any blank or spacer rows when selecting the header row and data start row.
Column Formatting Limitations
- Column names in notebooks will only contain:
- Letters: a-z
- Underscore: _
- Numbers: 0-9 (except as first character)
- Other characters (whitespaces, parenthesis, quotation marks, semi-colons, commas, curly brackets, equal signs, etc.) are replaced by an underscore when loaded (sanitisation)
- Column names must be unique (case insensitive)
- All letters are lowercased during data processing
- Column names can’t be more than 255 characters