The OneCloud BizApp for CSV Transformation enables the preparation of data prior to loading into target systems. Using CSV Transformation allows tabular data to be massaged into the required format, by splitting data sets based upon content in a record, rules-based filtering, and combining datasets from multiple sources.
For documentation on all available commands, see the CSV Transformation Command Reference.
OneCloud CSV Transformation Quick Start
Get first-hand experience with OneCloud's transformation capabilities, by visiting the OneCloud Transformations Quick Start.
To enable OneCloud to perform CSV transformation, you'll need to navigate to the connection manager to create a connection.
From here, choose OneCloud CSV from the service drop-down and select the appropriate Runner.
When configuring a transformation command, often the wrong delimiter is set and the transformation does not execute as expected.
If the tabular data set is not proper CSV, the OneCloud transformation command simply will not execute as OneCloud will check to see if the format is compliant with RFC 4180 before processing the input. A proper CSV:
- Has data stored in plain text using a character set such as ASCII, various Unicode character sets (e.g. UTF-8), EBCDIC, or Shift JIS
- Consists of records with one record per line with the records divided into fields separated by delimiters (typically a single reserved character such as a comma, semicolon, or tab; sometimes the delimiter may include optional spaces)
- Has the same sequence of fields for every record
- Is typically a flat file or relational data report output
If records in a tabular dataset have different column counts, then OneCloud will detect that it is not a proper CSV
Combining two proper CSV tabular data sets with different column counts will simply not work and the Stack Files command will display an error.