CSV Transformation

The OneCloud BizApp for CSV Transformation enables the preparation of data prior to loading into target systems. Using CSV Transformation allows tabular data to be massaged into the required format, by splitting data sets based upon content in a record, rules-based filtering, and combining datasets from multiple sources.

For documentation on all available commands, see the CSV Transformation Command Reference.

OneCloud CSV Transformation Quick Start

Get first-hand experience with OneCloud's transformation capabilities, by visiting the OneCloud Transformations Quick Start.

Connection Setup

To enable OneCloud to perform CSV transformation, you'll need to navigate to the connection manager to create a connection.

From here, choose OneCloud CSV from the service drop-down and select the appropriate Runner.

Connection Example

Common Issues

Wrong Delimiter

When configuring a transformation command, often the wrong delimiter is set and the transformation does not execute as expected.

Not a proper CSV

If the tabular data set is not proper CSV, the OneCloud transformation command simply will not execute as OneCloud will check to see if the format is compliant with RFC 4180 before processing the input. A proper CSV:

  • Has data stored in plain text using a character set such as ASCII, various Unicode character sets (e.g. UTF-8), EBCDIC, or Shift JIS
  • Consists of records with one record per line with the records divided into fields separated by delimiters (typically a single reserved character such as a comma, semicolon, or tab; sometimes the delimiter may include optional spaces)
  • Has the same sequence of fields for every record
  • Is typically a flat file or relational data report output

Inconsistent number of columns in each record

If records in a tabular dataset have different column counts, then OneCloud will detect that it is not a proper CSV

Different Column Counts

Combining two proper CSV tabular data sets with different column counts will simply not work and the Stack Files command will display an error.

CSV Transformation

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.