Skip to content

Create a source

A source can be created from different origins.

File source

Data can be uploaded directly from a file (CSV, XLSX, …). A source imported in this manner is referred to as a file source. The file source must be encoded in UTF-8, use commas ,, semicolons ; or tab \t as column separators, and start with a single header line, containing the column names.

Attention! Ensure that each row contains the same number of columns.

To create a file source we must upload the relative files in the designated modal: create file source modal upload file example

Table relations

Note that when uploading multiple files, the primary key and the relations between columns should be specified by the user through the configuration stepper.

Column type inference

When uploading a file, the column type will be inferred automatically. Users can manually adjust column types through the configurator stepper.

Size requirements

  • Each file must be less than 100MB in size.
  • Each file must correspond to a single table, except for Excel and OpenOffice formats, where each sheet corresponds to a single table. So the only way to import relational DB file sources is as separate files, which have to be linked manually in the configurator stepper.

File format requirements

Aindo’s platform supports the following formats for file sources:

  • .csv
  • .parquet
  • .tsv
  • .xls
  • .xlsx
  • .xlsm
  • .xlsb
  • .ods
  • .odf
  • .odt

Every file that is not format compliant will be rejected. upload file rejected

Remote database source

A remote database can be used as a source (note that the database must have at least read permissions). Aindo’s platform is compatible with the following database systems:

  • PostgreSQL
  • MySQL
  • MariaDB
  • Google Big Query

database settings source

To verify that you have entered the correct settings, you can use the “Test Connection” button to check if the remote database accepts the connection.

database settings source test

URL source

Data can also be imported through URLs, provided the landing webpage contains a table. To import a table directly from a webpage, click on “Provide the URL to a file” button. The following window will appear. Enter the URL in the text field and click on “Continue”.

url settings source

Configuration steps

The source configurator allows you to review and modify some properties of the imported data.

1. Choose data

The ‘Choose data’ step allows the user to include or exclude tables and/or columns from the data previously uploaded.

1-remove.png 2-add.png

2. Review data types

The ‘Review data types’ step allows the user to change the type of a column, choosing from the ones reviewed in the Supported data types section.

1-change-data-type.png 2-form.png

3. Set primary keys

The ‘Set primary keys’ step allows the user to set and unset primary keys for every table of the data previously uploaded.

1-set-pk.png

4. Set foreign keys

The ‘Set foreign keys’ step allows the user to set and unset foreign keys for every table of the data previously uploaded.

1-set-fk.png 2-form.png

Troubleshooting

If you encounter any issues, here are some common problems and their solutions:

  • File rejection: Ensure your file complies with the format requirements.
  • incorrect Column Types: Use the ‘Review data types’ step to correct any misidentified column type.
  • Missing Data: Check that all rows have the same number of columns.

FAQ

Q: What do I do if my file is larger than 100MB?
A: If you are working on an on-premise deployment, contact Aindo support to help you increase the size limit. If you are working on a cloud deployment, consider migrating the data to a supported database.

Q: Can I upload a file with no headers?
A: Yes you can, but the first row will be inferred as the header row.

Q: Can I use a database as source without ‘read’ permissions?
A: No, ‘read’ permissions are required so that Aindo can access the data for synthesis.