CSV Handler details – Quickbase Help

ZenTarget.4.log-793756680.zip
4 KB Download

Use the built-in CSV Handler in pipelines to fetch and process CSV files. The handler is extensible and allows you to process files that are delimited by semicolon, tabs or spaces in addition to commas.

Year,Make,Model,Description,Price
1997,Ford,E350,"ac, abs, moon",3000.00
1999,Chevy,"Venture ""Extended Edition""","",4900.00
1999,Chevy,"Venture ""Extended Edition, Very Large""","",5000.00
1996,Jeep,Grand Cherokee,"MUST SELL!
air, moon roof, loaded",4799.00

This is a built-in channel, it will not count towards the channel entitlement quota

Limits

0.95 MB compressed CSV (the other 0.05 MB are left for Headers field)
10 Minutes time to take fetch

Channel details

CSV Handler is a built-in channel and will not count towards the channel entitlement quota. However there are some limitations when using the steps in this channel:

The CSV values can be read as either a String, Number, or Integer.
There is a 1MB total capacity. This is made up of a maximum of 0.95 MB for the compressed CSV file and 0.05 MB for the Headers, Query Params, and other fields.
A fetch will not continue after 10 minutes

CSV Sources category

Incoming CSV(Trigger step)

Triggers when you make an HTTP request (with a CSV payload) to an auto-generated webhook endpoint.

Receive CSV and protect the endpoint with or without the Authentication schema, or receive using any of the HTTP verbs.

Notes:

Currently the supported authentication methods are JWT Token and Basic Auth (set Username and Password)
We can filter the incoming requests based on the request method type on two different levels - 1st level is very low and it is before even the trigger is activated (system level and can be achieved using the the configuration options), 2nd level is on the design level using the Add conditions and can be used to branch the logic based on the request method type or to skip/drop the received request.

JWT Auth

The Incoming CSV step supports authentication through JWT token.

When the JWT Token option is selected, the user needs to provide a public key and also select a signing algorithm.

Currently, we support the following types of signing algorithms: RS256, RS384, RS512, ES256, ES384, ES512.

The expected public key format is:

-----BEGIN PUBLIC KEY-----
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAu1SU1LfVLPHCozMxH2Mo
...
mwIDAQAB
-----END PUBLIC KEY-----

The pipeline gets triggered upon successful verification of the token. The output of the step includes the JWT payload in the form of an object that can be used in subsequent steps.

If verification fails, the pipeline does NOT get triggered, instead we return response with status code 401 (Unauthorized).

Fetch CSV(Action step)

Use this step to fetch a CSV file or resource from an URL.

Notes:

Supported Authentication methods are 3 types - Basic and Digest Auth and using QB User Token.
File based channels are also supported using the pipelines:// protocol (the link is stored in file_transfer_url field).
Important configuration option is Force Content Encoding - use it when you should deal with unknown CSV content encoding