Google Drive

Google Drive ETL connector for data replication

Snapshot

Features	Details
Release Status	Released
Table Selection	No
Column Selection	No
Edit Integration	Yes
Replication Type Selection	No
Authentication Parameters	Google Drive Username Password
Replication Type	Key Based Incremental
Replication Key	File Modified Date
Suggested Replication Frequency	24 hrs

Pre-requisites

1. Ensure that there is at least one file in the required format at the storage location and it has at least 1000 records with valid data. Daton uses this file as sample to auto generate the schema

2. Daton supports only the following DateTime formats. Dates will be processed as Strings if the format is not in the below listed formats

   YYYY-MM-DD HH:MM:SS

3. Each folder must have files in the same format. If files with either a different file format or different file type are present then data extracts will throw exceptions and data would not be processed. Create separate integrations for different file types and file formats

4. Un-check 'Suggestions' from Settings->General. This will help Daton to avoid duplicate file processing

5. Make sure you remove files from 'Trash' as well if there are any deletes from the integrated locations

Integrate Google Drive with Daton

1. Sign-in to Daton

2. Select Google Drive from the list of Integrations

3. Provide Integration Name, and Replication Frequency. Integration name would be used in creating tables for the integration and cannot be changed later

4. Authenticate with your Google Drive username and password

5. Provide the following details for the integration - Folder ID: File Type: We presently support only CSV format Number of Header Rows: We do not support nested headers

6. Review and update column names and datatypes from the auto generated schema mapper

7. Submit the integration

Workflow

1. Integrations would be in Pending state initially and will be moved to Active state as soon as the first job loads data successfully on to the configured warehouse

2. Users would be able to edit/pause/re-activate/delete integration anytime

3. Users can view job status and process logs from the integration details page by clicking on the integration name from the active list

4. Files to be processed would be identified with the modified dates of files. If a few records in an existing file get updated, then entire file would be processed again

5. Files present in sub folders from the selected location would not be processed

6. If new fields are to be added to the files, users must append them to the file, and edit the existing integration in Daton by appending the additional fields for the integration. Daton doesn't support intermittent field additions to a file.

Error Handling

1. If Date format used in files do not fall in the above mentioned list, then they would be processed as strings

2. Datatypes cannot be changed after initiating the integration