Snowflake

Snowflake ETL connector for data replication

Setting up Snowflake in Daton

Step1 - Whitelisting Daton IPs in Snowflake

Although this step is optional, we highly recommend that you whitelist our IPs to allow Daton to access your Snowflake account securely, you’ll need to create a new network policy or add Daton IP addresses to a network policy that you’ve whitelisted . You can do this using the management console or using SQL.

[Old UI]

• From the Snowflake management console, click Accounts and then Policies

  • Make sure you have ACCOUNTADMIN or SECURITYADMIN privileges

• Click Create a New Network Policy

• Name the policy and then enter the following IP addresses:

  • 35.238.200.205/32

• Click Finish

Creating a network policy in Daton through Snowflake Classic Console

[New UI]

• From the Snowflake management console, click Accounts and then Security

  • Make sure you have ACCOUNTADMIN or SECURITYADMIN privileges

• Click + Network Policy

• Name the policy and then enter the following IP addresses:

  • 35.238.200.205/32

• Click Create Network policy

Creating a network policy in Daton through Snowflake New UI

You can also whitelist Daton IP addresses using SQL

Use the following SQL:

CREATE NETWORK POLICY DATON_WHITELIST 
       ALLOWED_IP_LIST= ('35.238.200.205/32') 
       BLOCKED_IP_LIST= () 
       COMMENT        = ‘DATON_IP_ADDRESSES'
       ;

Step 1.1 Create a new database (Optional)

Create a new database to load the data into Snowflake

Create a new database

Give the database a meaningful name

Step 1.2 Create a new Schema in the Database (Optional)

Create a new schema for Daton to load data and select the Managed access option

Step 1.3 - Issues grants to enable Daton to connect to Snowflake

Please issue the following grants to the chosen Role:

GRANT USAGE ON WAREHOUSE <warehouse_name> TO <RoleName>;
GRANT CREATE SCHEMA, MONITOR, USAGE ON DATABASE <DBName> TO <RoleName>;
GRANT USAGE ON SCHEMA <DBName>.<SchemaName> TO <RoleName>;
GRANT CREATE TABLE ON SCHEMA <DBName>.<SchemaName> to <RoleName>;
GRANT CREATE STAGE ON SCHEMA <DBName>.<SchemaName> to <RoleName>;
GRANT CREATE FILE FORMAT ON SCHEMA <DBName>.<SchemaName> to <RoleName>;

For this instance;

GRANT USAGE ON WAREHOUSE <Snowflake> TO <AccountAdmin>;
GRANT CREATE SCHEMA, MONITOR, USAGE ON DATABASE <StagingArea> TO <AccountAdmin>;
GRANT USAGE ON SCHEMA <StagingArea>.<Raw> TO <AccountAdmin>;
GRANT CREATE TABLE ON SCHEMA <StagingArea>.<Raw> to <AccountAdmin>;
GRANT CREATE STAGE ON SCHEMA <StagingArea>.<Raw> to <AccountAdmin>;
GRANT CREATE FILE FORMAT ON SCHEMA <StagingArea>.<Raw> to <AccountAdmin>;

Step 2 - Enter the integration name

Daton will use the integration name to create tables in the data warehouse.

Step 3 - Enter connection details

Daton scans the warehouse permissions for the users and return a list of data warehouses the user has access to.

Enter Connection Details

Step 4 - Select the warehouse

Daton scans the warehouse permissions for the users and return a list of data warehouses the user has access to.

COMPUTE_WH is the default warehouse created by Snowflake. Select the data warehouse of your choice.

Select a Warehouse

Step 5 - Select the database

In this step, Daton lists databases in the selected warehouse to which the user has access.

Select a database

Step 6 - Select the schema

In this step, Daton lists schemas in the selected databases to which the user has access. Please not that Daton does not creata schema in Snowflake. We recomment to use a dedicated schema for Daton to replicate data.

Select a Schema

That is all you need to do to setup a Snowflake data warehouse on Daton. Continue to configure your sources, sit back, and let Daton take care of the data replication for you.

Reach out to us on [e-mail] if you have any issues.