LogoLogo
Daton
Daton
  • Daton Defined: From Web App Essentials to Advanced Integrations
  • Platform
    • Essentials
      • Billing
      • Integrate Facebook Ads on Daton
      • Integrate Shopify on Daton
      • Integrate Google Analytics on Daton
      • Access permissions for Daton
      • How to get started with Daton setup
      • Terminology in Daton
        • Source and Source_Table statuses
      • Various pages in Daton
    • Features
      • Navigating the pages in Daton
        • Notifications
        • Logs
        • Dashboard
        • My Account
        • Connectors
        • My Integrations
        • Integration Details
      • Templates
      • Account Management
        • My Account Page
      • Notifications
      • Monitoring
        • Logging and Log Retention
      • Manage Integrations
        • Handling Changes to Schema
        • Modifying an integration
      • Data
        • Handling Nested Data
        • Daton Metadata
        • Inserts, Updates, and Upserts
        • Data Type Mapping
        • Data Replication in Daton
          • Replication Fields
          • Replication Methods
            • Key-based Incremental Replication
      • Knowledge Base
        • What is ELT and how is it different from traditional ETL tools
          • Billing
      • Pipelines
        • Pipeline Jobs
        • Loading Behavior
      • Security
      • Feature Updates
        • Amazon Vendor Central
  • Connectors
    • Data Sources
      • Advertising
        • Adjust v1
        • Adjust v2
          • About Adjust v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Adjust v2 with Daton
          • Schema Information
        • Amazon Ads
          • Release Notes
        • Amazon Attribution
          • Release Notes
        • Amazon Brand Metrics
          • About Amazon Brand Metrics
          • Essential Attributes and Supported Tables
          • How to Integrate Amazon Brand Metrics with Daton
          • Schema Infomation
        • Amazon DSP V1
          • Release Notes
        • Amazon DSP V2
        • Amazon Marketing Cloud (AMC)
        • Amazon Marketing Streams
          • About Amazon Marketing Streams Connector
          • Essential Attributes
          • How to Integrate Amazon Marketing Streams with Daton
          • Release Notes
        • Amazon Sponsored Brand Ads
          • Release Notes
        • Amazon Sponsored Display Ads
          • Release Notes
        • Amazon Sponsored Product Ads
          • Release Notes
        • Amazon Sponsored TV Ads
        • Bing Ads
          • Release Notes
        • Bol Ads
          • Release Notes
        • Facebook Ads
          • Release Notes
        • Google Ads
          • Release Notes
        • Google My Business
        • Google My Business v2
          • About Google My Business v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Google Business Profile Account with Daton
          • Schema Information
        • Gorgias
        • Gorgias V2
        • HelpScout
        • HelpScout v2
          • About HelpScout Platform
          • Essential Attributes and Supported Tables
          • How to Integrate HelpScout with Daton
          • Schema Information
          • Release Notes
        • Outbrain
          • Release Notes
        • Outbrain v2
          • About Outbrain Platform
          • Essential Attributes & Supported Tables
          • How to Integrate Outbrain v2 with Daton
          • Schema Information
        • Pinterest v2
          • About Pinterest v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pinterest v2 with Daton
          • Schema Information
        • Rakuten
          • About Rakuten Connector
          • Essential Attributes
          • How to Integrate Rakuten with Daton
        • StackAdapt
          • About StackAdapt Platform
          • Essential Attributes and Supported Tables
          • How to Integrate StackAdapt with Daton
          • Schema Information
        • Typeform
          • About Typeform Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Typeform with Daton
          • Schema Information
        • Upscribe
          • Release Notes
        • Upscribe V2
          • About Upscribe Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Upscribe v2 with Daton
          • Schema Information
      • Analytics Platforms
        • Appsflyer
        • GA4
          • About Google Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate GA4 with Daton
          • Schema Information
        • Google Analytics
          • Release Notes
        • Jungle Scout
        • Northbeam
          • About Northbeam Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Northbeam with Daton
          • Schema Information
        • Prodco Analytics
          • About Prodco Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate Prodco Analytics Account with Daton
          • Schema Information
        • Rainforest
          • About Rainforest Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rainforest Account with Daton
          • Schema Information
        • Sprout Social
          • About Sprout Social Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Sprout Social with Daton
          • Schema Information
        • Taboola
        • Taboola v2
          • About Taboola v2
          • Essential Attributes and Supported Tables
          • How to Integrate Taboola v2 with Daton
          • Schema Information
        • Edge by Ascential
      • Business
        • ClickUp
          • About ClickUp Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ClickUp with Daton
          • Schema Information
        • Bubble
        • Pipedrive
          • About Pipedrive Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pipedrive with Daton
          • Schema Information
        • Teamwork
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork with Daton
          • Schema Information
        • Teamwork v2
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork v2 with Daton
          • Schema Information
        • TikTok Business
          • About TikTok Business Connector
          • Essential Attributes and Supported Tables
          • How to Integrate TikTok Business with Daton
          • Schema Information
        • Unbounce v2
          • About Unbounce v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unbounce v2 with Daton
          • Schema Information
      • Call Center
        • Aircall
        • Callpage
        • JustCall
          • About JustCall Connector
          • Essential Attributes and Supported Tables
          • How to Integrate JustCall with Daton
          • Schema Information
      • Databases
        • Amazon Aurora MySQL
          • About Amazon Aurora Platform
          • Essential Attributes
          • How to Integrate Amazon Aurora with Daton
        • Amazon Redshift
          • About Amazon Redshift Platform
          • Essential Attributes
          • How to Integrate Amazon Redshift with Daton
        • GCP MySQL
          • About GCP MySQL Platform
          • Essential Attributes
          • How to Integrate GCP MySQL with Daton
        • GCP PostgreSQL
          • Setup Manual
        • Magento (DB)
          • About Magento Connector
          • Essential Attributes
          • How to Integrate Magento with Daton
        • MySQL
          • Release Notes
        • NetSuite
        • PostgreSQL
          • Release Notes
        • SQLServer
        • WooCommerce SQL
          • About WooCommerce SQL Platform
          • Essential Attributes
          • How to Integrate WooCommerce SQL with Daton
      • Daton Connector
        • Release Notes
      • Ecommerce Platforms
        • Amazon MWS
          • Release Notes
        • Amazon Selling Partner
          • All Report Types and Tables
          • Release Notes
        • Amazon Vendor Central
          • All Report Types and Tables
          • Real Time Reports
          • Daily Reports
          • Weekly Reports
          • Snapshot Reports
          • Monthly Reports
          • Raw Tables
          • Release Notes
        • Bigcommerce
        • BigCommerce v2
          • About BigCommerce Platform
          • Essential Attributes and Supported Tables
          • How to Integrate BigCommerce Account with Daton
          • Schema Information
          • Release Notes
        • Bol Retail v2
          • Release Notes
        • Capillary Martjack
          • Release Notes
        • Kaufland
          • About Kaufland Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Kaufland with Daton
          • Schema Information
        • Keepa
          • About Keepa Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Keepa with Daton
          • Schema Information
        • Lazada
        • Loopreturns
          • Release Notes
        • Magento
          • Release Notes
        • Magento 2 (APIs)
          • Release Notes
        • Mercado Libre
          • About Mercado Libre Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Mercado Libre with Daton
          • Schema Information
        • Shopify
          • Access tokens for Shopify
          • Release Notes
        • Shopify V2
        • Walmart
          • Release Notes
        • Walmart_v2
          • Release Notes
        • WooCommerce
      • Files
        • Amazon S3
          • Release Notes
        • Dropbox
          • Release Notes
        • Email Attachments
          • About Email Attachments Connector
          • Essential Attributes and Connector Guidelines
          • How to Integrate Email Attachments with Daton
        • Google Cloud Storage
          • Release Notes
        • Google Drive
        • Google Sheets
          • Release Notes
        • SFTP (SSH File Transfer Protocol)
      • OMS/WMS
        • Cin7
        • Goflow
          • About Goflow Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Goflow with Daton
          • Schema Information
        • Rippling
          • About Rippling Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rippling with Daton
          • Schema Information
      • Payments
        • PayPal
          • About PayPal Connector
          • Essential Attributes and Supported Tables
          • How to Integrate PayPal with Daton
          • Schema Information
        • Razorpay
          • About Razorpay Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Razorpay with Daton
          • Schema Information
        • Razorpay v1
        • Stripe
      • Productivity Trackers
        • GitLab
          • Release Notes
        • Time Doctor
          • Release Notes
      • SaaS Integrations
        • Aftership
          • Release Notes
        • Aftership V2
        • Anvyl
        • Ascend
        • Awtomic
          • Release Notes
        • Braintree
          • About Braintree Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Braintree Account with Daton
          • Schema Information Braintree
        • Calendly
          • Release Notes
        • Calendly V2
        • Campaign Monitor
        • Capsule CRM
        • Chargebee
        • Freshworks CRM
        • Loop Subscription
        • Commission Junction
        • Constant Contact
        • Copper CRM
          • About Copper
          • Essential Attributes and Supported Tables
          • How to Integrate Copper Account with Daton
          • Schema Information
          • Release Notes
        • Criteo
        • Criteo Retail Media
        • Customer.io
        • DotDigital
        • dotdigital V2
        • Easyecom
        • EasyEcom V2
          • Release Notes
        • ePallet ERP
        • Etsy
        • Exchange Rates
          • About Exchange Rate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Exchange Rates with Daton
          • Schema Information
          • Release Notes
        • Fairing (previously EnquireLabs)
          • Release Notes
        • FreshBooks
          • Release Notes
        • Freshdesk
          • Release Notes
        • Freshsales
          • Release Notes
        • Fulfil
        • Gladly
          • Release Notes
        • Google Search Console
          • Release Notes
        • HubSpot
          • Release Notes
        • HubSpot v2
          • About HubSpot v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate HubSpot v2 with Daton
          • Schema Information
        • Impact
          • Release Notes
        • Infusionsoft (now Keap Max Classic)
          • About Infusionsoft Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Infusionsoft with Daton
          • Schema Information
        • Insightly
        • Intercom
          • Release Notes
        • Intercom V2
          • Release Notes
        • Outbrain V2 (Old)
          • Release Notes
        • Inventory Planner
        • Jira
        • JudgeMe
          • Release Notes
        • Kibo Commerce
        • Klaviyo
          • Release Notes
        • Klaviyo V2
          • Release Notes
        • Kustomer
        • LeadSquared CRM
        • LeadSquared V2
        • LinkedIn Ads
        • LiveChat
        • LoyaltyLion
        • MailChimp
          • Release Notes
        • MNTN
        • Monday
        • NewRelic
        • Okendo Reviews
          • About Okendo Reviews Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Okendo Reviews with Daton
          • Schema Information
        • Optimove
          • Release Notes
        • Pingdom
        • Pinterest
        • Pipedrive
        • PushEngage
        • Quickbase
        • QuickBooks
        • Quickbooks v2
          • About Quickbooks Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Quickbooks v2 with Daton
          • Schema Information
        • Re:amaze
        • ReCharge Payments
          • Release Notes
        • ReCharge Payments v1
          • Setup Manual
          • Schema Information
        • Recharge Payments V2
          • Setup Manual
          • Schema Information
        • Reviewmonitoring
          • Release Notes
        • Salsify
          • Release Notes
        • SendGrid
          • Release Notes
        • Shiphero
        • Shippo
        • Shiprocket
          • Release Notes
        • Shiprocket v2
          • About Shiprocket Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Shiprocket with Daton
          • Schema Information
        • Shipstation
          • Release Notes
        • Skubana
        • SkuVault
          • About SkuVault Connector
          • Essential Attributes and Supported Tables
          • How to Integrate SkuVault with Daton
          • Schema Information
        • Smartrr
        • Smartrr v2
          • About Smartrr Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Smartrr v2 with Daton
          • Schema Information
        • Stamped.io
          • About Stamped.io Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Stamped.io with Daton
          • Schema Information
        • Stamped.io v1
        • Stay AI
        • Sticky.io
        • SugarCRM
          • Release Notes
        • Survey Monkey
        • Tune
        • Unbounce
        • Unicommerce
        • Unicommerce
          • About Unicommerce Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unicommerce with Daton
          • Schema Information
          • Release Notes
        • When I Work
        • Xero
        • Xero V2
          • About Xero Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Xero V2 with Daton
          • Schema Information
        • Yahoo Gemini
        • Yotpo
        • Yotpo v2
          • About Yotpo Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Yotpo v2 with Daton
          • Schema Information
        • Zendesk Chat
        • Zendesk ETL
          • Release Notes
        • Zoho CRM
          • Release Notes
        • ZohoDesk
          • Release Notes
      • Surveys
        • Alchemer
          • About Alchemer Platform
          • Essential Attributes and Supported Tables Alchemer
          • How to Integrate Alchemer Account with Daton
          • Schema Information Alchemer
        • Fairing
          • About Fairing Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Fairing with Daton
          • Schema Information
        • Survicate
          • About Survicate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Survicate with Daton
          • Schema Information
      • Shipping Platforms
        • 3PL Central
        • Byrd
        • Cin7
        • ClickPost
        • Dear
        • Easypost
        • Ohi
          • About Ohi Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Ohi with Daton
          • Schema Information
        • ShipBob
          • About ShipBob Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ShipBob with Daton
          • Schema Information
      • Webhooks
    • Destinations
      • Amazon RDS PostgreSQL
        • Amazon RDS for PostgreSQL Integration with Daton
        • How to Set up RDS PostgreSQL Destination in Daton
      • Amazon RDS MySQL
        • About Integrating Amazon RDS for MySQL database with Daton
        • How to Set up RDS MySQL Destination in Daton
      • Amazon Redshift
        • Querying Daton created tables on RedShift
        • Release Notes
      • Amazon S3
        • Release Notes
      • Azure One Lake
        • About Azure One Lake as a connector in Daton
        • How to Set up an Azure One Lake Database for Integrating with Daton
        • How to Integrate your Azure One Lake Database as a Destination in Daton
      • Azure Data Lake Storage
        • About Azure Data Lake Storage as a connector in Daton
        • How to Set up an Azure Data Lake Storage for Integrating with Daton
        • How to Integrate Your Azure Data Lake Storage Database as a Destination in Daton
      • GCP PostgreSQL
        • About Google Cloud SQL for PostgreSQL Database with Daton
        • How to Set up GCP PostgreSQL Destination in Daton
      • Google BigQuery
        • Release Notes
      • GCS
      • MySQL
        • About Integrating MySQL with Daton
        • How to Set up a MySQL Database for Integrating with Daton
        • How to Set up Your MySQL Database as a Destination in Daton
      • Oracle Autonomous Data Warehouse
      • Snowflake
        • Release Notes
  • FAQs and Troubleshooting
    • Connector permissions and API Keys
      • Access tokens for Shopify
      • Amazon Ads Permissions
      • Where to find my Amazon MWS Merchant Token and Auth Token
      • How to create BigCommerce API Account and generate Client Id, Client Secret and Access tokens
      • How to create Client credentials for Bol Retail
      • How to create Developer application for Mercado Libre
      • How to create API Keys for SendGrid
      • Where to find API Keys for Freshsales
      • Where to find API Keys for Freshdesk
      • How to create REST API Keys for NewRelic
      • How to create API Keys for Chargebee
      • How to generate Access Token for Calendly
      • How to obtain Klaviyo API Key
      • Where to find API Keys for RazorPay
      • How to create API Keys for PushEngage
      • How to create Criteo API User and generate Client Id and Client Secret
      • How to find site-id/domain and create WooCommerce Consumer Key and Secret
    • Authentication Failure while connecting Database using SSH tunnel
    • Common Errors and Resolution
    • FAQs
      • How to get access to FB Ads Business Manager?
      • How to get access to Google Analytics?
      • Querying Daton created child tables for nested data
      • Google Analytics - FAQs
      • How does Lite Plan Work?
      • How do I upgrade my subscription?
      • How does loading behaviour impact billing?
      • What are the tables highlighted with the letter "F"?
      • Amazon Advertising FAQs
      • Amazon Business and Inventory Reports FAQs
      • Why don't I see my data?
      • How exactly do Business Reports work in Daton?
      • Steps to upload your own ASIN and SKU file in Amazon SP connectors
      • What are 'FATAL' and 'CANCELLED' report statuses in Amazon Selling Partner?
      • How to setup Google BigQuery Project
      • Amazon Selling Partner, Vendor Central - Access to resource denied error.
      • VendorSalesReportByManufacturing showing a FATAL report status?
      • How to Enable SSH Tunneling during a Database Source Authentication?
  • New Subscription Plans and Billing
    • Subscription Plans Overview
    • Find Your Perfect Data Integration Fit - Growth and Enterprise Plans Explored
    • Daton's Subscriptions Dashboard: Harness the Power of Your Data
    • How to Select and Subscribe to a Daton Subscription Plan?
    • Subscription Plan Upgrade and Downgrade
    • Changing Billing Cycle
  • Product Insights: Report, Roadmap, and Release Notes
    • Introduction to Product Insights
    • 2023 Recap and 2024 Roadmap
    • Release Notes
Powered by GitBook
On this page
  • Daton Plans
  • Building Blocks for Pricing
  • Free Trial
  • Lite Plan
  • Starter Plan
  • Growth and Business Plan
  • Enterprise Plans
  • Billing FAQ
  • What counts as a source?
  • What counts as an integration?
  • What counts as a replicated row?
  • How does Un-nesting impact billing?
  • How does the Lite plan work?
  • How many integrations are supported in the starter plan?
  • Why is my replicated rows count more than the data at source?
  • Common issues that impact usage
  • How to identify full load/replication tables?
  • What is the default Un-nesting behavior for each destination?
  • Managing and Optimizing Usage

Was this helpful?

  1. Platform
  2. Essentials

Billing

Review this document to understand how Daton Billing works and how various actions can impact billing.

PreviousEssentialsNextIntegrate Facebook Ads on Daton

Last updated 3 years ago

Was this helpful?

Daton Plans

We built Daton to support all your data replication needs or some of it if you already have a data pipeline in place. Our goal is to enable every business to own their data and leverage it for growth. Daton offers one of the most competitive pricing on the market, and we believe our plans reflect the same. For detailed pricing information, refer to the on our website.

Building Blocks for Pricing

Daton's pricing is dependent on many factors, but at the most basic level, they come down to three aspects

  1. How many sources are enabled

  2. How many integrations per source enabled

  3. How much data is replicated

For detailed pricing information and features included, refer to the on our website.

Free Trial

We offer a 14 day free trial for Daton. Users can try all features and connectors during this time and support is available to answer any questions.

Lite Plan

Lite plan is designed for customers who have replication needs for one or two connectors. A customer can only create up to two integrations for a particular source under this plan. It is a pay-per-use plan where customers get charged for the number of active integrations and the rows replicated.

The number of integrations per source in a Lite plan is limited to 2. Users can upgrade to a starter plan if they need more integrations per source and unlock additional capability.

Starter Plan

Starter plan is designed for individual brands. Agencies, Aggregators, and SaaS businesses that have critical data needs are better suited to use our Growth plan to ensure the right kind of features and support are available.

Growth and Business Plan

Growth and business plans are suited for companies that have critical business needs related to data replication, require faster support response times, and have more than 5 integrations per source or higher data volumes. Many additional platform features are available under these plans.

Enterprise Plans

Enterprise plans are designed for customers who want a more predictable spend for their data replication needs, have large volumes of data to process, and require 24 X7 support. Aggregators, SaaS companies, and user platforms are generally a good fit for our enterprise plans.

Billing FAQ

What counts as a source?

Any data source from which data needs to be extracted is considered a source in Daton. For example - Facebook, Shopify etc are considered as a source.

What counts as an integration?

A source can have multiple integrations.

For example, when we consider Shopify as a source, and you have eCommerce sites in Shopify for multiple countries, and you want to replicate data from each Shopify store, then you will set up one integration each for each store in Shopify that you want to replicate data. Each integration will count towards your quota for integrations under the plan.

What counts as a replicated row?

Any row that is appended (inserted) or upserted (updated or overwritten) in the warehouse is considered as a row in Daton.

Daton supports multiple loading mechanisms and users have complete control over this behavior in most sources.

  1. Users can append data

  2. Users can un-nesting data and create child tables in the warehouse

Most common scenarios for replication

  1. A new row is a row that has never been replicated through Daton. This is a common occurrence when you use append mode for loading data.

  2. An updated row is an existing row that has been changed in the warehouse. This is a common occurrence when you use Upserts mode for loading data.

  3. A sub-row or un-nested row is a row that is created from de-nesting nested data structures. Child tables are created and kept up to date and count towards billing.

  4. A copy of an existing row. For example:

    1. Rows in tables that are replicated in full during each replication job or

    2. Rows replicated as a result of resetting Replication Keys or

    3. Rows replicated as a result of resetting loading mode or

    4. Rows replicated as a result of re-loading data for any table.

How does Un-nesting impact billing?

Users have complete granular level control at a column-level in most sources on how to load data into the warehouse. The default behavior is to load data by un-nesting the data up to two levels within the JSON data provided by the source.

If you don't wish for columns in a particular integration, table, or a specific column to be un-nested, then you can use the un-nesting controls in the integration setup pages to control this behavior as per your requirement.

How does the Lite plan work?

An active integration is defined as an integration that was enabled and had more than 1 row of data replicated within a given month.

Scenario 1 - Customer has one active integration and data replicated is less than 1 million.

In this case customer will be charged a total of $20 for the month. $10 for the active integration and $10 for the million rows of data.

Scenario 2 - Customer has one active integration and data replicated is 1.5 million rows.

In this case customer will be charged a total of $30 for the month. $10 for the active integration and $10 for the first million rows of data and $10 for the additional 500k rows processed.

Scenario 3 - Customer has two active integrations and data replicated is less than 1 million.

In this case, customer will be charged a total of $30 for the month. $20 for the two active integrations and $10 for the million rows of data.

How many integrations are supported in the starter plan?

Starter plan offers customers up to 10 sources and up to 5 integrations per source.

Why is my replicated rows count more than the data at source?

You may be surprised by the totals when viewing the number of replicated rows in Daton. You might think to yourself:

How did Daton manage to replicate so many rows when my source doesn't have so many rows and neither my destination!?

Common issues that impact usage

The number of rows Daton replicates is directly impacted by:

  1. The number of tables set to replicate. The more tables that you select, the higher the potential for replicated rows. Select only the tables that you need for your downstream reporting. You can always come back and add more tables by editing your integration

  2. Select the right replication frequency. Users often select a frequency of replication that is not required to support business requirements. We recommend that you evaluate your requirements and set up the frequency based on business needs.

  3. Un-nesting nested columns - Daton unnests data prior to loading in to the data warehouse. If a nested column data is not required to support business requirements, we recommend that you de-select the column from the configuration pages to reduce the number of rows replicated.

How to identify full load/replication tables?

Tables that are loaded in full are marked by a "F" in the UI. Example -

What is the default Un-nesting behavior for each destination?

Warehouse

Default Behaviour

Amazon Redshift

Un-nest up to 2 levels

Google BigQuery

No Un-nesting

Snowflake

Un-nest up to 2 levels

Oracle Autonomous Warehouse

Un-nest up to 2 levels

Amazon S3

Un-nest up to 2 levels

All MySQL

Un-nest up to 2 levels

All PostgreSQL

Un-nest up to 2 levels

Google Cloud Storage

Un-nest up to 2 levels

Managing and Optimizing Usage

While you can change your plan at any time to accommodate your changing data volume needs, below are some ways for reducing your utilization and staying within your plan’s row limits:

Identify integrations with high usage

Daton supports incremental replication for integrations whenever possible. However, there are cases where times when high volume of replication may be unavoidable or may even be necessary. For example:

  • Data contains many nested structures.

  • A source generates large amounts of data

  • A high number of tables using Full Table Replication

  • Integration doesn’t currently support table selection

  • Advertising sources that have to tackle attribution problems

You can navigate to the specific integration and review the usage over a period of time and identify which tables are causing a high volume of replicated rows and take appropriate measures.

Selecting the right replication frequency.

Users often select a frequency of replication that is not required to support business requirements. We recommend that you evaluate your requirements and set up the frequency based on business needs.

Replication Frequency setting applies at the integration level and not at the individual table level. Please bear this in mind when the integration has many tables that can only be replicated in Full with each replication job.

De-select data that is not needed

We often notice that users tend to select all the data available in the source when they set up their integrations. The common reason for it is to gain familiarity with the data. Regardless of what the reason is, we suggest that you periodically review your integrations to evaluate whether the data you are replicating is being used or not.

We suggest that you only select the data (tables and nested columns) that you need to meet your business requirements.

Users can edit the integrations and modify the setups at any time to reign in costs. Most integrations support table and column level selections.

Selecting replication keys for databases

For integrations that support the selection of Replication Keys, we recommend that you select the appropriate keys whenever possible. Not selecting any replication key may result in tables being replicated in full and thereby leading to an increase in the load on the source databases as well are your costs in Daton.

Pause integrations

You can pause an integration while you are trying to figure out how to optimize your setups.

Pausing an integration will prevent additional records from being extracted. If jobs are running when the integration is paused, these jobs will continue for that cycle and rows extracted as a part of these jobs will be counted towards your quota. A new set of jobs will not be triggered once the integration is paused.

This is a common question we get. Remember that row usage in Daton refers to the total number of replicated rows. This means that the number of rows in the source will not always be the same as the number of rows in Daton. To understand what counts as a replicated row, refer to the documentation by .

The Replication Methods used for replicating tables. Tables using Full Table Replication can increase your row usage. . We recommend that you create a separate integration for tables that require full replication with a higher frequency.

For File-based destinations, additional files are created for each nested field.

pricing page
pricing page
Click here for details regarding some scenarios related to the Lite plan.
clicking here
Tables that are replicated in full are marked in the UI by the letter "F'
Refer to this document to understand how to query the parent and child tables created by Daton.
Full Replication Tables