LogoLogo
Daton
Daton
  • Daton Defined: From Web App Essentials to Advanced Integrations
  • Platform
    • Essentials
      • Billing
      • Integrate Facebook Ads on Daton
      • Integrate Shopify on Daton
      • Integrate Google Analytics on Daton
      • Access permissions for Daton
      • How to get started with Daton setup
      • Terminology in Daton
        • Source and Source_Table statuses
      • Various pages in Daton
    • Features
      • Navigating the pages in Daton
        • Notifications
        • Logs
        • Dashboard
        • My Account
        • Connectors
        • My Integrations
        • Integration Details
      • Templates
      • Account Management
        • My Account Page
      • Notifications
      • Monitoring
        • Logging and Log Retention
      • Manage Integrations
        • Handling Changes to Schema
        • Modifying an integration
      • Data
        • Handling Nested Data
        • Daton Metadata
        • Inserts, Updates, and Upserts
        • Data Type Mapping
        • Data Replication in Daton
          • Replication Fields
          • Replication Methods
            • Key-based Incremental Replication
      • Knowledge Base
        • What is ELT and how is it different from traditional ETL tools
          • Billing
      • Pipelines
        • Pipeline Jobs
        • Loading Behavior
      • Security
      • Feature Updates
        • Amazon Vendor Central
  • Connectors
    • Data Sources
      • Advertising
        • Adjust v1
        • Adjust v2
          • About Adjust v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Adjust v2 with Daton
          • Schema Information
        • Amazon Ads
          • Release Notes
        • Amazon Attribution
          • Release Notes
        • Amazon Brand Metrics
          • About Amazon Brand Metrics
          • Essential Attributes and Supported Tables
          • How to Integrate Amazon Brand Metrics with Daton
          • Schema Infomation
        • Amazon DSP V1
          • Release Notes
        • Amazon DSP V2
        • Amazon Marketing Cloud (AMC)
        • Amazon Marketing Streams
          • About Amazon Marketing Streams Connector
          • Essential Attributes
          • How to Integrate Amazon Marketing Streams with Daton
          • Release Notes
        • Amazon Sponsored Brand Ads
          • Release Notes
        • Amazon Sponsored Display Ads
          • Release Notes
        • Amazon Sponsored Product Ads
          • Release Notes
        • Amazon Sponsored TV Ads
        • Bing Ads
          • Release Notes
        • Bol Ads
          • Release Notes
        • Facebook Ads
          • Release Notes
        • Google Ads
          • Release Notes
        • Google My Business
        • Google My Business v2
          • About Google My Business v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Google Business Profile Account with Daton
          • Schema Information
        • Gorgias
        • Gorgias V2
        • HelpScout
        • HelpScout v2
          • About HelpScout Platform
          • Essential Attributes and Supported Tables
          • How to Integrate HelpScout with Daton
          • Schema Information
          • Release Notes
        • Outbrain
          • Release Notes
        • Outbrain v2
          • About Outbrain Platform
          • Essential Attributes & Supported Tables
          • How to Integrate Outbrain v2 with Daton
          • Schema Information
        • Pinterest v2
          • About Pinterest v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pinterest v2 with Daton
          • Schema Information
        • Rakuten
          • About Rakuten Connector
          • Essential Attributes
          • How to Integrate Rakuten with Daton
        • StackAdapt
          • About StackAdapt Platform
          • Essential Attributes and Supported Tables
          • How to Integrate StackAdapt with Daton
          • Schema Information
        • Typeform
          • About Typeform Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Typeform with Daton
          • Schema Information
        • Upscribe
          • Release Notes
        • Upscribe V2
          • About Upscribe Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Upscribe v2 with Daton
          • Schema Information
      • Analytics Platforms
        • Appsflyer
        • GA4
          • About Google Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate GA4 with Daton
          • Schema Information
        • Google Analytics
          • Release Notes
        • Jungle Scout
        • Northbeam
          • About Northbeam Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Northbeam with Daton
          • Schema Information
        • Prodco Analytics
          • About Prodco Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate Prodco Analytics Account with Daton
          • Schema Information
        • Rainforest
          • About Rainforest Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rainforest Account with Daton
          • Schema Information
        • Sprout Social
          • About Sprout Social Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Sprout Social with Daton
          • Schema Information
        • Taboola
        • Taboola v2
          • About Taboola v2
          • Essential Attributes and Supported Tables
          • How to Integrate Taboola v2 with Daton
          • Schema Information
        • Edge by Ascential
      • Business
        • ClickUp
          • About ClickUp Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ClickUp with Daton
          • Schema Information
        • Bubble
        • Pipedrive
          • About Pipedrive Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pipedrive with Daton
          • Schema Information
        • Teamwork
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork with Daton
          • Schema Information
        • Teamwork v2
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork v2 with Daton
          • Schema Information
        • TikTok Business
          • About TikTok Business Connector
          • Essential Attributes and Supported Tables
          • How to Integrate TikTok Business with Daton
          • Schema Information
        • Unbounce v2
          • About Unbounce v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unbounce v2 with Daton
          • Schema Information
      • Call Center
        • Aircall
        • Callpage
        • JustCall
          • About JustCall Connector
          • Essential Attributes and Supported Tables
          • How to Integrate JustCall with Daton
          • Schema Information
      • Databases
        • Amazon Aurora MySQL
          • About Amazon Aurora Platform
          • Essential Attributes
          • How to Integrate Amazon Aurora with Daton
        • Amazon Redshift
          • About Amazon Redshift Platform
          • Essential Attributes
          • How to Integrate Amazon Redshift with Daton
        • GCP MySQL
          • About GCP MySQL Platform
          • Essential Attributes
          • How to Integrate GCP MySQL with Daton
        • GCP PostgreSQL
          • Setup Manual
        • Magento (DB)
          • About Magento Connector
          • Essential Attributes
          • How to Integrate Magento with Daton
        • MySQL
          • Release Notes
        • NetSuite
        • PostgreSQL
          • Release Notes
        • SQLServer
        • WooCommerce SQL
          • About WooCommerce SQL Platform
          • Essential Attributes
          • How to Integrate WooCommerce SQL with Daton
      • Daton Connector
        • Release Notes
      • Ecommerce Platforms
        • Amazon MWS
          • Release Notes
        • Amazon Selling Partner
          • All Report Types and Tables
          • Release Notes
        • Amazon Vendor Central
          • All Report Types and Tables
          • Real Time Reports
          • Daily Reports
          • Weekly Reports
          • Snapshot Reports
          • Monthly Reports
          • Raw Tables
          • Release Notes
        • Bigcommerce
        • BigCommerce v2
          • About BigCommerce Platform
          • Essential Attributes and Supported Tables
          • How to Integrate BigCommerce Account with Daton
          • Schema Information
          • Release Notes
        • Bol Retail v2
          • Release Notes
        • Capillary Martjack
          • Release Notes
        • Kaufland
          • About Kaufland Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Kaufland with Daton
          • Schema Information
        • Keepa
          • About Keepa Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Keepa with Daton
          • Schema Information
        • Lazada
        • Loopreturns
          • Release Notes
        • Magento
          • Release Notes
        • Magento 2 (APIs)
          • Release Notes
        • Mercado Libre
          • About Mercado Libre Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Mercado Libre with Daton
          • Schema Information
        • Shopify
          • Access tokens for Shopify
          • Release Notes
        • Shopify V2
        • Walmart
          • Release Notes
        • Walmart_v2
          • Release Notes
        • WooCommerce
      • Files
        • Amazon S3
          • Release Notes
        • Dropbox
          • Release Notes
        • Email Attachments
          • About Email Attachments Connector
          • Essential Attributes and Connector Guidelines
          • How to Integrate Email Attachments with Daton
        • Google Cloud Storage
          • Release Notes
        • Google Drive
        • Google Sheets
          • Release Notes
        • SFTP (SSH File Transfer Protocol)
      • OMS/WMS
        • Cin7
        • Goflow
          • About Goflow Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Goflow with Daton
          • Schema Information
        • Rippling
          • About Rippling Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rippling with Daton
          • Schema Information
      • Payments
        • PayPal
          • About PayPal Connector
          • Essential Attributes and Supported Tables
          • How to Integrate PayPal with Daton
          • Schema Information
        • Razorpay
          • About Razorpay Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Razorpay with Daton
          • Schema Information
        • Razorpay v1
        • Stripe
      • Productivity Trackers
        • GitLab
          • Release Notes
        • Time Doctor
          • Release Notes
      • SaaS Integrations
        • Aftership
          • Release Notes
        • Aftership V2
        • Anvyl
        • Ascend
        • Awtomic
          • Release Notes
        • Braintree
          • About Braintree Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Braintree Account with Daton
          • Schema Information Braintree
        • Calendly
          • Release Notes
        • Calendly V2
        • Campaign Monitor
        • Capsule CRM
        • Chargebee
        • Freshworks CRM
        • Loop Subscription
        • Commission Junction
        • Constant Contact
        • Copper CRM
          • About Copper
          • Essential Attributes and Supported Tables
          • How to Integrate Copper Account with Daton
          • Schema Information
          • Release Notes
        • Criteo
        • Criteo Retail Media
        • Customer.io
        • DotDigital
        • dotdigital V2
        • Easyecom
        • EasyEcom V2
          • Release Notes
        • ePallet ERP
        • Etsy
        • Exchange Rates
          • About Exchange Rate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Exchange Rates with Daton
          • Schema Information
          • Release Notes
        • Fairing (previously EnquireLabs)
          • Release Notes
        • FreshBooks
          • Release Notes
        • Freshdesk
          • Release Notes
        • Freshsales
          • Release Notes
        • Fulfil
        • Gladly
          • Release Notes
        • Google Search Console
          • Release Notes
        • HubSpot
          • Release Notes
        • HubSpot v2
          • About HubSpot v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate HubSpot v2 with Daton
          • Schema Information
        • Impact
          • Release Notes
        • Infusionsoft (now Keap Max Classic)
          • About Infusionsoft Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Infusionsoft with Daton
          • Schema Information
        • Insightly
        • Intercom
          • Release Notes
        • Intercom V2
          • Release Notes
        • Outbrain V2 (Old)
          • Release Notes
        • Inventory Planner
        • Jira
        • JudgeMe
          • Release Notes
        • Kibo Commerce
        • Klaviyo
          • Release Notes
        • Klaviyo V2
          • Release Notes
        • Kustomer
        • LeadSquared CRM
        • LeadSquared V2
        • LinkedIn Ads
        • LiveChat
        • LoyaltyLion
        • MailChimp
          • Release Notes
        • MNTN
        • Monday
        • NewRelic
        • Okendo Reviews
          • About Okendo Reviews Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Okendo Reviews with Daton
          • Schema Information
        • Optimove
          • Release Notes
        • Pingdom
        • Pinterest
        • Pipedrive
        • PushEngage
        • Quickbase
        • QuickBooks
        • Quickbooks v2
          • About Quickbooks Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Quickbooks v2 with Daton
          • Schema Information
        • Re:amaze
        • ReCharge Payments
          • Release Notes
        • ReCharge Payments v1
          • Setup Manual
          • Schema Information
        • Recharge Payments V2
          • Setup Manual
          • Schema Information
        • Reviewmonitoring
          • Release Notes
        • Salsify
          • Release Notes
        • SendGrid
          • Release Notes
        • Shiphero
        • Shippo
        • Shiprocket
          • Release Notes
        • Shiprocket v2
          • About Shiprocket Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Shiprocket with Daton
          • Schema Information
        • Shipstation
          • Release Notes
        • Skubana
        • SkuVault
          • About SkuVault Connector
          • Essential Attributes and Supported Tables
          • How to Integrate SkuVault with Daton
          • Schema Information
        • Smartrr
        • Smartrr v2
          • About Smartrr Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Smartrr v2 with Daton
          • Schema Information
        • Stamped.io
          • About Stamped.io Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Stamped.io with Daton
          • Schema Information
        • Stamped.io v1
        • Stay AI
        • Sticky.io
        • SugarCRM
          • Release Notes
        • Survey Monkey
        • Tune
        • Unbounce
        • Unicommerce
        • Unicommerce
          • About Unicommerce Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unicommerce with Daton
          • Schema Information
          • Release Notes
        • When I Work
        • Xero
        • Xero V2
          • About Xero Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Xero V2 with Daton
          • Schema Information
        • Yahoo Gemini
        • Yotpo
        • Yotpo v2
          • About Yotpo Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Yotpo v2 with Daton
          • Schema Information
        • Zendesk Chat
        • Zendesk ETL
          • Release Notes
        • Zoho CRM
          • Release Notes
        • ZohoDesk
          • Release Notes
      • Surveys
        • Alchemer
          • About Alchemer Platform
          • Essential Attributes and Supported Tables Alchemer
          • How to Integrate Alchemer Account with Daton
          • Schema Information Alchemer
        • Fairing
          • About Fairing Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Fairing with Daton
          • Schema Information
        • Survicate
          • About Survicate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Survicate with Daton
          • Schema Information
      • Shipping Platforms
        • 3PL Central
        • Byrd
        • Cin7
        • ClickPost
        • Dear
        • Easypost
        • Ohi
          • About Ohi Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Ohi with Daton
          • Schema Information
        • ShipBob
          • About ShipBob Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ShipBob with Daton
          • Schema Information
      • Webhooks
    • Destinations
      • Amazon RDS PostgreSQL
        • Amazon RDS for PostgreSQL Integration with Daton
        • How to Set up RDS PostgreSQL Destination in Daton
      • Amazon RDS MySQL
        • About Integrating Amazon RDS for MySQL database with Daton
        • How to Set up RDS MySQL Destination in Daton
      • Amazon Redshift
        • Querying Daton created tables on RedShift
        • Release Notes
      • Amazon S3
        • Release Notes
      • Azure One Lake
        • About Azure One Lake as a connector in Daton
        • How to Set up an Azure One Lake Database for Integrating with Daton
        • How to Integrate your Azure One Lake Database as a Destination in Daton
      • Azure Data Lake Storage
        • About Azure Data Lake Storage as a connector in Daton
        • How to Set up an Azure Data Lake Storage for Integrating with Daton
        • How to Integrate Your Azure Data Lake Storage Database as a Destination in Daton
      • GCP PostgreSQL
        • About Google Cloud SQL for PostgreSQL Database with Daton
        • How to Set up GCP PostgreSQL Destination in Daton
      • Google BigQuery
        • Release Notes
      • GCS
      • MySQL
        • About Integrating MySQL with Daton
        • How to Set up a MySQL Database for Integrating with Daton
        • How to Set up Your MySQL Database as a Destination in Daton
      • Oracle Autonomous Data Warehouse
      • Snowflake
        • Release Notes
  • FAQs and Troubleshooting
    • Connector permissions and API Keys
      • Access tokens for Shopify
      • Amazon Ads Permissions
      • Where to find my Amazon MWS Merchant Token and Auth Token
      • How to create BigCommerce API Account and generate Client Id, Client Secret and Access tokens
      • How to create Client credentials for Bol Retail
      • How to create Developer application for Mercado Libre
      • How to create API Keys for SendGrid
      • Where to find API Keys for Freshsales
      • Where to find API Keys for Freshdesk
      • How to create REST API Keys for NewRelic
      • How to create API Keys for Chargebee
      • How to generate Access Token for Calendly
      • How to obtain Klaviyo API Key
      • Where to find API Keys for RazorPay
      • How to create API Keys for PushEngage
      • How to create Criteo API User and generate Client Id and Client Secret
      • How to find site-id/domain and create WooCommerce Consumer Key and Secret
    • Authentication Failure while connecting Database using SSH tunnel
    • Common Errors and Resolution
    • FAQs
      • How to get access to FB Ads Business Manager?
      • How to get access to Google Analytics?
      • Querying Daton created child tables for nested data
      • Google Analytics - FAQs
      • How does Lite Plan Work?
      • How do I upgrade my subscription?
      • How does loading behaviour impact billing?
      • What are the tables highlighted with the letter "F"?
      • Amazon Advertising FAQs
      • Amazon Business and Inventory Reports FAQs
      • Why don't I see my data?
      • How exactly do Business Reports work in Daton?
      • Steps to upload your own ASIN and SKU file in Amazon SP connectors
      • What are 'FATAL' and 'CANCELLED' report statuses in Amazon Selling Partner?
      • How to setup Google BigQuery Project
      • Amazon Selling Partner, Vendor Central - Access to resource denied error.
      • VendorSalesReportByManufacturing showing a FATAL report status?
      • How to Enable SSH Tunneling during a Database Source Authentication?
  • New Subscription Plans and Billing
    • Subscription Plans Overview
    • Find Your Perfect Data Integration Fit - Growth and Enterprise Plans Explored
    • Daton's Subscriptions Dashboard: Harness the Power of Your Data
    • How to Select and Subscribe to a Daton Subscription Plan?
    • Subscription Plan Upgrade and Downgrade
    • Changing Billing Cycle
  • Product Insights: Report, Roadmap, and Release Notes
    • Introduction to Product Insights
    • 2023 Recap and 2024 Roadmap
    • Release Notes
Powered by GitBook
On this page
  • Basics
  • Overages
  • Strategies to Mitigate Overage Charges
  • Visibility into processed rows

Was this helpful?

  1. Platform
  2. Features
  3. Knowledge Base
  4. What is ELT and how is it different from traditional ETL tools

Billing

This section gives you an overview of how you will get billed for Daton usage.

Basics

We have made a conscious attempt to keep Daton billing simple, and easy to track. The most granular element for billing in Daton is the number of rows replicated.

What is considered a replicated row?

  • A newly created row in the destination that has been replicated through Daton.

    • Each row in fully replicated tables

    • Newly created rows in an incrementally loaded table

  • An updated row in the destination

  • A row that has been created through un-nesting nested columns in tables.

    • Un-nested tables are created as sub-tables with the destination.

    • Applicable to certain data warehouses.

  • Rows processed as a result of reload and table setting operations.

Every Daton subscription grants users a limit of replicated rows per month. The number of rows replicated limit resets at the end of every billing cycle, i.e, in a given month, if the number of rows replicated is lower than the limit granted by the subscription, the remaining rows are lost and are not carried forward to the next billing cycle.

Overages

If the row limit for a certain month is breached, integrations continue to function, but an additional overage charge is applied at the end of the billing cycle. Some common occurrences for overages are

  • When new integrations are setup which will perform full loads

  • Fully replicated tables

  • Replicating nested columns.

Strategies to Mitigate Overage Charges

A replication schedule is attached at the source integration level. Any table that is being replicated within that integration will follow the same schedule. There will be instances where certain tables (APIs) within a source only support full replication while some others have replication field based replication. To keep the system lean and billing in check, users can adopt some of the following strategies.

Full vs Incremental load separation

  • Mixing full load only tables with incremental load tables will result in potentially unnecessary loads of full load tables.

  • A recommended approach would be to configure two or more integrations for the same source to handle incremental and full load separately.

Example:

  • Table 1:

    • Can only be replicated fully due to a lack of source system support or lack of a replication field.

    • New rows are added to the table once in a few days.

  • Table 2

    • Can be replicated based on a replication field.

    • 10 rows added to the table every hour.

If both the tables in the example are added as a part of the same integration that is running at a replication frequency of 1 hour, then the number of rows processed at the end of 4 hours will be:

Table 1: 100 + 100 + 100 + 100 Table 2: 100 + 10 + 10 + 10 Total rows processed = 100 4 + 100 + 310 = 530

If both the tables in the example are added as a part of the separate integrations that is running at a replication frequency of 24 hours for Table 1 and 1 hour for table 2, then the number of rows processed at the end of 2 hours will be:

Table 1: 100 ( next load will run after 24 hours) Table 2: 100 + 10 + 10 + 10 Total rows processed = 100 + 100 + 3*10 = 230

As you can see, the number of rows utilized can add up quickly for fully replicated tables and therefore planning your integration setup is important.

SaaS applications

Daton supports a variety of SaaS applications. Most SaaS applications these days support extracting data through REST APIs. However, some SaaS applications like analytics applications, generate more data than other applications like the ones for customer support. Knowing what data to pull from these sources is important to keep replicated rows to an optimal level.

Full Replication:

Certain SaaS applications do not permit extracting incremental data based on a previous stored state. In such cases, only full loads are possible. Please follow the recommended approach above for these type of SaaS integrations as well.

Nested Columns: Quite a few SaaS applications these days use nested columns within tables to store data. For example, Shopify stores order line data in a column within the order header table. When a relational database like Oracle, Postgres or MySQl is used as the destination, Daton attempts to un-nest these nested columns, creates new tables for these columns.

In the shopify example highlighted above, users may choose to unselect the nested column while configuring header table and configure a separate table for order lines.

Pausing integrations and removing tables from integration

Free vs Paid Integrations

Visibility into processed rows

Daton provides three different way for users to track data being processed by the data pipeline. All three views offer different perspectives in the data processed for the account.

Dashboard

Integrations

Integration details comprises of three sections. The section that pertains to billing is the section that highlights the number of rows processed by the most recent job for an integration. Clicking on the details icon include a small screenshot on the integration, takes the user to the details on an integration.

Integration Details

On this screen, users can view the total rows processed for a specific source integration, a list of all the jobs for that source, and other job related data.

PreviousWhat is ELT and how is it different from traditional ETL toolsNextPipelines

Last updated 5 years ago

Was this helpful?

Documentation Please refer to our before embarking on setting up an integration to understand how the SaaS application integration works and how different tables are replicated.

functionality allows users to unselect tables in the integration that are no longer being leveraged so that replication no longer happens for these tables. Please make the changes only after you have sufficiently determined that no one downstream is dependent on the table that you are unselecting from the integration.

will immediately signal Daton to no longer run any pipeline jobs pertaining to that integration. If you pause the integration while a job for that integration is currently running, that job will not be impact and those rows will be counted toward the monthly quota. It is not a common practice to pause any integration but is an option that can be considered if necessary.

In addition to the number of rows replicated per month, users could also be charged an additional fee over the base subscription price if they subscribe to certain paid integrations. At this point in time, all paid integrations are custom in nature, so please if you have any specific needs,, and we would be happy to engage.

Our dashboard gives you access to the summary of data processed by Daton. More details on the charts and graphs in the dashboard can be found

SaaS documentation
Edit integration
Pausing an integration
reach out to us
here