LogoLogo
Daton
Daton
  • Daton Defined: From Web App Essentials to Advanced Integrations
  • Platform
    • Essentials
      • Billing
      • Integrate Facebook Ads on Daton
      • Integrate Shopify on Daton
      • Integrate Google Analytics on Daton
      • Access permissions for Daton
      • How to get started with Daton setup
      • Terminology in Daton
        • Source and Source_Table statuses
      • Various pages in Daton
    • Features
      • Navigating the pages in Daton
        • Notifications
        • Logs
        • Dashboard
        • My Account
        • Connectors
        • My Integrations
        • Integration Details
      • Templates
      • Account Management
        • My Account Page
      • Notifications
      • Monitoring
        • Logging and Log Retention
      • Manage Integrations
        • Handling Changes to Schema
        • Modifying an integration
      • Data
        • Handling Nested Data
        • Daton Metadata
        • Inserts, Updates, and Upserts
        • Data Type Mapping
        • Data Replication in Daton
          • Replication Fields
          • Replication Methods
            • Key-based Incremental Replication
      • Knowledge Base
        • What is ELT and how is it different from traditional ETL tools
          • Billing
      • Pipelines
        • Pipeline Jobs
        • Loading Behavior
      • Security
      • Feature Updates
        • Amazon Vendor Central
  • Connectors
    • Data Sources
      • Advertising
        • Adjust v1
        • Adjust v2
          • About Adjust v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Adjust v2 with Daton
          • Schema Information
        • Amazon Ads
          • Release Notes
        • Amazon Attribution
          • Release Notes
        • Amazon Brand Metrics
          • About Amazon Brand Metrics
          • Essential Attributes and Supported Tables
          • How to Integrate Amazon Brand Metrics with Daton
          • Schema Infomation
        • Amazon DSP V1
          • Release Notes
        • Amazon DSP V2
        • Amazon Marketing Cloud (AMC)
        • Amazon Marketing Streams
          • About Amazon Marketing Streams Connector
          • Essential Attributes
          • How to Integrate Amazon Marketing Streams with Daton
          • Release Notes
        • Amazon Sponsored Brand Ads
          • Release Notes
        • Amazon Sponsored Display Ads
          • Release Notes
        • Amazon Sponsored Product Ads
          • Release Notes
        • Amazon Sponsored TV Ads
        • Bing Ads
          • Release Notes
        • Bol Ads
          • Release Notes
        • Facebook Ads
          • Release Notes
        • Google Ads
          • Release Notes
        • Google My Business
        • Google My Business v2
          • About Google My Business v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Google Business Profile Account with Daton
          • Schema Information
        • Gorgias
        • Gorgias V2
        • HelpScout
        • HelpScout v2
          • About HelpScout Platform
          • Essential Attributes and Supported Tables
          • How to Integrate HelpScout with Daton
          • Schema Information
          • Release Notes
        • Outbrain
          • Release Notes
        • Outbrain v2
          • About Outbrain Platform
          • Essential Attributes & Supported Tables
          • How to Integrate Outbrain v2 with Daton
          • Schema Information
        • Pinterest v2
          • About Pinterest v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pinterest v2 with Daton
          • Schema Information
        • Rakuten
          • About Rakuten Connector
          • Essential Attributes
          • How to Integrate Rakuten with Daton
        • StackAdapt
          • About StackAdapt Platform
          • Essential Attributes and Supported Tables
          • How to Integrate StackAdapt with Daton
          • Schema Information
        • Typeform
          • About Typeform Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Typeform with Daton
          • Schema Information
        • Upscribe
          • Release Notes
        • Upscribe V2
          • About Upscribe Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Upscribe v2 with Daton
          • Schema Information
      • Analytics Platforms
        • Appsflyer
        • GA4
          • About Google Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate GA4 with Daton
          • Schema Information
        • Google Analytics
          • Release Notes
        • Jungle Scout
        • Northbeam
          • About Northbeam Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Northbeam with Daton
          • Schema Information
        • Prodco Analytics
          • About Prodco Analytics Platform
          • Essential Attributes and Table Selection
          • How to Integrate Prodco Analytics Account with Daton
          • Schema Information
        • Rainforest
          • About Rainforest Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rainforest Account with Daton
          • Schema Information
        • Sprout Social
          • About Sprout Social Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Sprout Social with Daton
          • Schema Information
        • Taboola
        • Taboola v2
          • About Taboola v2
          • Essential Attributes and Supported Tables
          • How to Integrate Taboola v2 with Daton
          • Schema Information
        • Edge by Ascential
      • Business
        • ClickUp
          • About ClickUp Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ClickUp with Daton
          • Schema Information
        • Bubble
        • Pipedrive
          • About Pipedrive Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Pipedrive with Daton
          • Schema Information
        • Teamwork
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork with Daton
          • Schema Information
        • Teamwork v2
          • About Teamwork Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Teamwork v2 with Daton
          • Schema Information
        • TikTok Business
          • About TikTok Business Connector
          • Essential Attributes and Supported Tables
          • How to Integrate TikTok Business with Daton
          • Schema Information
        • Unbounce v2
          • About Unbounce v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unbounce v2 with Daton
          • Schema Information
      • Call Center
        • Aircall
        • Callpage
        • JustCall
          • About JustCall Connector
          • Essential Attributes and Supported Tables
          • How to Integrate JustCall with Daton
          • Schema Information
      • Databases
        • Amazon Aurora MySQL
          • About Amazon Aurora Platform
          • Essential Attributes
          • How to Integrate Amazon Aurora with Daton
        • Amazon Redshift
          • About Amazon Redshift Platform
          • Essential Attributes
          • How to Integrate Amazon Redshift with Daton
        • GCP MySQL
          • About GCP MySQL Platform
          • Essential Attributes
          • How to Integrate GCP MySQL with Daton
        • GCP PostgreSQL
          • Setup Manual
        • Magento (DB)
          • About Magento Connector
          • Essential Attributes
          • How to Integrate Magento with Daton
        • MySQL
          • Release Notes
        • NetSuite
        • PostgreSQL
          • Release Notes
        • SQLServer
        • WooCommerce SQL
          • About WooCommerce SQL Platform
          • Essential Attributes
          • How to Integrate WooCommerce SQL with Daton
      • Daton Connector
        • Release Notes
      • Ecommerce Platforms
        • Amazon MWS
          • Release Notes
        • Amazon Selling Partner
          • All Report Types and Tables
          • Release Notes
        • Amazon Vendor Central
          • All Report Types and Tables
          • Real Time Reports
          • Daily Reports
          • Weekly Reports
          • Snapshot Reports
          • Monthly Reports
          • Raw Tables
          • Release Notes
        • Bigcommerce
        • BigCommerce v2
          • About BigCommerce Platform
          • Essential Attributes and Supported Tables
          • How to Integrate BigCommerce Account with Daton
          • Schema Information
          • Release Notes
        • Bol Retail v2
          • Release Notes
        • Capillary Martjack
          • Release Notes
        • Kaufland
          • About Kaufland Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Kaufland with Daton
          • Schema Information
        • Keepa
          • About Keepa Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Keepa with Daton
          • Schema Information
        • Lazada
        • Loopreturns
          • Release Notes
        • Magento
          • Release Notes
        • Magento 2 (APIs)
          • Release Notes
        • Mercado Libre
          • About Mercado Libre Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Mercado Libre with Daton
          • Schema Information
        • Shopify
          • Access tokens for Shopify
          • Release Notes
        • Shopify V2
        • Walmart
          • Release Notes
        • Walmart_v2
          • Release Notes
        • WooCommerce
      • Files
        • Amazon S3
          • Release Notes
        • Dropbox
          • Release Notes
        • Email Attachments
          • About Email Attachments Connector
          • Essential Attributes and Connector Guidelines
          • How to Integrate Email Attachments with Daton
        • Google Cloud Storage
          • Release Notes
        • Google Drive
        • Google Sheets
          • Release Notes
        • SFTP (SSH File Transfer Protocol)
      • OMS/WMS
        • Cin7
        • Goflow
          • About Goflow Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Goflow with Daton
          • Schema Information
        • Rippling
          • About Rippling Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Rippling with Daton
          • Schema Information
      • Payments
        • PayPal
          • About PayPal Connector
          • Essential Attributes and Supported Tables
          • How to Integrate PayPal with Daton
          • Schema Information
        • Razorpay
          • About Razorpay Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Razorpay with Daton
          • Schema Information
        • Razorpay v1
        • Stripe
      • Productivity Trackers
        • GitLab
          • Release Notes
        • Time Doctor
          • Release Notes
      • SaaS Integrations
        • Aftership
          • Release Notes
        • Aftership V2
        • Anvyl
        • Ascend
        • Awtomic
          • Release Notes
        • Braintree
          • About Braintree Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Braintree Account with Daton
          • Schema Information Braintree
        • Calendly
          • Release Notes
        • Calendly V2
        • Campaign Monitor
        • Capsule CRM
        • Chargebee
        • Freshworks CRM
        • Loop Subscription
        • Commission Junction
        • Constant Contact
        • Copper CRM
          • About Copper
          • Essential Attributes and Supported Tables
          • How to Integrate Copper Account with Daton
          • Schema Information
          • Release Notes
        • Criteo
        • Criteo Retail Media
        • Customer.io
        • DotDigital
        • dotdigital V2
        • Easyecom
        • EasyEcom V2
          • Release Notes
        • ePallet ERP
        • Etsy
        • Exchange Rates
          • About Exchange Rate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Exchange Rates with Daton
          • Schema Information
          • Release Notes
        • Fairing (previously EnquireLabs)
          • Release Notes
        • FreshBooks
          • Release Notes
        • Freshdesk
          • Release Notes
        • Freshsales
          • Release Notes
        • Fulfil
        • Gladly
          • Release Notes
        • Google Search Console
          • Release Notes
        • HubSpot
          • Release Notes
        • HubSpot v2
          • About HubSpot v2 Connector
          • Essential Attributes and Supported Tables
          • How to Integrate HubSpot v2 with Daton
          • Schema Information
        • Impact
          • Release Notes
        • Infusionsoft (now Keap Max Classic)
          • About Infusionsoft Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Infusionsoft with Daton
          • Schema Information
        • Insightly
        • Intercom
          • Release Notes
        • Intercom V2
          • Release Notes
        • Outbrain V2 (Old)
          • Release Notes
        • Inventory Planner
        • Jira
        • JudgeMe
          • Release Notes
        • Kibo Commerce
        • Klaviyo
          • Release Notes
        • Klaviyo V2
          • Release Notes
        • Kustomer
        • LeadSquared CRM
        • LeadSquared V2
        • LinkedIn Ads
        • LiveChat
        • LoyaltyLion
        • MailChimp
          • Release Notes
        • MNTN
        • Monday
        • NewRelic
        • Okendo Reviews
          • About Okendo Reviews Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Okendo Reviews with Daton
          • Schema Information
        • Optimove
          • Release Notes
        • Pingdom
        • Pinterest
        • Pipedrive
        • PushEngage
        • Quickbase
        • QuickBooks
        • Quickbooks v2
          • About Quickbooks Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Quickbooks v2 with Daton
          • Schema Information
        • Re:amaze
        • ReCharge Payments
          • Release Notes
        • ReCharge Payments v1
          • Setup Manual
          • Schema Information
        • Recharge Payments V2
          • Setup Manual
          • Schema Information
        • Reviewmonitoring
          • Release Notes
        • Salsify
          • Release Notes
        • SendGrid
          • Release Notes
        • Shiphero
        • Shippo
        • Shiprocket
          • Release Notes
        • Shiprocket v2
          • About Shiprocket Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Shiprocket with Daton
          • Schema Information
        • Shipstation
          • Release Notes
        • Skubana
        • SkuVault
          • About SkuVault Connector
          • Essential Attributes and Supported Tables
          • How to Integrate SkuVault with Daton
          • Schema Information
        • Smartrr
        • Smartrr v2
          • About Smartrr Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Smartrr v2 with Daton
          • Schema Information
        • Stamped.io
          • About Stamped.io Platform
          • Essential Attributes and Supported Tables
          • How to Integrate Stamped.io with Daton
          • Schema Information
        • Stamped.io v1
        • Stay AI
        • Sticky.io
        • SugarCRM
          • Release Notes
        • Survey Monkey
        • Tune
        • Unbounce
        • Unicommerce
        • Unicommerce
          • About Unicommerce Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Unicommerce with Daton
          • Schema Information
          • Release Notes
        • When I Work
        • Xero
        • Xero V2
          • About Xero Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Xero V2 with Daton
          • Schema Information
        • Yahoo Gemini
        • Yotpo
        • Yotpo v2
          • About Yotpo Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Yotpo v2 with Daton
          • Schema Information
        • Zendesk Chat
        • Zendesk ETL
          • Release Notes
        • Zoho CRM
          • Release Notes
        • ZohoDesk
          • Release Notes
      • Surveys
        • Alchemer
          • About Alchemer Platform
          • Essential Attributes and Supported Tables Alchemer
          • How to Integrate Alchemer Account with Daton
          • Schema Information Alchemer
        • Fairing
          • About Fairing Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Fairing with Daton
          • Schema Information
        • Survicate
          • About Survicate Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Survicate with Daton
          • Schema Information
      • Shipping Platforms
        • 3PL Central
        • Byrd
        • Cin7
        • ClickPost
        • Dear
        • Easypost
        • Ohi
          • About Ohi Connector
          • Essential Attributes and Supported Tables
          • How to Integrate Ohi with Daton
          • Schema Information
        • ShipBob
          • About ShipBob Connector
          • Essential Attributes and Supported Tables
          • How to Integrate ShipBob with Daton
          • Schema Information
      • Webhooks
    • Destinations
      • Amazon RDS PostgreSQL
        • Amazon RDS for PostgreSQL Integration with Daton
        • How to Set up RDS PostgreSQL Destination in Daton
      • Amazon RDS MySQL
        • About Integrating Amazon RDS for MySQL database with Daton
        • How to Set up RDS MySQL Destination in Daton
      • Amazon Redshift
        • Querying Daton created tables on RedShift
        • Release Notes
      • Amazon S3
        • Release Notes
      • Azure One Lake
        • About Azure One Lake as a connector in Daton
        • How to Set up an Azure One Lake Database for Integrating with Daton
        • How to Integrate your Azure One Lake Database as a Destination in Daton
      • Azure Data Lake Storage
        • About Azure Data Lake Storage as a connector in Daton
        • How to Set up an Azure Data Lake Storage for Integrating with Daton
        • How to Integrate Your Azure Data Lake Storage Database as a Destination in Daton
      • GCP PostgreSQL
        • About Google Cloud SQL for PostgreSQL Database with Daton
        • How to Set up GCP PostgreSQL Destination in Daton
      • Google BigQuery
        • Release Notes
      • GCS
      • MySQL
        • About Integrating MySQL with Daton
        • How to Set up a MySQL Database for Integrating with Daton
        • How to Set up Your MySQL Database as a Destination in Daton
      • Oracle Autonomous Data Warehouse
      • Snowflake
        • Release Notes
  • FAQs and Troubleshooting
    • Connector permissions and API Keys
      • Access tokens for Shopify
      • Amazon Ads Permissions
      • Where to find my Amazon MWS Merchant Token and Auth Token
      • How to create BigCommerce API Account and generate Client Id, Client Secret and Access tokens
      • How to create Client credentials for Bol Retail
      • How to create Developer application for Mercado Libre
      • How to create API Keys for SendGrid
      • Where to find API Keys for Freshsales
      • Where to find API Keys for Freshdesk
      • How to create REST API Keys for NewRelic
      • How to create API Keys for Chargebee
      • How to generate Access Token for Calendly
      • How to obtain Klaviyo API Key
      • Where to find API Keys for RazorPay
      • How to create API Keys for PushEngage
      • How to create Criteo API User and generate Client Id and Client Secret
      • How to find site-id/domain and create WooCommerce Consumer Key and Secret
    • Authentication Failure while connecting Database using SSH tunnel
    • Common Errors and Resolution
    • FAQs
      • How to get access to FB Ads Business Manager?
      • How to get access to Google Analytics?
      • Querying Daton created child tables for nested data
      • Google Analytics - FAQs
      • How does Lite Plan Work?
      • How do I upgrade my subscription?
      • How does loading behaviour impact billing?
      • What are the tables highlighted with the letter "F"?
      • Amazon Advertising FAQs
      • Amazon Business and Inventory Reports FAQs
      • Why don't I see my data?
      • How exactly do Business Reports work in Daton?
      • Steps to upload your own ASIN and SKU file in Amazon SP connectors
      • What are 'FATAL' and 'CANCELLED' report statuses in Amazon Selling Partner?
      • How to setup Google BigQuery Project
      • Amazon Selling Partner, Vendor Central - Access to resource denied error.
      • VendorSalesReportByManufacturing showing a FATAL report status?
      • How to Enable SSH Tunneling during a Database Source Authentication?
  • New Subscription Plans and Billing
    • Subscription Plans Overview
    • Find Your Perfect Data Integration Fit - Growth and Enterprise Plans Explored
    • Daton's Subscriptions Dashboard: Harness the Power of Your Data
    • How to Select and Subscribe to a Daton Subscription Plan?
    • Subscription Plan Upgrade and Downgrade
    • Changing Billing Cycle
  • Product Insights: Report, Roadmap, and Release Notes
    • Introduction to Product Insights
    • 2023 Recap and 2024 Roadmap
    • Release Notes
Powered by GitBook
On this page
  • Steps to configure Amazon S3 destination
  • Pre-Requisites
  • Setups in S3
  • Setups in Daton

Was this helpful?

  1. Connectors
  2. Destinations

Amazon S3

Amazon ETL connector for data replication

PreviousRelease NotesNextRelease Notes

Last updated 1 year ago

Was this helpful?

Steps to configure Amazon S3 destination

Pre-Requisites

  1. Access to Amazon Web Services

  2. Access to Daton to configure the destination

  3. Permissions to manage S3 buckets in AWS

Once the pre-requisites are cleared, follow the steps below to configure S3 as a destination in Daton

Setups in S3

Step1 - Create an S3 Bucket

  • Use the search functionality on your AWS console to easily navigate to the S3 Setup console.

  • Create a Storage Bucket or Use an existing Storage Bucket depending on your requirements

  • Skip to step 3 if you already have a bucket

Enter the bucket name and select the appropriate options to define the bucket parameters according to your organization preference.

Step2 - Granting Bucket Permissions

One the bucket is created, grant permissions to Daton to create and manage files in this bucket.

Edit the bucket policy and add the following JSON to the policy after changing the bucket name to reflect the bucket where you want data loaded.

{
  "Version": "2012-10-17",
  "Id": "",
  "Statement": [
    {
      "Sid": "",
      "Effect": "Allow",
      "Principal": {
        "AWS": [
          "arn:aws:iam::214669062314:role/Warehouse"
        ]
      },
      "Action": [
        "s3:PutObject",
        "s3:GetObject",
        "s3:ListBucket"
        ],
      "Resource": [
        "arn:aws:s3:::<YOUR_BUCKET_NAME>",
        "arn:aws:s3:::<YOUR_BUCKET_NAME>/*"
      ]
    }
  ]
}

Setups in Daton

The steps laid out earlier in the document are a pre-requisite before you start configuring S3 as a destination in Daton.

Enter an integration name to identify the warehouse in Daton.

Enter S3 parameters that will determine how the data will be populated in the S3 buckets.

  1. Select the region in which you have created the bucket.

  2. Enter the bucket name that is going to host the files replicated by Daton

  3. Enter the Object Key Prefix

  4. Currently, we support CSVs, Parquet and JSON for S3 buckets. If you need support for any other format, do write to us at support@sarasanalytics.com

5. Optionally you can add the additional keys to Object key prefix by selecting optional key elements field.

6. The time zone used is UTC.

7. They key would have the following format if all the optional elements are selected: [object_key_prefix]/[integration_name]/[tablename]/[year]/[month]/[day]/[hour]/[timestamp.filetype] If only a combination of elements are selected then the order of optional elements in the key will be in descending order of the time period.

Create an S3 bucket where the data will be loaded
Save the permissions to the bucket