Sep 03, 2019

Improved Support for Replacing or Appending Data

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates.
Javier Álvarez Medina
Co-founder

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates. We understand data as something that evolves and changes over time, therefore our product must treat data like that: as something that is alive.

Whenever you build a data pipe in Tinybird Analytics, your transformation nodes will always remain connected to the Data Sources they use. As soon as those Data Sources change, all their related transformation nodes will be recalculated in real-time. No delays.

Also, we’ve taken care of implementing everything needed to ensure your APIs keep performing in real-time as new data gets ingested. You will not need to worry about how and when you should be updating your data.

Although our API already supported appending data to an existing Data Source or replacing it entirely, during the last week we’ve added support for both replacing and appending data in our User Interface.

Append or replace data to an existing Data Source
Append or replace data to an existing Data Source

As you can see in the gif above, whenever Tinybird Analytics detects you are trying to import a Data Source with a name that already exists in your account, the advanced data import options are shown.

In case you need to append data to an existing Data Source directly, we’ve enabled a shortcut to do exactly that; you can find it in the Data Source modal window, as you can see in the image below.

Append data to a Data Source
Append data to a Data Source

Take a look at our documentation and let us know what you think, or sign up for early access to Tinybird (we’re gradually opening up early access to companies and developers).

Do you like this post?

Related posts

A big performance boost, adding columns and more
Tinybird
Team
May 31, 2021
Tiny Updates: Drag and Drop to Rearrange Nodes in a Pipe
DataOps: 10 principles to develop data intensive projects
Changelog: Snowflake connector, cancellable jobs and more
Tinybird
Team
Mar 23, 2021
Tinybird Changelog: New User Experience for Data Exploration
A new way to create intermediate Data Sources in Tinybird
Tinybird
Team
Jun 15, 2023
Ship data as you ship code: Deploy changes with a single command
Iterating terabyte-sized ClickHouse®️ tables in production
Iterating terabyte-sized ClickHouse®️ tables in production
Changelog: Revamping the API endpoints workflow and boosting your productivity

Build fast data products, faster.

Try Tinybird and bring your data sources together and enable engineers to build with data in minutes. No credit card required, free to get started.
Need more? Contact sales for Enterprise support.