Blogs-Tapdata-Tapdata

Release Notes

Tapdata Cloud 3.5.1 Release Notes

New Features ① Added new options for Atlas storage when ordering on the international site: Free trial, M10, M20, M30. ② Added support for adding existing Mongo storage when ordering storage on the international site. ③ Introduced a new feature: Master-Slave Merge Nodes. Functional Enhancements ① The documentation for configuring data sources has been updated to include embedded online documentation. ② Provided parameter guidance for connecting to core data sources during connection creation. Resolved Issues: ① Resolved an issue where previously executed tasks were unable to access the run monitoring page.

Sep 08,2023

Notice

Release Notes

Tapdata Cloud 3.4 Release Notes

New Features: ① Guided task creation based on the Data Panel. ② Added a new Dashboard page. ③ Added support for DWS data source as a target. ④ Added an initialization guide for the Real-time Data Center. ⑤ Added domestic B2B payment method. Feature Enhancements: ① Integration of data replication and Data Panel. ② Optimized payment confirmation page. ③ Improved and adjusted the process for creating calculation engines. ④ Enhanced data validation usability. ⑤ Implemented error codes for MongoDB data source. ⑥ Incremental delay indicator on the left side of the runtime monitoring page now uses the Y-axis for task incremental delay alert threshold. ⑦ Enhanced new user onboarding process, added offline deployment guide. ⑧ Improved presentation of sample data. Resolved Issues: ① Fixed the issue where using custom SQL prompts unsupported MongoDB as a target. ② Fixed the problem where if the task’s automatic reset fails after enabling automatic periodic scheduling, it won’t attempt to reset again in the next running cycle and the task won’t be scheduled for execution.

Sep 08,2023

Notice

Release Notes

Tapdata Cloud 3.2.6 Release Notes

New Features: ① Data replication/development tasks now support dynamically adjusting batch parameters based on data record size. ② For full and incremental tasks, added support for scheduled reruns. ③ Implemented the process for free users to upgrade to paid subscriptions. ④ In the add/delete field node, added the ability for automatic sequential adjustment. Resolved Issues: ① Adjusted the recommended task count in the engine specifications to enforce a mandatory task quantity limit.

Sep 08,2023

Notice

All Shipped

Easily replicate data from MySQL to BigQuery

Are you seeking a streamlined approach to enhance your organization’s data management and analytics capabilities? Look no further. This article introduces an excellent solution for replicating data from MySQL to BigQuery, offering a minimalist yet powerful approach to optimize your data integration process. Unlock the Power of Data with BigQuery Data Sync Replicating data from SQL Server to BigQuery can offer several benefits, including: Scalability: BigQuery offers scalable data storage and processing, allowing you to handle large datasets and scale your analytics capabilities. Cost-effectiveness: By replicating data from SQL Server to BigQuery, you can reduce operational costs associated with maintaining and scaling your own infrastructure. Advanced analytics capabilities: BigQuery provides advanced analytics features, empowering you to perform complex tasks like machine learning, predictive modeling, and data exploration. Real-time analytics: Replicating data from SQL Server to BigQuery enables timely analysis and insights with up-to-date data, supporting real-time or near-real-time analytics scenarios. Data consolidation and centralization: Replicating data to BigQuery from multiple SQL Server instances or databases simplifies data management by consolidating and centralizing data in a single location, improving accessibility and facilitating cross-system analysis. Integration with Google Cloud ecosystem: Replicating data from SQL Server to BigQuery seamlessly integrates with other...

Jul 25,2023

Best Practices

All Shipped

Open Source License, Welcome to the Cloud Era

Preface Open source licenses have evolved from the original GPL to GPLv2 and GPLv3, along with Apache, MPL, AGPL, LGPL, etc. But a number of new licenses have emerged in recent years, causing some heated discussions in the community. These new licenses include BSL, SSPL, Elastic, and a special addition called Commons Clause. The community is mainly divided into two camps from the perspective of argument: Fundamentalism and Pragmatism. Fundamentalist followers believe that only those who comply with the 10 principles defined by the Open Source Initiative (OSI) established in 1998 and pass the OSI certification (get OSI-Certified) can be called open source licenses. Pragmatism, starting from the purpose of open source itself, believes that under the condition that the source code is open and the vast majority of community developers can use or contribute without being affected, there is no need to struggle with the literal definition, as long as it can be beneficial to the community. According to the OSI open source License rules, currently, MongoDB using SSPL, Elastic Search and Airbyte using Elastic License V2, CockroachDB using BSL, and Redis with Common Clause, all these famous open source software could not be called “open source software”. So...

Jul 25,2023

Application scenarios

Comparing Methods: Replication from MySQL to MongoDB – Find the Best Approach

Are you struggling to find the best approach for replicating data from MySQL to MongoDB? Look no further! In this blog post, we will dive deep into the world of replication methods, comparing the performance, scalability, data consistency, flexibility, and ecosystem support of both MySQL and MongoDB. Whether you’re a developer, database administrator, or simply curious about the differences between these two popular databases, this comprehensive comparison aims to provide you with all the information you need to make an informed decision. So, let’s explore the world of replication methods and find the best approach for your specific needs! Overview of MySQL and MongoDB Introduction to MySQL MySQL is a widely used open-source relational database management system (RDBMS) that has been around since the mid-1990s. It is known for its stability, scalability, and ease of use, making it a popular choice for many applications and organizations. Key features and strengths of MySQL One of the key features of MySQL is its flexibility. It supports various data types, including numeric, string, date/time, and spatial data types. This allows developers to store and manipulate different types of data efficiently. Another strength of MySQL is its robustness. It can handle large amounts of...

Jul 15,2023

Application scenarios , Data connection method