MindMap Gallery Alibaba Cloud database file storage DBFS
Database File Storage (DBFS) is a cloud-native shared file storage service for database scenarios. It is designed based on a shared storage architecture, provides database customization functions through file protocols, and has enterprise-level storage features. It mainly serves self-built databases on the cloud and applications based on traditional storage area networks (SAN), providing users with low-cost, high-performance, and high-availability storage services.
Edited at 2024-01-12 17:50:59One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
Project management is the process of applying specialized knowledge, skills, tools, and methods to project activities so that the project can achieve or exceed the set needs and expectations within the constraints of limited resources. This diagram provides a comprehensive overview of the 8 components of the project management process and can be used as a generic template for direct application.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
Project management is the process of applying specialized knowledge, skills, tools, and methods to project activities so that the project can achieve or exceed the set needs and expectations within the constraints of limited resources. This diagram provides a comprehensive overview of the 8 components of the project management process and can be used as a generic template for direct application.
Alibaba Cloud database file storage DBFS
Product introduction
Database File Storage (DBFS) is a cloud-native shared file storage service for database scenarios. It is designed based on a shared storage architecture, provides database customization functions through file protocols, and has enterprise-level storage features. It mainly serves self-built databases on the cloud and applications based on traditional SAN, providing users with high IO performance and high availability. At the same time, it reduces the complexity and cost of the database's direct block-based architecture (such as the scenario where the database is active, standby, and disaster recovery), and provides capabilities such as IO acceleration, multi-point read and write multi-activity, data backup, and protection. Provide low-cost, high-performance storage solutions and best practices for database businesses such as OLTP, OLAP and NoSQL.
Product Features
Function illustrate Scenes Data customization Users do not need to make additional purchases. POSIX Compatible: Compatible with POSIX file interface. Atomic write: Supports atomic write of DIRECT IO, which needs to be aligned according to 4K, 8K, 16K, 32K, and 64K. User mode: Reduce data copies inside and outside the core to improve performance. Key IO acceleration: Accelerate key IO of the database and increase the number of database transactions per second. Separation of storage and computing: Self-built database realizes the separation of storage and computing, achieving better performance, ease of use, capacity flexibility and cost savings than simply based on cloud disk architecture. MySQL database: Turn off Double Writer Buffer. Online expansion Supports business-friendly online expansion of storage capacity. Users do not need to purchase it separately, it is supported by default. Storage capacity: up to 256TB. Online expansion: Businesses can purchase storage capacity on demand. If business data grows, it can be expanded online in a friendly manner. shared reading and writing A piece of data can be shared and mounted at multiple points for reading and writing, and reading and writing can be expanded linearly. Active and standby high availability: Based on shared storage, it can switch the active and standby databases in seconds without data loss. Multi-active and high availability: databases and application clusters such as Oracle RAC and SAP HANA can be deployed. Write once and read many times: The database can be written once and read many times by integrating the DBFS SDK. Snapshot Supports DBFS snapshot function to realize data backup and recovery. DBFS snapshots are not charged separately, only ECS cloud disk snapshot fees are charged. Data backup: realize database backup through snapshot function. Data recovery: The database can be restored through snapshots, which is used for disaster recovery, test and development environment construction, etc. clone Supports cloning the same DBFS instance based on DBFS snapshot. Environment replication: Create new DBFS instances based on DBFS snapshots to achieve rapid replication of the database environment.
Product advantages
Database file storage DBFS is a file storage launched by Alibaba Cloud for database scenarios. It has made many technical innovations and optimizations in terms of performance, elasticity, high availability, cost and data security. It is suitable for self-built databases on the cloud and provides enterprise-level storage features. Advantages that can be enjoyed by building a database based on DBFS:
Comparative item DBFS cloud disk Shared cloud disk NAS high performance Supports atomic write, user mode, database key IO acceleration, etc. The best solution for databases based on cloud storage, with higher performance than those based solely on cloud disks. Generally built based on ext4, it does not support atomic writes or key IO acceleration of the database. Kernel-mode data copying affects performance. You need to install a third-party commercial cluster file system before you can use it, and you need to purchase a commercial license. For example: Veritas CFS, Oracle ACFS, OCFS2, etc. Does not support atomic writes or database critical IO acceleration. Kernel-mode data copying affects performance. General purpose file storage. The kernel state client does not support atomic writes or database critical IO acceleration. Designed for non-database scenarios. storage The maximum capacity is 256TB. Online expansion friendly. Maximum capacity 32TB. The upper-layer file system needs to support online expansion. Currently, file systems such as ext4 will experience varying degrees of IO hangs when they are expanded online. (IO hang refers to system instability or even downtime caused by certain IOs that take too long during system operation) Maximum capacity 32TB. The upper-layer cluster file system needs to be expanded, which is complex and has a long expansion cycle. Online expansion is not supported. Maximum capacity 1PB. Ease of use Compatible with POSIX file interface, easy to deploy and ready to use. It needs to be manually formatted into a kernel-mode file system such as ext4. The upper cluster file system is complex to build and requires senior experts to deploy and test it. The lead time is long and the cost is high. Client mount. Support online expansion. shared reading and writing Shared high concurrent reading and writing, IO-level data consistency, linear expansion, etc. not support. support. However, it can only be used after deploying an upper-layer third-party commercial cluster file system. support. However, it does not support high concurrent reading and writing of the same file and IO-level data consistency protection. Protocol support POSIX file interface provides the same access method as the local file system. block interface. block interface. NFS, SMB protocol, etc. Some POSIX semantics are not supported. Non-database engine specific protocol.
Application scenarios
Self-built database on the cloud
DBFS has features tailored for database scenarios and is very suitable for cloud users to build their own databases (for example: MySQL, PostgreSQL, etc.) to achieve separation of storage and computing:
Comparative item DBFS local disk Ultimate performance It helps users realize the separation of database storage and calculation, and obtains the best performance benefits for database storage in the cloud. The delay is in the hundreds of microseconds. Low latency. Generally, SSD disks are <100μs. For details, please refer to the ECS local SSD type indicator description. low cost Storage capacity is purchased on demand, supports online expansion, and supports large-capacity storage. Storage capacity cannot be purchased on demand, there is a waste of space, and large-capacity storage is not supported. High reliability Provides high reliability with three copies of the database. Users are required to do primary and secondary replication by themselves. High availability Implement minute-level high-availability switching of databases based on shared storage. RPO=0. Active and backup high availability is based on one copy of data, saving costs. There are two primary and secondary data stores. In the active and standby log replication synchronization mode, the performance of the main database is affected. In asynchronous mode, there is a risk of data loss due to standby database delay. Deployment and switching are complex, and the switching tool needs to be highly available.
Moving traditional databases to the cloud
Traditional databases, such as Oracle/RAC, SAP HANA, etc., are built on SAN. Compared with SAN, DBFS is very suitable for moving traditional SAN to the cloud because it has the following advantages:
Comparative item DBFS Traditional SAN Ease of use After applying for server opening, mount it and use it. The deployment cycle is long and the use is complex, requiring the support of professional storage experts. You need to purchase and deploy a third-party commercial cluster file system before it can be used. operating costs There is no need to worry about issues such as warranty expiration, storage media damage, disk replacement, etc. The price is expensive and the subsequent operating costs are high. storage Supports online expansion, up to 256T. The expansion cycle is long and the process is complex. Online expansion is generally not supported. Data Security Supports data encryption, cloning, etc. Meet the backup, recovery and other needs of database storage. SAN-based data replication technology requires additional costs and is expensive.
Database support instructions
The database and OS versions currently supported and recommended by the database storage service DBFS.
Formal commercial use
List of databases recommended for official commercial use:
MySQL 5.7.x
PostgreSQL 10.x
MongoDB 4.4
Recommended Linux versions for official commercial use:
Alibaba Cloud Linux 2.1903 64-bit
CentOS 8.x 64-bit