Database Types

AWS 資料庫類型總覽。

Intro

  • Storing data on disk (EFS, EBS, EC2 Instance Store, S3) can have limits
  • Databases allow you to:
    • Structure the data
    • Build indexes to efficiently query/search
    • Define relationships between datasets

Relational Databases

Relational Databases

NoSQL Databases

  • non-SQL = non-relational databases
  • Built for specific data models with flexible schemas

Benefits

BenefitDescription
FlexibilityEasy to evolve data model
ScalabilityDesigned to scale-out by using distributed clusters
High-PerformanceOptimized for a specific data model
Highly functionalTypes optimized for the data model

Examples

  • Key-Value
  • Document
  • Graph
  • In-memory
  • Search Databases

AWS Database Services

DynamoDB

  • Fully Managed, highly available with replication across 3 AZ
  • NoSQL database (Key-Value)
  • Millions of requests per second, trillions of rows, 100s of TB storage
  • Single-digit millisecond latency
  • DAX (DynamoDB Accelerator) provides 10x performance

ElastiCache

  • Managed Redis or Memcached
  • In-memory databases with high performance, low latency
  • Reduces load off databases for read intensive workloads

RDS

  • Managed DB Service for SQL databases
  • Supports: PostgreSQL, MySQL, MariaDB, Oracle, MS SQL Server, Aurora
  • Automated provisioning, OS patching, backups, monitoring

Aurora

  • AWS proprietary technology
  • Supports PostgreSQL and MySQL
  • 5x performance improvement over MySQL on RDS
  • Storage grows in increments of 10GB, up to 64 TB

Redshift

  • Based on PostgreSQL, but for OLAP (analytics, data warehousing)
  • 10x better performance than other data warehouses
  • Columnar storage, Massively Parallel Query Execution

EMR (Elastic MapReduce)

  • Hadoop clusters for Big Data processing
  • Supports Apache Spark, HBase, Presto, Flink
  • Auto-scaling and Spot instances

Athena

  • Serverless query service for S3
  • Uses standard SQL
  • Supports CSV, JSON, ORC, Avro, Parquet

QuickSight

  • Serverless ML-powered BI service
  • Interactive dashboards
  • Integrated with RDS, Aurora, Athena, Redshift, S3

DocumentDB

  • AWS implementation of MongoDB
  • Similar deployment concepts as Aurora
  • Storage grows in increments of 10GB, up to 64 TB

Neptune

  • Fully managed graph database
  • Use cases: Knowledge Graphs, Fraud Detection, Recommendation Engines, Social Networking

QLDB (Quantum Ledger Database)

  • Immutable system for recording financial transactions
  • Cryptographically verifiable
  • 2-3x better performance than common ledger blockchain frameworks

Amazon Managed Blockchain

  • Join public blockchain networks or create your own
  • Compatible with Hyperledger Fabric & Ethereum

Glue

  • Managed ETL (Extract, Transform, Load) service
  • Fully serverless
Glue ETL

DMS (Database Migration Service)

  • Quickly and securely migrate databases to AWS
  • Source database remains available during migration
  • Supports homogeneous and heterogeneous migrations
Database Migration Service