Google cloud storage options

Posted by Eirik on 4 Mar, 2024

Google cloud provides 5 storage products:

  1. Cloud Storage
  2. Cloud SQL
  3. Cloud Spanner
  4. Firestore
  5. Cloud Bigtable

1. Cloud storage

  • Google’s object storage product.
  • It allows user to store any amount of data and retrieve it as often as needed.
  • Fully managed scalable service that has wide variety of uses. Example: web archival and disaster recovery, website content, direct download. Primary use: Binary large-object storage (BLOB)
  • Online contents: videos and photos
  • Backup and archiving
  • Storage of intermediate results

object storage: store data as object but not as file and folder hierarchy(file storage), or as chunks of a disk(block storage)

  • Stored as binary form of the actual data itself
  • Relevant associated meta-data (date create, author, resource type, permissions)
  • Globally unique identifier These unique keys are in the form of URLs, act well with web technologies!

Cloud storage are organized into buckets, it needs

  1. A globally unique name
  2. Specific geographic location for where should be stored (should consider the minimized latency)

Objects in the buckets are immutable! Versioning are used in the bucket for data updating. But it requires access grant from administer. Version is just like git!

Versioning: cloud storage will keep track of detailed history(record overwrite/delete/intact) of modifications. You can list the archived version of an object, restore the object to an older state

No versioning: new version will always overwrite older versions.

IAM + ACL = System can control the resources they need to do their jobs with security.

  • IAM Roles are inherited from projects for most purposes, cloud IAM is sufficient.

  • ACL If you need finer control, ACL can be created.

    • scope: who can access and perform an action (user or group)
    • permission: what action can be performed (read, write)
  • Cloud storage also have lifecycle policies:

    • Delete objects older than n days
    • Delete obkects before specific date
    • Keep only the n most recent versions (Need versinoing enabled)
  • There are 4 primary storage classes in Cloud storage

  1. Standard Storage: best for hot data, which means frequently access. Or fit for data only store in brief of time.
  2. Nearline Storage: Infrequently access data(e,g. once a month or less)
  3. Coldline Storage: Infrequently access data(e,g. once per 90 days at most)
  4. Archive Storage: Infrequently access data(e,g. once a year or less, low-cost)
Features
  • Unlimited storage (no min object size)
  • Worldwide accessibility and locations
  • Low latency and high durability
  • A uniform experience
  • Geo-redundancy
Autoclass
  • Auto move data to colder storage to reduce cost
  • Auto move data to hotter storage for optimal accesses

Data traveling between customers’ device and storage through HTTPS/TLS

2. Cloud SQL

Cloud SQL offers fully relational databases including MySQL, PostgreSQL and SQL Server as a service

3. Cloud Spanner

4. Firestore

5. Cloud Bigtable