Snowflake SnowPro Core Certification  [draft]

Features and Architecture Snowflake Architecture Snowflake Editions Standard Edition Enterprise Edition Business Critical Edition Virtual Private Snowflake (VPS) Table Types Temporary Table Transient Table Permanent Table External Table Virtual Warehouse Data Spilling Caching Layers Query Result Cache Metadata Cache Warehouse Data Cache Clustering Cache (aka Partition Pruning Efficiency) Key Takeaways Time Travel Fail-safe Important Notes Summary Task Stored Procedure System Tables and Views Resource Monitors Account Access and Security Snowflake Account Roles Privileges Ownership Monitor Privilege Requirements for Common Use Cases Authentication Methods Multi-Factor Authentication (MFA) Federated Authentication (SSO) Network Policy Key Rotation Performance Concepts Scaling Policy Search Optimisation Service (SOS) Table Clustering Depth Materialised View Data Loading and Unloading Upload into Stage Snowflake Stage Internal Stage External Stage Temporary Stage Directory Table in Snowflake Stage COPY INTO Load data into Table Unload data from Table to Stage ON_ERROR Truncating column values PURGE=TRUE INSERT OVERWRITE Snowpipe Data Transformation VARIANT Data Type Clustering Key Automatic Clustering Flatten() Table Clone Privilege APPROX_COUNT_DISTINCT Sampling Data Protection and Data Sharing Data Sharing Row Access Policy External Functions Reference Features and Architecture Snowflake Architecture Snowflake uses a multi-cluster shared data architecture, means...

August 24, 2020 · 21 min · 4397 words · Eric

Snowflake Concepts

Basic Concept Snowflake is a new model cloud-based enterprise-level data warehouse. Architecture Snowflake’s architecture is a hybrid of traditional shared-disk database architectures and shared-nothing databases architectures. Similar to shared-disk architectures, Snowflake uses a central data repository for persisted data that is accessible from all compute nodes in the data warehouse. But similar to shared-nothing architectures, Snowflake processes queries using MPP (massively parallel processing) compute clusters where each node in the cluster stores a portion of the entire dataset locally....

May 13, 2020 · 3 min · 625 words · Eric

Snowflake Common Command Reference

DML Show warehouse with filters 1 SHOW WAREHOUSES like '%testing%'; Show most recent query ID 1 SELECT last_query_id() If you want to retrieve the second most recent query ID, you can also provide -2 argument and do something like 1 SELECT last_query_id(-2) Reference Snowflake: General Reference

May 12, 2020 · 1 min · 46 words · Eric

Snowflake Note IV - Data Ingestion  [draft]

Content

May 10, 2020 · 1 min · word · Eric

7 Best Practices for Snowflake

General Introduction Key customers 7 Best Practices for Building Data Applications Isolation workloads with Snowflake Key features Zero-Copy Clone Time Travel AS OF feature Semi-structured Support add timestamp column Materialized Views Snowflake materialized views is different with other platforms Code in your Language snowflake connection diagnose system SnowPipe Use the Ecosystem Manage Cost Manage compute configure with Auto Suspend configure with Auto Resume configure suspend window after idle time window Monitoring resources all data app utilise resource monitoring FAQ Q: Does Snowflake a transactional database?...

May 5, 2020 · 5 min · 991 words · Eric