study-note

Content

SnowSQL For macOS, you can use brew cask to install SnowSQL from command-line 1 brew cask install snowflake-snowsql JDBC Drive Snowflake JDBC maven repo: https://repo1.maven.org/maven2/net/snowflake/snowflake-jdbc/ 1 wget https://repo1.maven.org/maven2/net/snowflake/snowflake-jdbc/3.9.2/snowflake-jdbc-3.9.2.jar Python SDK 1 pip install snowflake-connector-python Spark SDK Snowflake Spark Connector repo: https://github.com/snowflakedb/spark-snowflake

In this note, I am going to create my first Database and table in Snowflake, and load csv data files from AWS S3 into our table. Typical Data Ingestion Process Prepare your files Stage the data Execute COPY command Managing regular loads Loading data from AWS S3 Bucket Step 1: Database and table initialization So first of all, we need to create our database. Here we are creating a new database called OUR_FIRST_DATABASE and our table called OUR_FIRST_TABLE...

General Introduction Basic ideas about Snowflake Separation of storage and compute Built for Cloud environment built from scratch optimized for cloud storage & compute is decoupled Software as a Service No software, infrastructure or upgrade to manage Pay only for used compute & storage Storage & compute charged independently, only for use Scalable Virtual warehouse enable compute scaling Authentication Configuration Resource Management Data Protection Availability Optimization Unique features in Snowflake Time travel Cloning More details can be found at {% post_link snowflake-online-talk ‘Snowflake Online Talk’ %}...