certification

01 - Modeling Data Management Solutions Bronze Ingestion Patterns Ingestion Patterns Singleplex: One-to-One mapping of source datasets to bronze tables. Multiplex: Many-to-One mapping, i.e. many datasets are mapped to one bronze table. Singleplex is the traditional ingestion model where each data source or topic is ingested separately. Singleplex usually works well for batch processing. However, for streaming processing of large datasets, if you have many streaming jobs, one per topic, you will hit the maximum limit of concurrent jobs in your workspace....

General Databricks Certified Data Engineer Professional: link Time allotted to complex exam is 2 hours (120 minutes) Exam fee $200 USD Number of questions 60 Question type: multiple choice questions Passing scores is at least 70% on the overall exam Code Example data manipulation code will be in SQL when possible Structured Streaming code will be in Python Runtime version is DBR 10.4 LTS Practice Exam: link Target Audience Data Engineer, >= 2yoe Advanced, practitioner certification Assess candidates at a level equivalent to two or more years with data engineering with Databricks Expectation Understanding of the Databricks platform and developer tools Ability to build optimised and cleaned data processing pipelines using the Spark and Delta Lake APIs Ability to model data into a Lakehouse using knowledge of general data modeling concepts Ability to make data pipelines secure, reliable, monitored, and tested before deployment Out of Scope The following is not expected of a Professional-level data engineer:...

Features and Architecture Snowflake Architecture Snowflake Editions Standard Edition Enterprise Edition Business Critical Edition Virtual Private Snowflake (VPS) Table Types Temporary Table Transient Table Permanent Table External Table Virtual Warehouse Data Spilling Caching Layers Query Result Cache Metadata Cache Warehouse Data Cache Clustering Cache (aka Partition Pruning Efficiency) Key Takeaways Time Travel Fail-safe Important Notes Summary Task Stored Procedure System Tables and Views Resource Monitors Account Access and Security Snowflake Account Roles Privileges Ownership Monitor Privilege Requirements for Common Use Cases Authentication Methods Multi-Factor Authentication (MFA) Federated Authentication (SSO) Network Policy Key Rotation Performance Concepts Scaling Policy Search Optimisation Service (SOS) Table Clustering Depth Materialised View Data Loading and Unloading Upload into Stage Snowflake Stage Internal Stage External Stage Temporary Stage Directory Table in Snowflake Stage COPY INTO Load data into Table Unload data from Table to Stage ON_ERROR Truncating column values PURGE=TRUE INSERT OVERWRITE Snowpipe Data Transformation VARIANT Data Type Clustering Key Automatic Clustering Flatten() Table Clone Privilege APPROX_COUNT_DISTINCT Sampling Data Protection and Data Sharing Data Sharing Row Access Policy External Functions Reference Features and Architecture Snowflake Architecture Snowflake uses a multi-cluster shared data architecture, means...

https://cloud.google.com/certification/guides/machine-learning-engineer Round out your skills with training

Billing and Cost Management User-Defined Cost Allocation Tags User-defined tags are tags that you define, create and apply to resources.After you have create and applied them, you can activate them on the Billing and Cost Management console for cost allocation tracking. The detailed steps are: Log in to the AWS Management Console of the new account Use the Tag Editor to create the new user-defined tags Use the Cost Allocation Tag manager in the payer account to mark the tags as cost allocation tags Certificate Manager (ACM) When you request a public certificate, AWS Certificate Manager (ACM) generates a public/private key pair...