0 - General dbt Fundamentals dbt Developer Hub 1 - Who is an Analytics Engineer? Traditional Data Teams Data Engineers Data Engineers are in charge of building the infrastructure that data is hosted on, usually databases. DE also manage the ETL process to ensure data is where it needs to be, and in tables for Data Analysts to query. Skill set for Data Engineers include SQL, Python, java, other functional programming languages....
What is DataOps? DataOps is a methodology that combines technology, processes, principles, and personnel to automate data orchestration throughout an organization. Data Platform Design Data Model: Kimball Model. Data File Format Comparison: Apache Parquet, Avro, ORC, and Arrow. Open Table Formats: Delta Table, Apache Iceberg, Hudi, and Hive. Data Governance & Management Data Governance and Trust establishes the rules of engagement for the organisation. This includes how data will be managed across roles, responsibilities, decision rights, policies, and standards....