https://eric.nz/tags/dp-203/ Recent content in dp-203 on Eric's Note https://eric.nz/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E https://eric.nz/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E Hugo -- gohugo.io Sat, 12 Oct 2024 20:58:04 +0000 https://eric.nz/posts/azure-dp-203/ Sat, 12 Oct 2024 20:58:04 +0000 https://eric.nz/posts/azure-dp-203/ Apache Spark Cache data into the memory of local executor Spark Pool Clusters View Active Spark Streams Data Shuffling Azure Cosmos DB NoSQL Database to support API models at planet scale with low latency performance Schema Representation Azure Databricks Key Components Capacity Limits Workspace Security Network & Network Security Azure Databricks Cluster Types Azure Data Factory Azure Data Factory Core Concepts Global parameters Interact with Data Factory using Programming Languages Linked Service Diagnostic Logs Integration Runtime Azure Data Lake Gen2 (ADLS) Staging Area Processing Analytical Data workloads for best Performance Azure Event Hubs Options for an input to Azure Stream Analytics job with low latency and high throughput Azure Storage Storage Account Name Storage Analytics Storage RESTful API Access data in Storage Account with REST API Log every operation in Azure Storage Account activity in real-time Azure Synapse Analytics What is Azure Synapse Analytics?