https://eric.nz/tags/azure/ Recent content in azure on Eric's Note https://eric.nz/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E https://eric.nz/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E Hugo -- gohugo.io Tue, 12 Nov 2024 10:58:14 +0000 https://eric.nz/posts/azure-az-305/ Tue, 12 Nov 2024 10:58:14 +0000 https://eric.nz/posts/azure-az-305/ Authentication & Authorisation Let Pre-authenticated user to access application via Entra ID Privileged Identity Management (PIM) Enable Principle of Least Possible Privilege, Just-in-Time access, and periodic review access Monitoring and Alerting Receive alerts based on conditions met in the application Logging Correlate Azure Resources Usage and Performance data Miscellaneous Azure Bicep Authentication & Authorisation Let Pre-authenticated user to access application via Entra ID Entra ID Enterprise Application. This would be most suitable solution to meet the requirement of pre-authenticating users using their Entra ID accounts. https://eric.nz/posts/azure-dp-100/ Fri, 25 Oct 2024 17:45:21 +0000 https://eric.nz/posts/azure-dp-100/ Azure Machine Learning HyperDrive Overview How HyperDrive Works HyperDrive Search Algorithms Model Interpretability Ensure version control and tracking all experiments for a team Increase Model Training Speed Effectively Manage Computational Resources Consume a large dataset stored in Azure Data Lake for Machine Learning model training Ensure Model does not exhibit bias based on feature Azure Machine Learning Designer Overview Missing required Python packages in Azure Machine Learning Designer Azure Monitor Application Insights Model Evaluation Methods Confusion Matrix Recall Precision Accuracy F1-Score ROC AUC Miscellaneous Model Deployment within Constrained Environment One-Hot Encoding Initial run with Minimal Resources Azure Blob Storage vs Azure Data Lake Storage Azure Machine Learning HyperDrive Overview HyperDrive in Azure Machine Learning is a tool used for hyperparameter tuning. https://eric.nz/posts/azure-ai-102/ Thu, 17 Oct 2024 16:39:04 +0000 https://eric.nz/posts/azure-ai-102/ Azure OpenAI Terms Authentication with Azure OpenAI APIs Connect to app based on OpenAI Resource Connect to OpenAI app via OpenAI SDK Prevent Hate Speech OpenAI RESTful APIs OpenAI Model Settings Token Types OpenAI Cost Model Common OpenAI SDK methods Improve the quality of responses from OpenAI-backed Chatbot with minimal efforts Improve the accuracy of Chatbot response for similar questions Create OpenAI based marketing press release app Azure AI Search Glossary Stages for AI Enrichment Types of projections and Usage Key Types Have compromised key and want to prevent unauthorised access to Search Endpoint Have throttled request for AI Search Implement autocompletion with Cognitive Search Azure AI Services Improve reading experience for dyslexia Different types of content display in Chatbot Azure Cognitive Services Overview Provision Cognitive Services with Azure CLI Deploy a containerised Cognitive Services service for Sentiment Analysis Configure your App to connect to Cognitive Services service with minimal administrative effort Ensure Cognitive Services based Chatbot recognise your company’s products and codename Content Safety Optimise content filter configurations for objectionable content Monitor Online Activity Protected Material Detection Speech Types of Speech Services Optimise the text-to-speech sound quality for poor network conditions Enable Speech Capability for a Chatbot Document Intelligence What is Document Intelligence Translate files from German to French with custom glossary Deploy Document Intelligence resource in an ARM template Extract Information from Scanned document with minimal development efforts Pre-built models in Document Intelligence Threshold of Confidence score in Document Intelligence Vision Analyse image with Vision SDK Compute Vision API vs Custom Vision API Computer Vision vs Document Intelligence Custom Vision Overview Steps to build and train a custom classification model Face Increase the likelihood to detect faces in blurred images and sideways faces Translate Common Translate API Endpoints Service Endpoint for Translate Language Minimise similar utterances from input Use container on the host computer from Language Understanding (LUIS) Ensure only specific Azure processes can access Language Service Common Packages and its usage scenarios Entity Extraction Key Phrase Extraction Video Indexer Best way to index a 20GB Video file with Azure Video Indexer Miscellaneous Only specific resources to access Azure AI Services Identify unusual values in Time Series Detect when a user ask questions via Video and Audio Azure OpenAI Terms Frequency penalty parameter. https://eric.nz/posts/azure-dp-203/ Sat, 12 Oct 2024 20:58:04 +0000 https://eric.nz/posts/azure-dp-203/ Apache Spark Cache data into the memory of local executor Spark Pool Clusters View Active Spark Streams Data Shuffling Azure Cosmos DB NoSQL Database to support API models at planet scale with low latency performance Schema Representation Azure Databricks Key Components Capacity Limits Workspace Security Network & Network Security Azure Databricks Cluster Types Azure Data Factory Azure Data Factory Core Concepts Global parameters Interact with Data Factory using Programming Languages Linked Service Diagnostic Logs Integration Runtime Azure Data Lake Gen2 (ADLS) Staging Area Processing Analytical Data workloads for best Performance Azure Event Hubs Options for an input to Azure Stream Analytics job with low latency and high throughput Azure Storage Storage Account Name Storage Analytics Storage RESTful API Access data in Storage Account with REST API Log every operation in Azure Storage Account activity in real-time Azure Synapse Analytics What is Azure Synapse Analytics? https://eric.nz/posts/azure-dp-600/ Thu, 03 Oct 2024 21:45:31 +0000 https://eric.nz/posts/azure-dp-600/ Fabric Terms Capacity Lakehouse Managed Table Lakehouse Shortcut Lakehouse View Power BI DAX Formatter Power BI Model Explorer Power BI Tabular Editor (Best Practice Analyser) Tabular Editor Tenant Subscription Developer can deploy in Dev Test Workspace and view Prod Workspace Fabric Configuration Enable read-write access to dataset stored in Fabric via XMLA Endpoint Create and Publish custom Direct Lake semantic model using External Tools Lakehouse Handle frequent schema change in Copy Activity Convert Lakehouse files from CSV to Delta format for Power BI Reporting SQL Analytics Endpoint Performance Optimisation - Lots of useless logs, lots of small files Query S3 data with SQL Endpoint Prevent new tables been added to Lakehouse automatically Query data from multiple tables in different Lakehouses without copying data Data Factory Lookup Activity Pass values across multiple steps in Data Factory Pipeline Power BI Query Folding Incremental Refresh XMLA Endpoint Power BI Mode Display all rows including duplicates in PowerBI visual Distinct Count vs Unique Count in PowerQuery Calculate Duplicated Rows in PowerQuery Power BI File Formats Reduce Query Execution time for visuals on all pages on top of large dataset Incremental Refresh fails in Power BI report Semantic Model Enable Scale-out for a Semantic Model Analyse frequently used columns in memory Performance Optimisation Prevent implicit measures Identify Surrogate key column for SCD Type 2 table in Semantic Model Ensure user always use Direct Lake mode with semantic model PySpark Large dataset join a small dataset Necessary fields for Slow Change Dimension (SCD) Type2 Filver vs KeepFilters Table Maintenance Operations Miscellaneous Get maximum value of a column with PowerQuery Microsoft Fabric Capacity Metrics App Dynamic Management View (DMV) Fabric Terms Capacity Lakehouse Managed Table A managed table is a physical table that stores data in a Lakehouse. https://eric.nz/posts/azure-fundamentals-genai/ Wed, 31 Jul 2024 17:21:07 +0000 https://eric.nz/posts/azure-fundamentals-genai/ Generative AI describes a category of capabilities within AI that create original content. GenAI applications are powered by Language Models, which are specialised type of machine learning models that you can use to perform natural language processing (NLP) tasks, including: determining sentiment or otherwise classifying natural language text. summarising text. comparing multiple text sources for semantic similarity. generating new natural language. Consider the following ways you can improve the response a copilot provides: https://eric.nz/posts/azure-fundamentals-part-i/ Fri, 26 Jul 2024 22:57:10 +0000 https://eric.nz/posts/azure-fundamentals-part-i/ Describe Cloud Computing Introduction to Cloud Computing Describe the Shared Responsibility Model Define Cloud Model Describe the Consumption-Based Model Describe the Benefits of Using Cloud Services Describe the Benefits of High Availability & Scalability in the Cloud Describe the Benefits of Reliability & Predictability in the Cloud Describe the Benefits of Security & Governance in the Cloud Describe the Benefits of Manageability in the Cloud Describe Cloud Service Types Describe Infrastructure as a Service (IaaS) Describe Platform as a Service (PaaS) Describe Software as a Service (SaaS) Reference Describe Cloud Computing Introduction to Cloud Computing What is Cloud Computing? https://eric.nz/posts/azure-fundamentals-part-ii/ Wed, 24 Jul 2024 10:58:14 +0000 https://eric.nz/posts/azure-fundamentals-part-ii/ Describe the Core Architectural Components of Azure What is Microsoft Azure? Get started with Azure Accounts Describe Azure Physical Infrastructure Describe Azure Management Infrastructure Describe Azure Compute and Networking Services Describe Azure Virtual Machines Describe Azure Virtual Desktop Describe Azure Containers Describe Azure Functions Describe Application Host Options Describe Virtual Networking Describe Azure Virtual Private Networks Describe Azure ExpressRoute Describe Azure DNS Describe Azure Storage Services Describe Azure Storage Accounts Describe Azure Storage Redundancy Describe Azure Storage services Identify Azure data migration options Identify Azure file movement options Describe Azure Identity, Access and Security Describe Azure directory services Describe Azure authentication methods Describe Azure external identities Describe Azure conditional access Describe Azure Role-Based Access Control (RBAC) Describe zero trust model Describe defense-in-depth Describe Microsoft Defender for Cloud Reference Describe the Core Architectural Components of Azure What is Microsoft Azure? https://eric.nz/posts/azure-fundamentals-part-iii/ Wed, 24 Jul 2024 10:58:14 +0000 https://eric.nz/posts/azure-fundamentals-part-iii/ Describe Cost Management in Azure Describe Factors that Can Affect Costs in Azure Compare the Pricing and Total Cost of Ownership calculators Describe the purpose of tags Describe Features and Tools in Azure for Governance and Compliance Describe the purpose of Microsoft Purview Describe the purpose of Azure Policy Describe the purpose of Resource Locks Describe the purpose of the Service Trust portal Describe Features and Tools for Managing and Deploying Azure Resources Describe the Azure Portal Describe Azure Cloud Shell, including Azure CLI and Azure PowerShell Describe the purpose of Azure Arc Describe Azure Resource Manager (ARM), ARM Templates, and Bicep Describe Monitoring Tools in Azure Describe the Purpose of Azure Advisor Describe Azure Service Health Describe Azure Monitor, including Azure Log Analytics, Azure Monitor Alerts, and Application Insights Reference Describe Cost Management in Azure Describe Factors that Can Affect Costs in Azure Azure Shifts development costs from CapEx of building out and maintaining infrastructure and facilities, to an OpEx of renting infrastructure as you need it. https://eric.nz/posts/azure-az-900/ Wed, 24 Jul 2024 10:58:14 +0000 https://eric.nz/posts/azure-az-900/ General Azure Fundamentals: link Passing Grade: 700/1000 Questions: 35 ~ 50 Questions no penalty for wrong answers Multiple Choice Multiple Answer Drag and Drop Yes and No Duration: 45 mins Microsoft Fundamentals certifications such as AZ-900 or MS-900 do no expires, as long as the technology is still available or relevant. Exam Topics Cloud Concepts (25% ~ 30%). 13-15 questions Azure Architecture & Services (35% ~ 40%). 16-18 questions Azure Management & Governance (30% ~ 35%).