Azure Solution Architect Expert

Authentication & Authorisation Let Pre-authenticated user to access application via Entra ID Privileged Identity Management (PIM) Enable Principle of Least Possible Privilege, Just-in-Time access, and periodic review access Monitoring and Alerting Receive alerts based on conditions met in the application Logging Correlate Azure Resources Usage and Performance data Miscellaneous Azure Bicep Authentication & Authorisation Let Pre-authenticated user to access application via Entra ID Entra ID Enterprise Application. This would be most suitable solution to meet the requirement of pre-authenticating users using their Entra ID accounts....

November 12, 2024 · 3 min · 628 words · Eric

Azure Data Scientist Associate  [draft]

Azure Machine Learning HyperDrive Overview How HyperDrive Works HyperDrive Search Algorithms Model Interpretability Ensure version control and tracking all experiments for a team Increase Model Training Speed Effectively Manage Computational Resources Consume a large dataset stored in Azure Data Lake for Machine Learning model training Ensure Model does not exhibit bias based on feature Azure Machine Learning Designer Overview Missing required Python packages in Azure Machine Learning Designer Azure Monitor Application Insights Model Evaluation Methods Confusion Matrix Recall Precision Accuracy F1-Score ROC AUC Miscellaneous Model Deployment within Constrained Environment One-Hot Encoding Initial run with Minimal Resources Azure Blob Storage vs Azure Data Lake Storage Azure Machine Learning HyperDrive Overview HyperDrive in Azure Machine Learning is a tool used for hyperparameter tuning....

October 25, 2024 · 8 min · 1532 words · Eric

Azure AI Engineer Associate  [draft]

Azure OpenAI Terms Authentication with Azure OpenAI APIs Connect to app based on OpenAI Resource Connect to OpenAI app via OpenAI SDK Prevent Hate Speech OpenAI RESTful APIs OpenAI Model Settings Token Types OpenAI Cost Model Common OpenAI SDK methods Improve the quality of responses from OpenAI-backed Chatbot with minimal efforts Improve the accuracy of Chatbot response for similar questions Create OpenAI based marketing press release app Azure AI Search Glossary Stages for AI Enrichment Types of projections and Usage Key Types Have compromised key and want to prevent unauthorised access to Search Endpoint Have throttled request for AI Search Implement autocompletion with Cognitive Search Azure AI Services Improve reading experience for dyslexia Different types of content display in Chatbot Azure Cognitive Services Overview Provision Cognitive Services with Azure CLI Deploy a containerised Cognitive Services service for Sentiment Analysis Configure your App to connect to Cognitive Services service with minimal administrative effort Ensure Cognitive Services based Chatbot recognise your company’s products and codename Content Safety Optimise content filter configurations for objectionable content Monitor Online Activity Protected Material Detection Speech Types of Speech Services Optimise the text-to-speech sound quality for poor network conditions Enable Speech Capability for a Chatbot Document Intelligence What is Document Intelligence Translate files from German to French with custom glossary Deploy Document Intelligence resource in an ARM template Extract Information from Scanned document with minimal development efforts Pre-built models in Document Intelligence Threshold of Confidence score in Document Intelligence Vision Analyse image with Vision SDK Compute Vision API vs Custom Vision API Computer Vision vs Document Intelligence Custom Vision Overview Steps to build and train a custom classification model Face Increase the likelihood to detect faces in blurred images and sideways faces Translate Common Translate API Endpoints Service Endpoint for Translate Language Minimise similar utterances from input Use container on the host computer from Language Understanding (LUIS) Ensure only specific Azure processes can access Language Service Common Packages and its usage scenarios Entity Extraction Key Phrase Extraction Video Indexer Best way to index a 20GB Video file with Azure Video Indexer Miscellaneous Only specific resources to access Azure AI Services Identify unusual values in Time Series Detect when a user ask questions via Video and Audio Azure OpenAI Terms Frequency penalty parameter....

October 17, 2024 · 21 min · 4373 words · Eric

Azure Data Engineer Associate  [draft]

Apache Spark Cache data into the memory of local executor Spark Pool Clusters View Active Spark Streams Data Shuffling Azure Cosmos DB NoSQL Database to support API models at planet scale with low latency performance Schema Representation Azure Databricks Key Components Capacity Limits Workspace Security Network & Network Security Azure Databricks Cluster Types Azure Data Factory Azure Data Factory Core Concepts Global parameters Interact with Data Factory using Programming Languages Linked Service Diagnostic Logs Integration Runtime Azure Data Lake Gen2 (ADLS) Staging Area Processing Analytical Data workloads for best Performance Azure Event Hubs Options for an input to Azure Stream Analytics job with low latency and high throughput Azure Storage Storage Account Name Storage Analytics Storage RESTful API Access data in Storage Account with REST API Log every operation in Azure Storage Account activity in real-time Azure Synapse Analytics What is Azure Synapse Analytics?...

October 12, 2024 · 19 min · 4020 words · Eric

Fabric Analytics Engineers Associate  [draft]

Fabric Terms Capacity Lakehouse Managed Table Lakehouse Shortcut Lakehouse View Power BI DAX Formatter Power BI Model Explorer Power BI Tabular Editor (Best Practice Analyser) Tabular Editor Tenant Subscription Developer can deploy in Dev Test Workspace and view Prod Workspace Fabric Configuration Enable read-write access to dataset stored in Fabric via XMLA Endpoint Create and Publish custom Direct Lake semantic model using External Tools Lakehouse Handle frequent schema change in Copy Activity Convert Lakehouse files from CSV to Delta format for Power BI Reporting SQL Analytics Endpoint Performance Optimisation - Lots of useless logs, lots of small files Query S3 data with SQL Endpoint Prevent new tables been added to Lakehouse automatically Query data from multiple tables in different Lakehouses without copying data Data Factory Lookup Activity Pass values across multiple steps in Data Factory Pipeline Power BI Query Folding Incremental Refresh XMLA Endpoint Power BI Mode Display all rows including duplicates in PowerBI visual Distinct Count vs Unique Count in PowerQuery Calculate Duplicated Rows in PowerQuery Power BI File Formats Reduce Query Execution time for visuals on all pages on top of large dataset Incremental Refresh fails in Power BI report Semantic Model Enable Scale-out for a Semantic Model Analyse frequently used columns in memory Performance Optimisation Prevent implicit measures Identify Surrogate key column for SCD Type 2 table in Semantic Model Ensure user always use Direct Lake mode with semantic model PySpark Large dataset join a small dataset Necessary fields for Slow Change Dimension (SCD) Type2 Filver vs KeepFilters Table Maintenance Operations Miscellaneous Get maximum value of a column with PowerQuery Microsoft Fabric Capacity Metrics App Dynamic Management View (DMV) Fabric Terms Capacity Lakehouse Managed Table A managed table is a physical table that stores data in a Lakehouse....

October 3, 2024 · 13 min · 2683 words · Eric