-
Zero‑ETL, Zero Public Internet: Mirror Azure SQL to OneLake via Private Endpoint + Fabric VNet Data Gateway
Introduction Mirroring has been a transformative technology for data integrations tasks since the early Microsoft Fabric days. Moreover, this feature has been called “pain killer as a service” in community posts. In many projects, data sources to be mirrored are behind private networking and for security reasons they are not accessible using public internet. If…
-
Interacting with Microsoft Graph API Using Microsoft Fabric
Introduction This article is an updated version of my 2022 post on using Synapse pipelines to retrieve security groups and their members through the Microsoft Graph API. Some customers recently asked for a Microsoft Fabric–based approach, and I also noticed that many developers are still defaulting to Python clients to interact with Graph. While Python…
-
Vector Search for AI Apps in Azure Databases
Introduction Vector databases and vector search are becoming increasingly important in modern applications due to their ability to handle complex and high-dimensional data efficiently. In today’s data-driven world, applications such as recommendation systems, image and video retrieval, natural language processing, and anomaly detection rely heavily on the ability to search and analyze large volumes of…
-
Microsoft Fabric and Databricks Unity Catalog integration using the mirrored Azure Databricks Catalog item, better together?
Introduction Databricks Unity Catalog has emerged as a popular choice in data platforms for access management and governance. It offers a unified governance solution that simplifies security and compliance by providing a single place to administer data access policies across all workspaces and personas. Unity Catalog’s security model is based on standard ANSI SQL, allowing…
-
Data Management Showdown: Azure Synapse Link for Cosmos DB vs. Microsoft Fabric Mirroring
In the ever-evolving landscape of data management and analytics, choosing the right tools and approaches is crucial for optimizing performance and achieving business goals. Two prominent solutions that have gained traction are Azure Synapse Link for Azure Cosmos DB and Mirroring in Microsoft Fabric. Both offer unique benefits and cater to different needs, making it essential to understand…
-
A simple Power App that consumes Azure OpenAI GPT models
Introduction Welcome to this tutorial on using Power Apps with Azure Open AI. In this quick start guide, I will walk you through the process of integrating Azure Open AI with Power Apps to create a chat application. By the end of this tutorial, you will have a functional Power App example that leverages the…
-
Power App Custom Connector to access Azure OpenAI GPT models using API Management and OAuth 2.0
Introduction In the rapidly evolving landscape of artificial intelligence, the integration of Azure OpenAI GPT models with Power Apps through Custom Connectors and OAuth 2.0 represents a significant leap forward in application development and security. This article delves into the transformative potential of leveraging Azure API management to enhance security measures, emphasizing the critical role…
-
Enhancing Azure OpenAI Security with Microsoft Entra ID & OAuth 2.0
Introduction When it comes to securing Azure OpenAI REST APIs, there are several authentication methods available, each with its own set of advantages and considerations. I will abbreviate Azure OpenAI as AOAI from now on. API Key Authentication The API Key method is straightforward; it requires including the API Key in the api-key HTTP header…
-
Developing a Copilot Powered by External APIs and LLMs
Introduction In this article, we will explore how to develop a copilot that can leverage external APIs and LLMs to provide rich and dynamic conversational experiences. A copilot is an intelligent assistant that can help users with various tasks and scenarios, such as booking a flight, ordering food, or getting medical advice. A copilot can…
-
Creating a knowledge management assistant with Microsoft Copilot Studio
Introduction In the last post I described how you can create a chatbot with Azure OpenAI and add your own data to build a RAG application with a low-code approach. I used SQL Server performance PowerPoint slide decks as source data; therefore, I call my chatbot knowledge management assistant for SQL Server, but you can…
Paul Hernandez playing with Data
Business Intelligence, Data Analysis, Advanced Analytics and more …
Paul Hernandez playing with Data 