Supported Scenarios

Business Scenarios

Document Retrieval

Activate GenAI with Azure is a new delivery that leverages the power of artificial intelligence and cloud computing to provide a smart and scalable document search and retrieval solution. The solution uses Azure OpenAI, Cognitive Search, Container Apps, Application Insights, and Azure API Management to create a chat interface that can answer user queries with relevant documents, suggested follow-up questions, and citations. The solution also allows users to upload custom data files and perform vector search using semantic or hybrid methods. Additionally, the solution supports extensibility through plugins, charge back functionality, security features such as authentication and authorization, monitoring capabilities, and scalability options.

Technical Scenarios

Azure OpenAI enhanced Monitoring

Ensure models are being used responsibly within the corporate environment and within the approved use cases of the service.

References:

• Enterprise Azure OpenAI

Load Balance Azure OpenAI instances

Enable high availability of the model APIs to ensure user requests are met even if the traffic exceeds the limits of a single Azure OpenAI service.

References:

Load Balancing in Azure OpenAI Service

Serverless Document Batch Processing

Use Azure Functions to process documents, create embeddings and store them in the specified memory store.

References:

Azure OpenAI Embeddings QnA