Business Scenarios
Document Retrieval
Activate GenAI with Azure is a new delivery that leverages the power of artificial intelligence and cloud computing to provide a smart and scalable document search and retrieval solution. The solution uses Azure OpenAI, Cognitive Search, Container Apps, Application Insights, and Azure API Management to create a chat interface that can answer user queries with relevant documents, suggested follow-up questions, and citations. The solution also allows users to upload custom data files and perform vector search using semantic or hybrid methods. Additionally, the solution supports extensibility through plugins, charge back functionality, security features such as authentication and authorization, monitoring capabilities, and scalability options.
Technical Scenarios
Azure OpenAI enhanced Monitoring
Ensure models are being used responsibly within the corporate environment and within the approved use cases of the service.
References:
Load Balance Azure OpenAI instances
Enable high availability of the model APIs to ensure user requests are met even if the traffic exceeds the limits of a single Azure OpenAI service.
References:
Load Balancing in Azure OpenAI Service
Serverless Document Batch Processing
Use Azure Functions to process documents, create embeddings and store them in the specified memory store.
References: