Cognitive Search Workshop - Building an Enterprise Cognitive Search Solution
WARNING - This Training is OUTDATED
Warning - Tuesday, January 1, 2019
This training is OUTDATED. Many of the labs will not work from January onwards. Much information no longer reflects the reality of the product. The LearnAI Team strongly recommends the use of the new version: http://aka.ms/kmb
The new version is also free and public. It contains all the knowledge presented within this training, with the addition of:
- Azure Search Fundamentals
- Content Moderator API
- A Bot using Bot Framework V4
- Cognitive Search last updates
- All new Cognitive Search pricing information and requirements (since December 21, 2018)
Azure Search adds data extraction, natural language processing (NLP), and image processing skills to an Azure Search indexing pipeline, making previously unsearchable or unstructured content more searchable. Information created by Cognitive Search Skills, such as entity recognition or image analysis, gets added to an index in Azure Search. This one day training will focus on hands-on activities that develop proficiency with Cognitive Search, an Azure Search AI-oriented capability announced at Microsoft Build 2018. These labs assume an introductory to intermediate knowledge of Visual Studio, the Azure Portal, Azure Functions and Azure Search. If you are not at that skill level, we have prerequisite materials below that you need to complete prior to beginning this training.
We will focus on hands-on activities to learn how to create a Cognitive Search solution for all types of business documents. The documents include pdfs, docs, ppts and images, as well as documents with multiple languages. In this training, you will create a data flow that uses cognitive skills to enrich your business documents. These enrichments will become part of an Azure Search index.
At the end of this workshop, you should have learned:
- What Cognitive Search is
- How to implement this Cognitive Search Solution
- Why to use this solution with demos, POCs and other business scenarios
Since this is an AI training on top of Microsoft Azure Services, before we start you need:
- If if you don’t have prior experience:
- To Create: You need a Microsoft Azure account to create the services we use in our solution. You can create a free account, use your MSDN account or use any other subscription where you have permission to create services.
- To Install: Visual Studio 2017 version version 15.5 or later, including the Azure development workload.
- To Install: Postman. To call the labs APIs.
Since you have finished the prerequisites, let’s start the training. You just need to follow the workshop structure presented below.
- Introduction - 1 hour - Motivation, context, key concepts
- Solution Architecture - 1 hour - Diagram, use cases, deployment options and costs
- Environment Creation - 1 hour - Using the Azure Portal, we will create the services we need fo the workshop
- Lab 1 - 2 hours - Create a Cognitive Search Enrichment Process: Text Skills
- Lab 2 - 1 hour - Create a Cognitive Search Skillset: Image Skills
- Lab 3 - 2 hours - Create a Cognitive Search Skillset with Custom Skills
- Final Case - 0.5 hour - Brainstorm - Create a Cognitive Search Solution
- Q&A, Feedback and Survey - 0.5 hour
Workshop clean up
If you don’t want to keep the solution up and running for future use, you should get rid of the environment after the course. Assuming that you created all services in the same resource group, the fastest way to clean up is by deleting it. This will permanently remove the Azure Search service, the Azure Function app and Azure Blob service (including the services and any stored content that you created for this workshop). In the portal, the resource group name is on the Overview page of each service.
- Microsoft AI School
- Microsoft AI Platform
- Microsoft AI Principles
- Microsoft AI Ethics
- Microsoft AI Customer Cases
- Microsoft AI Lab -> Released May, 2018
- Microsoft AI TV -> Released May, 2018
- Microsoft AI Analytics School
- Microsoft Research Open Data
- Cognitive Search Official Demo - JFK Files
- Cognitive Search Official Code - JFK Files
- Cognitive Search Business Documents Demo - Wolters Kluwer
- Cognitive Search Business Oil & Gas Demo - Exxon Mobile
- Cognitive Search Business Healthcare Demo - CTakes
- Cognitive Services Enrichment Pipeline Demo
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact email@example.com with any additional questions or comments.