{"id":459,"date":"2024-07-29T07:19:34","date_gmt":"2024-07-28T21:19:34","guid":{"rendered":"https:\/\/www.cloudproinc.com.au\/?p=459"},"modified":"2024-07-29T07:19:38","modified_gmt":"2024-07-28T21:19:38","slug":"reading-handwriting-with-azure-ai-vision-and-net-c","status":"publish","type":"post","link":"https:\/\/cloudproinc.com.au\/index.php\/2024\/07\/29\/reading-handwriting-with-azure-ai-vision-and-net-c\/","title":{"rendered":"Reading Handwriting with Azure AI Vision and .NET C#"},"content":{"rendered":"\n

This Azure AI Vision article will show you how to create a .NET app that reads handwritten text using Azure AI Vision.<\/p>\n\n\n\n\n\n\n\n

Microsoft Azure AI Services offers several AI services that can help streamline business processes or create in-house applications that can replace SaaS apps. <\/p>\n\n\n\n

Azure AI Vision allows us to work with objects through images and videos. One of the services’ capabilities is the ability to read text in the form of an image<\/a> or handwriting.<\/p>\n\n\n\n

In this post, we pass the following image to a .NET C# application and read the text. The result will be the output of the text to the console. <\/p>\n\n\n\n

\"Reading<\/figure>\n\n\n\n

Create Azure AI Vision Service <\/h2>\n\n\n\n

Before starting, we need to create an Azure AI Vision service. In our case, we are using Azure Bicep to provision the service using the following code. The code will also output the endpoint and key, which we will need to authenticate to the services later on.<\/p>\n\n\n\n

\n\nresource aivision 'Microsoft.CognitiveServices\/accounts@2023-05-01' = {\n  name: 'CognitiveServices'\n  location: 'southeastasia'\n \n  sku: {\n    name: 'S0'\n  }\n  kind: 'CognitiveServices'\n  properties: {\n   \n  }\n \n}\n\n\noutput cognitiveServiceEndpoint string = aivision.properties.endpoint\noutput cognitiveServiceKey string = listKeys(aivision.id, '2022-12-01').key1\n\n\n\n<\/code><\/pre>\n\n\n\n
Once the service is provided, create a console application using Dotnet CLI or Visual Studio.<\/p>\n\n\n\n
Reading Handwriting with Azure AI Vision and .NET C#<\/h2>\n\n\n\n
After creating the console application, the first thing we need to do is use appsettings.json to save the login credentials for the AI Vision service. In our case, we are using the following file (add your key and endpoint to the file).<\/p>\n\n\n\n
{\n  \"AIServicesEndpoint\": \"ENDPOINT URL\",\n  \"AIServicesKey\": \"KEY\"\n}\n<\/code><\/pre>\n\n\n\n
Below, you can see the structure of the application. <\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
The images directory is used to store the handwriting images.<\/p>\n\n\n\n
Program.cs<\/h2>\n\n\n\n
The application code is shown below.<\/p>\n\n\n\n
using System;\nusing System.IO;\nusing System.Linq;\nusing System.Drawing;\nusing System.Collections.Generic;\nusing System.Threading;\nusing System.Threading.Tasks;\nusing Microsoft.Extensions.Configuration;\nusing Azure;\nusing Azure.AI.Vision.ImageAnalysis;\n\n\npublic class Program\n{\n    static void Main()\n    {\n        AnalyzeImages();\n    }\n\n    static void AnalyzeImages()\n    {\n        \/\/ Get config settings from AppSettings\n        IConfigurationBuilder builder = new ConfigurationBuilder().AddJsonFile(\"appsettings.json\");\n        IConfigurationRoot configuration = builder.Build();\n        string aiSvcEndpoint = configuration[\"AIServicesEndpoint\"];\n        string aiSvcKey = configuration[\"AIServicesKey\"];\n\n        ImageAnalysisClient client = new ImageAnalysisClient(\n            new Uri(aiSvcEndpoint),\n            new AzureKeyCredential(aiSvcKey));\n\n        string[] imageFiles = Directory.GetFiles(\"images\");\n\n        foreach (string imageFile in imageFiles)\n        {\n            using FileStream stream = new FileStream(imageFile, FileMode.Open);\n\n            ImageAnalysisResult result = client.Analyze(\n                BinaryData.FromStream(stream),\n                VisualFeatures.Read);\n            stream.Close();\n\n            if (result.Read != null)\n            {\n                Console.WriteLine($\"The following text was found in image: {Path.GetFileName(imageFile)}\");\n\n                \/\/ Prepare image for drawing\n                System.Drawing.Image image = System.Drawing.Image.FromFile(imageFile);\n                Graphics graphics = Graphics.FromImage(image);\n                Pen pen = new Pen(Color.Cyan, 3);\n\n                foreach (var line in result.Read.Blocks.SelectMany(block => block.Lines))\n                {\n                    \/\/ Return the text detected in the image\n                    Console.WriteLine($\"   '{line.Text}'\");\n\n                    \/\/ Draw bounding box around line\n                    var drawLinePolygon = true;\n\n                    \/\/ Draw line bounding polygon\n                    if (drawLinePolygon)\n                    {\n                        var r = line.BoundingPolygon;\n\n                        Point[] polygonPoints = {\n                         new Point(r[0].X, r[0].Y),\n                         new Point(r[1].X, r[1].Y),\n                         new Point(r[2].X, r[2].Y),\n                         new Point(r[3].X, r[3].Y)\n                     };\n\n                        graphics.DrawPolygon(pen, polygonPoints);\n                    }\n\n                }\n\n                \/\/ Save image\n                String output_file = $\"{Path.GetFileName(imageFile)}_textResult.jpg\";\n                image.Save(output_file);\n                Console.WriteLine(\"\\nResults saved in \" + output_file + \"\\n\");\n            }\n\n\n        }\n    }\n}\n<\/code><\/pre>\n\n\n\n
The results are also saved to the root directory and will highlight the detected text. <\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
If you need assistance developing  AI-based applications using Azure AI Services, please use the form below to contact us.<\/p>\n\n\n
Submit a form.<\/a><\/div>\n\n\n
Read More AI Articles <\/h2>\n\n\n\n