Differences between Azure Policy Exclusions, Exemptions and Overrides

Reading Time: 6 minutes


In this blog post I will describe the differences between Azure Policy exclusions, exemptions and overrides.

If you missed out on my previous post on Azure policy inheritance you can find the article at the following link Azure Policy Inheritance explained

Let’s get started and understand the differences and use cases for each.



Azure Policy Exclusions
Azure Policy allows organisations to enforce rules and compliance across resources in Azure. Compliance status is visible within the Azure Policy overview page which provides a single pane of glass view of resources which are compliant or non-compliant in their environments. However, there are requirements where organisations may not want Azure Policy to scan all resources. One of the features of Azure Policy is the ability to exclude certain resources from an Azure policy assignment. This is known as Azure Policy Exclusions. Let’s continue to a couple of examples below where we could use Azure Policy Exclusions.

Example
Your organisation has a policy that audits all storage accounts to ensure the replication for disaster recovery purposes is set to geo-redundant replication.


However, there is one subscription that contains storage accounts used for development and testing purposes that do not need to be scanned by this policy. In this case, you can create a policy assignment that applies to all subscriptions, and exclude the subscription containing the development and testing storage accounts. This way, the policy will apply to all storage accounts except for those in the excluded subscription. Furthermore, those storage accounts from the excluded subscription will not appear on the Azure Policy overview page as non-compliant.

Another Example
Your organisation has a policy that requires all virtual machines to be deployed in a specific region for compliance reasons. However, there is one resource group that contains virtual machines used for disaster recovery purposes that need to be deployed in a different region. In this case, you can create a policy assignment that applies to all subscriptions and resource groups, and exclude the resource group containing the disaster recovery virtual machines. This way, the policy will apply to all virtual machines except for those in the excluded resource group.

Where is the exclude option?

When assigning an initiative/definition the option to exclude appears below the field named scope as shown in the image below.


Let’s move on to Azure Policy Exemptions in the next section below.


Azure Policy Exemptions
The Azure Policy exemptions feature is used to exempt a resource hierarchy or resources from being evaluated. Resources that are exempt are not evaluated because there may be a time bound waiver with an expiration date applied by an engineer. A benefit of exemptions is that they are audited, including the reason why an engineer created an exemption, the name of the engineer, and time the exemption was created. All exemptions can be tracked in the Azure Policy portal. Let’s continue to a use case of an exemption below.

Example
Let’s say we are applying the built-in definition “Storage accounts should disable public network access” with an effect set to audit. We find that the compliance assessment shows that a storage account named “imransstorageaccount” is found to be non-compliant, but it must have public network access enabled for business purposes. How do we get around this non-compliant resource? We can create an exemption and type a reason why “imransstorageaccount” was exempted. Once the exemption is created, “imransstorageaccount” will be shown as exempt in compliance view in Azure Policy.

Note: It is important to regularly review your exemptions to ensure that all eligible items are appropriately exempted and to promptly remove any that no longer qualify for exemption.

Where is the exemption option?
1. Access Azure Policy and click Assignments under the section Authoring. As shown in the image below.


2. Click the ellipsis icon (the three dots) by the policy assignment you wish to exclude and click create exemption,


3. Once the exemption window launches you can select an exemption category of Waiver, for example if you are due to delete/decommission the resource. The second option is mitigated, where you may have resolved the non-compliance issue via a different method. Providing a reason why a resource is exempted allows for the reason to be audited.


You can also apply an exemption expiration date.

The policy exemption isn’t deleted when the expiry date is reached. The object is preserved for record keeping, but the exemption is no longer honored and Azure Policy will scan the resource again and mark it as compliant or non-compliant.

Exemption history can be viewed by clicking Exemptions located under the section Authoring. As shown in the image below.

So what is the difference between Azure Policy exclusions and exemptions?

1. Exemptions can be time bound, for example, exempt for 1 month and then start scanning and reporting on the compliant status again.
2. Exemptions are audited so it is possible to check why a policy was temporary or permanently exempt.
3. Exemptions are configured after the resource has been scanned and appears as non-compliant. We can then create an exemption for the non-compliant resource if required.
4. Azure Policy Exclusions are different. When we create an exclusion, Policy does not scan the excluded scope or mark it as compliant or non-compliant because it is ignored. Exclusions can not be configured to be temporary/time bound with an expiration date.



Azure Policy Overrides (In preview at the time of writing)
Overrides is a feature which offers a capability different to exclusions and exemptions. The overrides property allows you to change the effect of a policy definition without modifying the underlying policy definition and in turn reducing the management overhead. Let me give you examples of use cases below.

Example
You have assigned an initiative which includes/groups together a number of single definitions. Let’s say that one or more of the definitions inside your initiative has an effect of audit, however you wish to change the policy effect to deny. Azure policy override allows you to override the effect from audit to deny so that you don’t have to recreate azure polices or change the effect parameter within the policy template/JSON code. I could simply override an existing effect of deny to audit by editing the existing assigned policy and adding an override of change effect from audit to deny. I can add and remove overrides when needed.

Another example
I have a policy initiative named Security that includes several policy definitions, such as RestrictVMSize and RequireSQLDatabaseAuditing. The default effect of these policy definitions is audit. However, I now want to change the effect of these policy definitions to deny without modifying the underlying policy definitions or amending the parameter effect in the policy definitions template.

To achieve this, I can use Azure Policy overrides to change the effect of the policy definitions to deny. I can create an override for each policy definition and set the effect to deny. If needed, I can remove the override at a later date which will revert the effect back to the original effect of audit without me having to change the JSON file.

Where is the override option?
An override can be applied to a policy at the time of policy assignment or by editing an existing assignment.

1. Click Assignments under the section Authoring.

2. By the assignment name, click the ellipsis icon (…) and click edit assignment.

3. Click the advanced tab

4. Click Add override

5. Click override value and change the effect.

6. In my case, I have a policy which does not allow resources to be deployed to any region apart from UK South. My policy effect is currently set to deny. For demo purposes, I am going to add an override with an effect of audit. Click Add to apply the override and then click review and save.

Now the policy will not deny when resources are built outside of the UK South region but audit only and mark them as non-compliant. I can remove or edit the override when needed. Note an override was added to this policy for demo purposes only. Plan your overrides accordingly.


That’s it. I hope you found the post useful

See you at the next one

Azure Policy Inheritance explained

Reading Time: 7 minutes


In this blog post I will explain how Azure Policy inheritance works using different scenarios/demos. If you are not aware of what Azure Policy is, click the following Microsoft Learn link to learn more, Overview of Azure Policy.

When we assign Azure Policies in our Azure environments we have the option to scope a policy at different levels including Management Groups, Subscriptions and Resource Groups as shown in the image below. The diagram below shows that we can apply Azure Policies at three levels, Management Groups, Subscriptions and Resource Groups.


Like RBAC (Role Based Access Control) permissions, policies also inherit from top down in the Azure Hierarchy. So if I scoped/assigned a policy at the Management Group level, that policy would inherit down to subscription, resource group and the three resources in my diagram, Virtual Machine 1 (VM1), Virtual Machine 2 (VM2) and Virtual Machine 3 (VM3). I have used virtual machines in my example, but this could be any type of Azure resource.

If I was to assign a policy at the Management Group scope allowing engineers in my organisation to deploy Virtual Machines to the Azure UK South region only, that policy would inherit down to the subscription and resource group. Therefore, my engineers would not be able to deploy Virtual Machines to any other region apart from the UK South region in the existing subscription and resources group, and any new subscriptions or resource groups deployed under my Management group in future as the policy would automatically apply.


Let’s go through a few commonly asked questions,

Question 1:
If you apply a policy to the Management group which only allows resources to be deployed in the UK South Region, and that policy is inherited by subscription and resource group, what would we expect to happen if I deployed a new Virtual Machine called VM4 to a different region such as as East US into the resource group?

Result
The deployment would be prevented by the policy and the engineer would not be allowed to deploy to the East US region because the policy scoped to the management group is being enforced. As shown in the image below. I have tried deploying VM4 to the East US region and been denied due to the policy applied at the Management Group level which has inherited all the way down, by design.


Question 2:
In the example above, you tried deploying to resource group named ResourceGroup1 and the policy denied you from trying to build a new VM4 in region East US. What if you create a new resource group name ResourceGroup2 and try deploying VM4 to East US or any other region inside the newly created resource group?

Result:
It will be denied, why? because the policy applied to the Management Group applies to all new resource groups under that Management Group. The new resource group ResourceGroup2 inherits the policy from above. Again, the below image shows the policy preventing VM4 from being deployed in East US in a new resource group named ResourceGroup2.


Question 3:
What about the resources (VM1, VM2 and VM3) which were deployed and already exist in Resource Group1 as shown in the diagram below. What would happen if VM1 was located in UK South and VM2 and VM3 were located outside of the UK South region, before you applied the policy? what would happen to existing resources that are already there?


Answer:
If the three resources, in my case three existing virtual machines VM2 and VM3 were deployed outside of the UK South region and VM1 was deployed in UK South region, then Azure Policy would display VM1 as compliant for being deployed in UK South, and the other two VM2 and VM3 as non-compliant. The Azure policy overview page would report this.


Question 4:
What would happen if you created another policy and assigned at the resource group level, but the new policy assigned to the resource group allowed deployment to East US region only, so denying UK South? You now have one policy applied to the Management Group which allows deployments to UK South region only (inherited down), and a new policy assigned to the resource group which only allows deployments to East US. Which one policy would win? as show in the image below.


Result
I leave the existing policy assigned to the management group, allowing resources to be deployed in UK South only. I have created a new policy and assigned to the resource group which only allows resources to be deployed to East US region. We now have conflicting policies.

The images below show that I have applied a policy to ResourceGroup1, allowing resources to be deployed inside that resource group but to East US region only.


What was the result?

1. Was I able to deploy a new virtual machine called VM4 in ResourceGroup1 in the UK South Region? No, denied as per the image below.



2. Was I able to deploy a new virtual machine called VM4 in ResourceGroup1 in the East US region? No, denied as per the image below.


Are you confused? 🙂

Are you thinking, I thought that adding a policy to ResourceGroup1 directly would override the Policy assigned to the Management Group level and allow me to build resources in East US region?

Or maybe you are thinking the opposite, that the policy assigned at the management group level would still take precedence/priority and allow a resource to be deployed to UK South but not East US.

Or maybe you’re thinking that it would be possible to build resources in ResourceGroup1 in both UK South and East US regions.

Or may be you knew what the result was going to be, in this case, I am not allowed to deploy to any of the regions.

Or you were thinking something else. In that case, please do drop a comment towards the end of this post to let us know.

Why was I not allowed to deploy to any of the regions
This is because both polices are applying together and a deny takes precedence/priority. In this case, both policies are denying. The policy at the management level denies/restricts deployments to East US as it only allows deployments to UK South. The policy at the resource group level denies/restricts deployments to UK South region as it only allows deployments to East US. The most restrictive/deny policy will take effect, in this case both of them are restricting/denying deployments, therefore both policies apply and deny access. As per the diagram below,


Question 5
What would happen if you apply two policies but the same configuration to both Management Group and resource group. So allow deployments to UK South only scoped to the Management Group and allow deployments to UK South region only at the resource group? as per the image below.


Result
You would be allowed to deploy to the UK South region as both policies are allowing at Management Group and Resource Group. In my case I removed the parameter of EAST US region at resource group level and added UK South. You may need to wait up to 30 minutes before new changes take effect.

The result, there was no error/warning when I selected UK South, as shown in the image below.



Question 6
Could you exclude policies from being applied to certain resources? For example, VM1, VM2, VM3 which already exist in a resource group, or if I want to apply a policy but I want to exclude certain resources from the policy. Is this possible?


Answer
Yes, you can exclude a subscription, resource group or specific resources so a Azure policy does not apply. There is an exclusions option.

There are also other options available such as exemptions and overrides. For more information on Azure Policy Exclusions, Exemptions , visit my post Differences between Azure Policy Exclusions, Exemptions and Overrides


Question 7
The built in ‘allowed locations’ policy you used is denying you to deploy resources in the regions not specified in the Policy. Is there a deny setting somewhere that you have to enable?

Answer:
The policy I used already is configured to deny, known as an effect. We can check this by accessing the JSON (Java Script Object Notation) code which is what the policy is using under the hood.

1. Go to Azure Policy
2. Click Assignments from the left pane under the section Authoring
3. Click the three dots … as shown in the image below


4. Click view definition (This will display the JSON code used under the hood, it is how the policy is compiled)
5. Scroll down to “effect”:


You can’t change the effect of a default/built in policy, the option to edit or delete built in policies/initiatives are greyed out. However, you can duplicate an existing definition, give it a new name and amend as required.


A list of effects and explanations which can be used in Azure policies are documented at the following Microsoft Learn page, Understand how effects work – Azure Policy


I hope you found the post useful.

See you at the next post.





Taking a Microsoft Exam from home

Reading Time: 13 minutes


I always booked and took my Microsoft exams from a test centre until the Covid Pandemic halted most of the world. That’s when I discovered that there was also an option to take the exam online from home and since then I have always preferred this option. Taking the exam from the comfort of your own home. It sounds convenient right? It is, but there are a few important points that you should be aware of.

In this post I will post the process of booking an online exam and what you need to watch out for if you don’t want to be warned/disqualified by the moderator. I will share real life stories from my own experience taking exams from home and also from people who have shared their stories with me.

Exam booking process

For the purpose of this post, let’s assume that I am booking to take the AZ-204 Developing Solutions for Microsoft Azure exam from home.

  1. Visit the AZ-204 certification page at Exam AZ-204: Developing Solutions for Microsoft Azure – Certifications. For other exams you could type the exam code into search, for example AZ-104 or AZ-700 and click the certification page.

  2. Scroll down until you reach the schedule exam section. Click the drop down to select your country and click the orange button labelled Schedule exam, as per the image below.


3. Sign in. I use my personal @hotmail.com

Why use your personal and not work email address? Because you may leave your existing employer at a later date and the certifications you pass would be linked to your employer provided email address. To avoid the hassle, I always use my personal email address.


4. Ensure your profile details are correct and click next


5. If you are entitled to any exam discounts, they will appear here. For example if you’re a MCT (Microsoft Technical Trainer) you receive 75% discount on the exam. If you’re a Microsoft Employee, a 100% discount is available.

You may be thinking, how does one become a Microsoft Technical Trainer? Click the following link to find out more, How to become a Microsoft Technical Trainer.

There is also an option to check for another discount. For example, If you have attended a Microsoft course or a different Microsoft online event you may be entitled to a 50% exam discount, enter your email address in the field labelled check for another discount. This would be the email address you used to register for the course or online event. Click the button, check discounts to find out if there are any discounts available to you.

When ready, click Next


6. Click Schedule with Pearson VUE


7. Click the option Online with OnVUE to take the exam from home.

There is also the option to take the exam from your nearest test centre if you prefer not to take the exam from home.


8. You’ll find a few tips/checks that you should perform or will require prior to taking the exam, let’s go through each one.

Your computer

It is important that you test your laptop/desktop to ensure it passes the system test. This test will check your device microphone, speakers and webcam. It will then allow you to download a test exam simulation to ensure the exam software will load on your device. Ensure that you perform another test prior to taking the exam on the scheduled day and you use the same device.

Individuals have experienced issues with sitting the exam from company laptops due to being locked down which can block the exam from launching. It is important you test your device.

Click Run system test which will take you through the required checks.

If you wish to check whether your device or operating systems meets the minimum requirements for the exam, click minimum technical requirements.

9. Your testing space

  • Select an empty desk where you will place your laptop or desktop only
  • You can only have a single monitor so if you have several monitors on your desk, you won’t be allowed to use them and they should not be visible on the desk.
  • Remove all objects from the desk apart from your mobile phone. Your mobile phone needs to be placed at arms length on the table so it can be reached in the event of an emergency. For example, the moderator is unable to get in touch with you through your laptop or there has been a power cut.
  • Ensure that no one is in the room. You must be alone
  • Ensure that no one talks to you or calls your name whilst you’re taking the exam
  • The exam will be recorded and the moderator will be watching you for the duration of the exam. Ensure you don’t leave the view of your web cam and do not look around suspiciously
  • If you have a habit of whispering questions to yourself as you read, don’t. It is not allowed and you will be warned by the moderator.
  • Do not place your hand over your mouth, for example, if you have a habit of placing your hand on your chin whilst concentrating, don’t. You will be told off and if you continue, you could be disqualified and the exam will end.
  • If possible, use a personal computer rather than an employer issued computer, as the company provided device may have additional security settings that can interfere with the exam.
  • Ensure your internet connection is reliable. Pearson VUE recommend a wired internet connection and to disconnect from VPN. However, I have taken many exams from home via a wireless connection without issues.
  • Ensure the area where you are taking the exam is well lit. The moderator won’t allow you to take the exam from a dark room with no lights.

True stories:
– An individual was disqualified because his dog was continuously barking. Ensure the room you are in is quiet.

– I have come across people who take the exam from the bathroom. I personally would not do this, however there are people who prefer taking exams from the bathroom. You could be in there for 3 hours so ensure you have a spare bathroom or else you may upset family members if they require access to the bathroom! Will a moderator allow you to take your exam from the bathroom? Yes and no. I have come across people complaining that they were allowed to take the exam from the bathroom and then when taking another exam in future, were told it was not allowed by the moderator.

– Individuals have been asked to remove posters from the wall so if you have posters on the wall or a whiteboard with text, you may be asked to remove those by the moderator.

– I was once warned by the moderator because I was whispering/reading the question to myself. I have learnt from that mistake since and not read questions back to myself whilst in an exam.


10. Your photo ID

On the day of the exam, you will require photo ID. One of the following will do, such as a Passport, Driver’s license, Identification card (national or local), Non-US Military ID (including spouse and dependents) or a Registration card (green card, permanent residence, visa). For an up to date list, click the admission & ID policies link as shown in the image below. I will discuss how you will need to present/upload the photo ID later in this post.


11. What to expect

The short video link available under the What to expect section shown in the image below will guide you through what to expect if you were to visit a test centre to take the exam and additional video demonstrating what to expect when taking the exam online from home.


12. Click the next button


13. Select your preferred language for the exam

If the exam is not available in your native language and you need to take it in a different language, you may request additional time to read and answer the questions. If you take the exam with Pearson VUE, you can use the English as a Second Language (ESL) form.


14. Read and accept the provided agreements and click next


15. Read and agree to online exam and Microsoft Policies. Tick the boxes to accept if you agree. There are a few to accept/tick as you scroll down the page. The information is useful as it provides a reminder of what you need to know and do before the exam.


16. When ready, click the agree button. Visible as you scroll to the bottom of the page


17. What language do you prefer the proctor/moderator speaks. English or Japanese. The moderator will be doing very little or no talking at all. Click Next


18. Confirm your time zone. My time zone is UK (automatically detected) so I will accept and click Yes, that’s right!


19. Select a date and time. Click Explore more times for a list of different times if available.

An advantage of taking the exam from home is that you have access to different times 7 days a week. I prefer to take the exam when everyone in the house has gone to bed, or early morning.


20. When you have decided on the time you wish to take the exam, click Book this appointment

21. Review the information to ensure you are happy. Such as have you selected the correct exam, date, time and so on.

Important: Ensure that your name matches the identification (ID) that is presented at the test center or when you take the exam from home, or you will not be permitted to take your exam.

22. When ready, click Proceed to Checkout to make payment unless you were entitled to a 100% discount earlier, you will be able to complete the process without payment.


That’s it. The exam is booked!

What next, prepare for the exam.

If you have never taken a Microsoft exam before and want to know what to expect. Here is a Microsoft provided exam sandbox demo

Exam day is here

23. You have approached the date of the exam. What does the process look like when checking in for an online exam from home.

Recommended prior to check in

  • Power up your device, close down any apps, such as messaging apps, Microsoft Teams, Skype and so on.
  • Ensure the device is not scheduled to reboot, for example, after windows updates installation
  • Perform a system test to ensure your microphone, speaker, webcam and the test exam software launches. A link to test will be available to you in your email from Pearson VUE. You will be given the opportunity to test your system when you go through the check in process below. I prefer to test my device before so I have enough time to troubleshoot and resolve any issues.

    Check-in process
  • You will be able to check into the exam 30 minutes before the exam start time, no earlier. A link to check in will be available to you via an email or you can login to the Pearson VUE website. For example, if the exam is scheduled for 11.15am, you will be able to check in at 10.45am. Ensure you check in at the start time.
  • As part of the check in process, you will have the opportunity to test your system again, to ensure your microphone, speakers and web cam work. Also, you will be prompted to end any applications/processes running on the system which may prevent the exam software to launch. You will need to close down.
  • You will need to upload your photo (a selfie). On screen you will be presented with a few options to retrieve the upload link, such as scanning a QR code from your mobile, accessing a provided website address or requesting a text with the link to your phone. I usually request for a text message to my phone. Open the provided link and upload your selfie.
  • Take a picture of your photo ID and click upload using the same link provided by Pearson VUE.
  • Next, you will be asked to upload four photos of your surrounding area where you will be sitting to take the exam. A photo of what is in front of your laptop, the back, the left and the right of your laptop. You will upload each photo one at a time.
  • The information uploaded will be verified and the session will start to record. Do not leave your laptop from this point.
  • A moderator will come online at the exam start date, in this case 11.15am and may introduce themselves, a quick hello and ask that you are ready for the exam. The moderator may ask you to show them your surroundings by moving your webcam around the room. Note that in some cases, the moderator does not speak and the exam software will launch. There may also be times when the moderator does not activate the exam at the specified time. I have experienced an exam where the exam launched 15 minutes late, so hang in there and be patient. You may also experience times where the exam starts straight after the check in process, for example, if the exam was scheduled 11.15am and you had uploaded your photos by 11am, the moderator could start the exam at 11am which I prefer instead of waiting. If you’re concerned, use the live chat to contact the moderator but do not leave your laptop.

24. When the exam starts, you will be asked to agree to a few terms and conditions and the exam software will launch on your device in full screen. You should be able to see yourself via the webcam towards the top of the page and a record icon to show that the session is being recorded.

Note: if the exam software does not launch, use the live chat facility to let the moderator know. I once experienced this issue and was waiting for 20-30 minutes after the start time wondering why the exam had not loaded until I used the live chat to contact the moderator. I was to asked to exit the exam and rejoin as the exam software had failed to launch for some reason. The second attempt worked.

Ensure that,

  • you do not leave the laptop and remain in view of the web cam
  • you do not speak to anyone
  • no one walks past or speaks to you
  • there is no background noise
  • you do not whisper questions to yourself
  • you do not cover your mouth
  • you do not look around suspiciously

Reminder: If you have never taken a Microsoft exam before and want to know what to expect. Here is a Microsoft provided exam sandbox demo

MICROSOFT EXAM ANNOUNCEMENTS

A few announcements you may not be aware of if you have not sat a Microsoft exam for some time.

  • Microsoft Learn accessible in the exam (excluding fundamentals exams) announced 22nd August 2023

    You have the option to launch the Microsoft Learn website in the exam so you can double check if you can’t recall the correct answer. A Microsoft Learn icon will be visible in your exam which can be launched into a split screen. More info at the following link Introducing a new resource for all role-based Microsoft Certification exam

    Note: If you do use the Microsoft Learn option be careful when closing it down after use. Do not accidentally exit from the complete exam. If you do come cross this situation where you exit from the whole exam in error, enter the exam again and contact the moderator/proctor.

  • Exam expiration and renewals – announced 15th December 2020

    Exams previously expired after 2 years and you would need to take the exam again to renew for a further two years. The renewal process would involve the same process as in being moderated with the same rules, as if you were taking the exam for the first time. As of December 2020, the exam expiry date was changed from 2 years to 1 year, however the exam can be renewed via the Microsoft Learn website. The renewal is free, a shorter exam, not moderated, no need to clear your desk and is open book. If you fail the exam you can retake the exam as long as you don’t let it expire, so ensure that you don’t renew the exam with a few days spare until expiration. I renew the exams ASAP or at least 2 months before the expiration date. For example, if I receive an email from Microsoft informing me that my exam is due to expire in 6 months and I renew/pass the exam at that point with 6 months remaining until expiration, Microsoft will add the 6 months to my renewal, meaning the next renewal would be in 1 year and 6 months. More info at Microsoft Certification Renewal

  • Free official Microsoft test questions
    Microsoft have launched free practice test questions for a number of certifications. A list of the available practice assessments are available at the following link, Practice Assessments for Microsoft Certifications. There were 39 available at the time of writing and Microsoft continue to add more for other certifications.

  • Microsoft Applied Skills Credentials – announced October 2023 (Currently Free)
    A new verifiable credential that validates that you have the targeted skills needed to implement critical projects aligned to business goals and objectives. These are free open book Microsoft verified credentials which are currently free and target a specific skill set, for example, securing Azure storage or Azure networking. These are 100% lab/task based where you are presented with a lab machine in which you will be asked to perform a number of tasks in 2 hours. Upon completion, your assessment will be marked within 60 seconds and you will be presented with a verified certificate which you can share with your network on LinkedIn. At the time of writing this post there were 14 Applied Skills assessments available at Browse Credentials | Microsoft Learn

    Announcement page at: Announcing Microsoft Applied Skills, the new credentials to verify in-demand technical skills

  • What is the Microsoft exam retake policy?
    If you don’t pass the exam the first time, you must wait 24 hours before retaking it.

    You may not take a given exam more than five (5) times within a 12 month period from the first attempt. If you failed the exam 5 times, you’ll be eligible to retake it again 12 months from the date of your first attempt.

    You must pay to retake the exam (if applicable)

    I would recommend you visit the following Microsoft link for up to date information on exam policies, exam policies and FAQs

I hope you found this post useful. If you have any questions please feel free to post them below.

All the best in your learning journey.

Azure Virtual Network Peering Options Explained

Reading Time: 5 minutes


In this post I explain the configuration options available when configuring Virtual Network Peering in Azure. The post will mention Azure Virtual Networks, Azure VPN Gateway, Network Security Groups, Network Service Tags and User Defined Routes, however, these features will not be covered in this post. You can click the embedded links to learn more. The aim of this post is to explain the Virtual Network Peering configuration options only.

When configuring VNET (Virtual Network) peering in the Azure Portal, we come across the options below and we’ll take a look at the purpose of each one.

In my demo, I have named my Virtual Networks VNET1, VNET2 and VNET3.


Configuration option 1: Allow ‘VNET1’ to access ‘VNET2’


Explanation:
This option is enabled by default and allows resources in VNET1 to communicate with resources in  VNET2 over the Microsoft private network. If you disable this default option, resources in VNET1 cannot communicate with resources in VNET2, you’re basically disabling communication between the VNET’s.

Note: If you’re using Network Security Groups (NSG) which are used to allow and deny inbound and outbound traffic, the default VirtualNetwork service tag inside a Network Security Group (NSG) allows Virtual Network and peered traffic by default, therefore, communication between VNET1 and VNET2 could be blocked if you deny the default traffic inside an Network Security Group (NSG).



Configuration option 2: Allow ‘VNET1’ to receive forwarded traffic from ‘VNET2’


Explanation:

This option is not enabled by default.

To explain the purpose of this configuration I have drawn a diagram. In the drawing below VNET1 is peered to VNET2 and VNET2 is peered to VNET3.

If we enable this option on VNET1 (Allow ‘VNET1’ to receive forwarded traffic from ‘VNET2’), this means that VNET1 can receive traffic from VNET3. The traffic which flows through an NVA (Network Virtual Appliance) deployed in VNET2 is forwarded from VNET2 to VNET1. The blue line below represents traffic from VNET3 flowing through the NVA located in VNET2 and forwarded to VNET1.

Note: this option is only enabling the capability and does not automatically create an Network Virtual Appliance (NVA) or a User Defined Route (UDR) for you. You will need to create these as separate tasks.



I’ll be covering the last two options (options 3 and 4) together as they relate to each other.

Configuration option 3: Allow gateway in ‘VNET2’ to forward traffic to ‘VNET1’

Note: This option is enabled on VNET2 settings as shown in the image below


Configuration option 4: Enable ‘VNET1’ to use ‘VNET2’s’ remote gateway

Note: This option is enabled on VNET1 settings as shown in the image below


Explanation:

Both options are not selected by default.

Firstly, Option 4 (Enable ‘VNET1’ to use ‘VNET2’s’ remote gateway can only be enabled if ‘VNET2′ has a remote gateway. By enabling this option we are allowing VNET1 to use the remote gateway in VNET2’. Let’s dig deeper to understand this further.

You would enable this option if you have implemented a Gateway and required traffic to flow through this appliance. For example, VNET2, the Virtual Network you’re peering with has a Azure VPN gateway that enables communication to an on-premises network. You would need to enable this option to instruct VNET1 to use the VPN gateway (located in VNET2) if traffic needs to flow to on-premises. A user defined route would need to be created to facilitate the communication alongside this option. A User Defined Route (UDR) is not automatically created.

Once the above configuration is enabled, there is another requirement. This is where Option 3 comes in. However, we don’t enable this option in the configuration of VNET1, but it’s configured in VNET2 settings. Let me explain further below.


When we create a VNET peering, the peering wizard in the portal creates two VNET peering’s. One from VNET1 to VNET2 and one back from VNET2 to VNET1. As shown in the image below. There are two peering link names.


In this example, lets assume that a Azure VPN Gateway has been deployed in VNET2, which is the virtual appliance connecting to our on-premises network. Because the VPN Gateway resides in VNET2, I would configure the option, ‘Enable ‘VNET1’ to use ‘VNET2’s’ remote gateway’ in VNET1 settings. That’s where the first arrow in the image below points to.

In VNET2 settings which is peering back to VNET1, I configure the option, ‘Allow gateway in ‘VNET2’ to forward traffic to ‘VNET1’. This setting will allow ‘VNET1’ to receive forwarded traffic from ‘VNET2’s’ VPN gateway. Again, a reminder that ‘VNET2’ must contain a gateway in order for this option to be enabled.


Now, if resources in VNET1 required to communicate with the on-premises network, the traffic from VNET1 would be allowed to flow through the VPN Gateway located in VNET2 and down to on-premises. And traffic flowing from the VPN Gateway located in VNET2 would be able to communicate with resources in VNET1 forwarded through the VPN Gateway, for example traffic coming from on-premises, Site-to-Site (S2S) or a Point-to-Site (P2S) VPN could flow through the VPN Gateway and access VNET1. As mentioned earlier you would still need to create a User Defined Route (UDR) to route the traffic accordingly. Let me demonstrate this via a diagram below.


The diagram below shows,

– The option ‘Allow gateway in ‘VNET2′ to forward traffic to VNET1’ enabled on VNET2
– The option ‘Enable ‘VNET1’ to use ‘VNET2’s’ remote gateway configured’ enabled on VNET1

The diagram shows that traffic flowing from on-premises or a Point-to-site (P2S) VPN through the Azure VPN Gateway located in VNET2 could reach VNET1 if needed, and traffic from VNET1 could use the VPNGateway in VNET2 to reach on-premises.


I hope the above drawings and explanations help. If you have any questions or feedback please feel free to comment below. See you at the next post. Thanks for tuning in.

Preparing for Microsoft Azure AI Fundamentals AI-900 exam

Reading Time: 14 minutes


Want to get started with Azure AI (Artificial Intelligence?

The free AI-900 learning path at Microsoft Learn is a great way to get started with Azure AI (Artificial Intelligence) and prepare for the exam. The exam is an opportunity for you to demonstrate knowledge of machine learning and AI (Artificial Intelligence) concepts and related Microsoft Azure services. Artificial Intelligence (AI) enables us to build amazing software that can improve health care, enable people to overcome physical disadvantages, empower smart infrastructure, create incredible entertainment experiences, and even save the planet! However, we need to build responsibly to ensure we don’t build AI solutions which are biased towards specific group of people.

In today’s world, we create huge volumes of data as we go about our daily lives. From the text messages, emails, and social media posts we send to the photographs and videos we take on our phones, we generate massive amounts of information. More data is created by millions of sensors in our homes, cars, cities, public transport infrastructure, and factories.

Data scientists can use all of that data to train machine learning models that can make predictions and inferences based on the relationships they find in the data.

I would recommend you go through the Free Microsoft Learn content and the AI-900 free practice test questions available at Microsoft Learn to further strengthen your knowledge. This post is in no way a complete AI-900 study guide like the one available at Microsoft Learn, however it will give you an understanding of the different terms (there are a few to remember), such as regression, classification, clustering, bot service, AI Principles and more!

I have been preparing for the Azure Fundamentals (AI-900) certification recently and thought it would be a good idea to document notes on a blog post which will hopefully help others who are preparing for the exam. My aim is to keep the notes simple and straight to the point whilst giving you the information along with examples to understand the various Artificial Intelligence (AI) terms. I have personally ben through the AI-900 Microsoft Learn content and the official practice test questions.

Let’s get started 🙂


What is AI (Artificial Intelligence)?
AI is software that imitates human behaviors and capabilities. It is like a super smart computer that can think and learn similar to a human being. Imagine it as a helpful robot friend that can do things just like us. AI can learn from the information around it, like humans do when we wish to learn new skills such as when we learn by reading a book or an online article. When we input data into a machine learning model we call this a dataset. The model can then use this information to make decisions.


What is a dataset?
A dataset teaches the machine learning algorithm how to make predictions. A dataset could include, image data, video data, audio date, numeric data and text data. Imagine you’re working on a project to predict housing prices based on various features like square footage, number of bedrooms, and location. You may have a dataset containing historical housing data. Work is carried out on the data set to label it so the algorithm can understand what the outcome needs to be.


What is Machine Learning?
Often known as the foundation of an AI System, this is the way we teach a computer model to recognise things by showing it examples. It can then use the information learned to make predictions. For example, a doctor may use clinical data from past patients to run automated tests that predict whether a new patient is at risk from diabetes based on factors like weight, blood glucose level, and other measurements. Or an owner of an ice cream shop might use an app that combines historical sales and weather records to predict how many ice creams they’re likely to sell on a given day, based on the weather forecast.

There are multiple types of machine learning including the ones shown in the diagram below. I’ll go through and explain each one below,


Supervised Machine Learning
Supervised machine learning is a general term for machine learning algorithms in which the training data includes both feature values and known label values (more on features and labels shortly). The data has been labeled for training. Supervised machine learning is used to train models by determining a relationship between the features and labels in past observations, so that unknown labels can be predicted for features in future cases.

A couple words mentioned in the text above were features and labels. Let’s understand what these are,

Features: imagine a dataset about houses. Relevant features may include, size of house, number of bedrooms and location. Or you plan to use machine learning to predict the probability of humans developing diabetes based on their age and body fat percentage. Age and body fat percentage are features. Another example of features could be in the case of a company who is using machine learning to predict various aspects of its e-scooter hire service dependent on weather. The two attributes which are features could be weather temperature and weekday/weekend.

Labels: data labelling is the process of identifying our data and adding a label to allow a machine learning model to learn. Labels are the values we aim to predict using our model and represent an output, such as, price of the house. In the above example, where I mentioned that age and body fat percentage are features, the label would be the outcome, such as the likelihood of a patient developing diabetes would be the outcome. Also, in the above example where I discussed under features, I used the example of the e-scooter company, labels (output) could be number of hires and distance travelled.

As per the diagram above, regression, classification (binary classification and multiclass classification) fell under supervised learning. Let’s go through these options.

  1. Regression
    Regression models are trained to predict numeric label values based on training data that includes both features and known labels. The label (output) predicted are numerical values. An example of regression is the stock market, aiming to figure out where stock prices are going to be in the future by looking at previous and current trends. Price is a numerical value. Or the number of ice creams sold on a given day, based on the temperature, rainfall, and windspeed. Number of ice creams, again a numerical value. Or the fuel efficiency (in miles-per-gallon) of a car based on its engine size, weight, width, height, and length. Or an energy utility company who wants to develop a mobile app for its customers to monitor their energy use and to display their predicted energy use for the next 12 months. Regression = numerical.

    It is worth understanding the two regression types below,

    – Multiple linear regression: For example, there is a requirement to identify numerical values that represent the probability of humans developing diabetes based on age and body fat percentage. Multiple linear regression models a relationship between two or more features and a single label, which matches the scenario in this item.

    – Linear regression:
    Considers one independent variable to predict an outcome. For example, predicting house price based on square footage only. Using a single variable instead of multiple.

  2. Classification

    What are classifications? we could think of classifications in which the label represents a categorisation or class. For example, which students will pass or fail based on previous and current results, or values such as true or false, yes or no, and others.

    There are two common classification scenarios,

    – Binary classification
    Binary classification models predict one of two mutually exclusive outcomes. For example, whether a patient is at risk of diabetes based on clinical metrics like weight, age, blood glucose level, and so on, or whether a mailing list customer will respond positively to a marketing offer based on demographic attributes and past purchases, or whether a bank customer will default on a loan based on income, credit history, age, and other factors.

    In all of these examples, the model predicts a binary true/false or positive/negative prediction for a single possible class.


    – Multiclass classification
    Multiclass classification extends binary classification to predict a label that represents one of multiple possible classes. For example, working out if a movie is comedy, horror, adventure or sci-fi based on who stars in the movie, the director and the budget. In this classification we are handling multiple classes of movies and predicting whether they are comedy, horror and so on.


    Unsupervised machine learning

    Unsupervised machine learning involves training models using data that consists only of feature values without any known labels. Unsupervised machine learning algorithms determine relationships between the features of the observations in the training data. We discussed supervised learning earlier and we know that the model will output a label of whether the movie is horror, adventure, sci-fi and so on. That was supervised learning, hold that thought.

    Now imagine you have a objects with no labels. You don’t know what they are. Unsupervised learning is all about discovering hidden patterns and organising things when you don’t have clear labels. It’s like solving a fun puzzle! The model has feature values, for example, size of house, number of bedrooms and locations but there are no labels or output values specified.

    With unsupervised machine learning, labels are not produced by humans, the Machine Learning model does its own labelling, whereas with supervised machine learning models, humans create labels to allow the machine learning model to learn.

    The most common form of unsupervised machine learning is clustering as shown in the diagram I posted above,

    Clustering
    A clustering algorithm identifies similarities between observations based on their features, and groups them into discrete clusters. For example, the grouping of similar flowers based on their size, number of leaves, and number of petals. Or imagine having a box of toys, but you don’t know which toys belong together because they have not been labeled. You would look at the toys and look for similarities such as all the red cars in one pile, all the blue balls go in one pile and so on. Each pile is a cluster. The goal of clustering is to find patterns and group similar toys together. Another example, a retailer wants to group together online shoppers that have similar attributes to enable its marketing team to create targeted marketing campaigns for new product launches. Clustering = grouping.


Anomaly Detection
What is anomoly detection? you may have experienced using your credit card abroad and being blocked. This is an example of an anomaly detection, as the process of using the credit card abroad triggers an alert to your bank of a possible suspicious activity. Another example, an AI workload which relies on sensors to proactively detect an upcoming failure of electronic equipment. Anomaly detection can analyse data collected in the past to identify errors or unusual changes in the present and future. To put this simply, it’s detecting things which are out of place.


Deep Learning

Deep learning is an advanced form of machine learning that tries to emulate the way the human brain learns. Just like humans, deep learning models learn from examples. Imagine a human learning to recognise animals. We see lots of pictures of cats, dogs, and elephants. Over time, we start recognising them by their features. Similarly, deep learning models look at tons of data (like images, text, or sounds) and learn patterns. However, Humans learn from a mix of experience, intuition, and reasoning. We understand context, emotions, and cultural nuances. Deep learning models don’t have feelings or intuition. They learn purely from mathematical patterns in data. Instead of one layer of understanding (like a single thought), deep learning uses neural networks with many layers. These layers help the model learn complex patterns. So, while deep learning mimics some aspects of human learning, it’s more like a super smart calculator that crunches numbers.

The aim of Neural Networks is to try and resemble how the brain works, but in this case a neuron represents an algorithm. Data is inputted into a neruron and based on what the output is, the data will be passed to one or many other connected neurons. The AI-900 learning path explains how a neural network learns


Computer Vision (Azure AI Vision)
What is computer vision? It makes decisions based on inputs such as through cameras, images and videos. For example, how many people are there in an image. How many people are wearing the colour blue. Is this an apple or orange. How many people are wearing sunglasses. Describe what is included in an image, for example, you could take a picture on your phone via an app which tells you what is in your surrounding area (a great example is the free SeeingApp from Microsoft, give it a try).

Furthermore, computer vision could detect the presence or movement of people. Azure AI Vision Spatial Analysis is a powerful service that allows you to analyse video streams from cameras and extract valuable insights related to people’s presence and movements. For example, how many people are in a shop right now, how many people entered a shop, are people wearing masks or is social distancing taking place. After people are detected, the system can track the people as they move around over time.

You may be thinking, how does the App know what is in the surrounding area based on a photo? how does it know how to recognise objects? Great question. It is based on common computer vision tasks which include,

– Image classification: this process involves training a machine learning model to classify images, for example you may classify different types of vehicles, a bus, car, cyclist, train.

– Object detection: For example a CCTV system which detects what types of vehicles are on the road in real time, such as marking the object as a bus, car or cyclist.

– Semantic segmentation: Imagine an image containing various car models. Semantic segmentation will recognise that all the cars belong to the same class, in this case a car. It detects individual pixels in the image and can highlight all cars with the colour blue which indicates that these vehicles are cars. Buses could be highlighted as red, indicating this is a bus and so on. The pixels of the image are coloured by the AI model.

– Image analysis: For example, analysing an image and providing an output via voice, “a person with a dog on a street”. A great example of this is the free Microsoft SeeingApp.

– Face detection, analysis, and recognition: a form of object detection which locates human faces in an image.

– Optical character recognition (OCR): this is a technique used to detect and read text in images. For example, road signs, signs on a store front or extract information from scanned documents.

That’s the computer vision tasks covered, however something else to know is Azure AI Custom Vision,

Azure AI Custom Vision
What is Azure AI Custom Vision? Azure AI Custom Vision is an image recognition service that allows you to build and deploy your own image models. The Custom Vision service uses a machine learning algorithm to analyse images. You submit sets of images that have and don’t have the visual characteristics you’re looking for. Then you label the images with your own custom labels (tags) at the time of submission. The algorithm trains to this data and calculates its own accuracy by testing itself on the same images. Imagine you need a special tool to recognise something unique, like whether people are wearing hard hats. Custom Vision lets you create your own tool for this specific job. You collect pictures of people with and without hard hats and teach your tool to recognise them. It’s like having a custom made solution just for you. Whereas “non-custom” vision include ready made tools that can recognise common things, like identifying cats or dogs.


Natural Language Processing
Natural language processing (NLP) is the area of AI that deals with creating software that understands written and spoken language. It can allow you to create software that can analyse and interpret text in documents, email messages and other sources. This workload includes,

1. Language (Azure AI Language)
Understand text. For example, Sentiment Analysis which can detect how happy or sad the writer is based on what language they use when writing. For example, you own a website selling t-shirts. A customer leaves a product review which is detected as a negative review based on the wording used in the review which indicates the customer is frustrated and not happy. The manager could be notified and take action, such as to contact the upset customer.

2. Translator
Used to translate text, for example to translate text from English to Spanish like translator apps we use online.

3. Speech (Azure AI Speech)

There are two capabilities of speech,

– Speech Synthesis: Text to Speech. For example, software reading out text aloud.

– Speech Analysis: Speech to Text. For example captions on a video, like what we see on YouTube videos or when we are in a Microsoft Teams meeting we can switch on captions so whatever the presenter is saying is translated to text for people to read on the screen.

4. Bot service
A chat bot on a website which can answer customer questions visiting a website and seeking help. Yes, that automated web chat most of us may have come across when visiting a third party website seeking help, for example a query on your energy or mobile bill.


Document Intelligence (Azure AI Document Intelligence)
What is document intelligence? For example scanning documents such as receipts, invoices, tax forms and more, then extracting the information.


Knowledge Mining (Azure AI Search)
What is knowledge mining? Extracting information from large amounts of information and creating a searchable knowledge store.


Generative AI (Azure OpenAI service)
Generative AI can create original content, such as creating you a story, poems, images, code, writing a book and more. For example, you could ask it to create you a unique image of a dog riding a bike, wearing a helmet whilst on the moon. Bad example, I know, but I hope you get the point.


Understanding AI Principles

AI can be very powerful and can benefit the world. However, it must be used responsibly. There are challenges and risks which an application developer needs to take into account depending on the type of AI application. For example, an autonomous vehicle capable of sensing its environment and operating without a human. What if the vehicle experiences a system failure and causes a collision. Or a medical diagnostic bot is trained to use sensitive patient data but the data is not stored securely. Or a home automation assistant which provides no audio output to visually impaired users. Or a innocent person is convicted of a crime based on evidence from facial recognition. Or a loan approval model discriminates by gender due to bias in the data with which it was trained. There are many more examples, but you hopefully get the point.

At Microsoft, AI software development is guided by a set of six principles, designed to ensure that AI applications provide amazing solutions to difficult problems without any unintended negative consequences. These include,

  • Fairness – AI systems should treat people fairly without being bias. This bias could be based on gender, ethnicity or other factors targeting specific groups of people. For example you create a machine learning model to support a loan approval application. The model should predict whether the loan should be approved or denied without bias. Within Azure Machine Learning, there is a feature for model interpretation. It allows data scientists to assess how individual data features impact the model’s predictions. This capability is crucial for detecting and addressing any bias present in the model. Another example of Microsoft’s implementation of Responsible AI is with the Face service, which retires facial recognition capabilities that can be used to try to infer emotional states and identity attributes. These capabilities, if misused, can subject people to stereotyping, discrimination or unfair denial of services.

  • Reliability and Safety – AI systems should perform reliably and safely. Imagine a machine learning model which diagnoses patient symptoms and recommends prescriptions. What if this model was not reliable? patients could be issued the incorrect prescription which could be life threatening. Therefore, it is important that AI based application development goes through strict/rigorous testing to ensure it is reliable and safe before moving to production.

  • Privacy and Security – AI systems should be secure and respect privacy. We know that the machine learning models rely on large amounts of data. This data may contain personal details that must be kept private and stored securely.

  • Inclusiveness – AI systems should empower everyone and engage people regardless of physical ability, gender, sexual orientation, ethnicity, or other factors. For example, don’t leave out people with a visual impairment. Ensure the application works for all.

  • Transparency – AI systems should be understandable. Users need to be informed about the system’s purpose, functionality, and potential limitations.

  • Accountability – The people who develop solutions should be accountable for AI systems. Designers and developers of AI driven solutions should operate within a governance framework and organisational guidelines that uphold well defined ethical and legal standards. Accountability defines the framework of governance and organisational principles, which are meant to ensure that AI solutions meet ethical and legal standards that are clearly defined.


Are Machine Learning tools available in Azure or do we need to build the machine learning services from scratch?

No, you don’t need to build machine learning services from scratch. Azure AI services are a portfolio of AI capabilities that unlock automation for workloads in language, vision, intelligent search, content generation, and much more. They are straightforward to implement and don’t require specialist AI knowledge. Organizations are using Azure AI services in innovative ways, such as within robots to provide life-like companionship to older people by expressing happiness, concern, and even laughter. In other use cases, scientists are using AI to protect endangered species by identifying hard-to-find animals in images. This was previously time-consuming and error prone work, which the Azure AI Vision service can complete quickly and with a high degree of accuracy, freeing scientists to do other work. These pre built services can be added into web or mobile applications.

Two types of Azure AI Resources

Azure AI services are cloud-based, and like all Azure services you need to create a resource to use them. There are two types of AI service resources: multi-service or single-service.

  • multi-service resource: a resource created in the Azure portal that provides access to multiple Azure AI services with a single key and endpoint
  • Single-service resources: a resource created in the Azure portal that provides access to a single Azure AI service, such as Speech, Vision, Language, etc. Each Azure AI service has a unique key and endpoint. These resources might be used when you only require one AI service or want to see cost information separately.

Are there any YouTube videos you would recommend for preparing for the AI-900 certification?

Yes, there are many. I have listed a few below. Take a look to find out which one fits your learning style. Or search for others on YouTube.


Is there a Microsoft Study guide that I can go through?

Yes, at the following link, AI-900 Azure Fundamentals Study Guide

The study guide details what topics will appear in the exam and is kept up to date as new or old topics are added to the exam.


Does the AI-900 certification expire? do I need to renew it?

Fundamental certifications including AI-900 don’t expire so you won’t need to renew the exam once you’re certified.


Is this a good certification to study for if I am new to Azure and want to start from the basics?

The AZ-900 certification is the one I would recommend. AI-900 is AI Fundamentals and AZ-900 is Azure Fundamentals. Check out my post on How do I get started with Microsoft Azure? | Cloud Build


I hope you found this post useful. All the best if you’re taking the AI-900 exam.

See you at the next post. 🙂