Perform the following in the Azure Console:

1. Go to Azure Active Directory
2. Go to Users and group
3. Go to Group settings
4. Set Self-service group management enabled to No

References:

1. https://docs.microsoft.com/en-us/azure/active-directory/active-directory-accessmanagement-self-service-group-management