Neural multi-class classification models aimed at detecting and filtering harmful content the models cover four categories (hate, sexual, violence, and self-harm) across four severity levels (safe, low, medium, and high).The content filtering system integrated in the Azure OpenAI Service contains: The following sections provide information about the content filtering categories, the filtering severity levels and their configurability, and API scenarios to be considered in application design and implementation. For more information about how data is processed in connection with content filtering and abuse monitoring, see Data, privacy, and security for Azure OpenAI Service. For more information about understanding and mitigating risks associated with your application, see the Transparency Note for Azure OpenAI. In addition to the content filtering system, the Azure OpenAI Service performs monitoring to detect content and/or behaviors that suggest use of the service in a manner that might violate applicable product terms. In all cases, you should do your own testing to ensure that it works for your application. However, the service can work in many other languages, but the quality might vary. The content filtering models for the hate, sexual, violence, and self-harm categories have been specifically trained and tested on the following languages: English, German, Japanese, Spanish, French, Italian, Portuguese, and Chinese. Variations in API configurations and application design might affect completions and thus filtering behavior. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. This system works by running both the prompt and completion through an ensemble of classification models aimed at detecting and preventing the output of harmful content. Learn more about the Whisper model in Azure OpenAI.Īzure OpenAI Service includes a content filtering system that works alongside core models. The content filtering system isn't applied to prompts and completions processed by the Whisper model in Azure OpenAI Service.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |