Image Moderation detects and filters unwanted content such as written texts, faces, and objects from images and videos. It is mainly used to moderate adult-only content that is generally inappropriate for people under the age of 18 that includes NSFW (Not Safe For Work) occurences: nudity, sexual activity, profanity, or any type of violence.
In addition to inappropriate content, it can also be used to detect fraud to block scammers, personal information (phone numbers, emails, social security numbers), minors, or even the presence of celebrities.
The Image Moderation API predicts whether an image contains potentially explicit content based on a probability score between 0 and 1. It also returns a determination of whether the image meets the conditions (true or false).
Image Moderation APIs can detect degrees of nudity: from partial nudity (bikini, underwear, cleavage, barechest), to full nudity (naked bodies) to explicit nudity (suggestive poses, sexual content), it attributes percentages of confidence to your images and videos.
Detects offensive gestures, signs, and texts in images considered inappropriate: middle fingers, far-right flags, bad words, hateful language, etc. It is a great tool to moderate user-generated content to keep communities on social platforms safe from extremist content, harassment, and misinformation.
Again, the goal here is to moderate user-generated images or videos to remove or blur any gun-related content (along with other types of weapons) or displays of alcohol or drugs.
Image Moderation APIs also help detect graphic violence and gore such as blood, wounds, self-harm, human skulls, etc.
While comparing Image Moderation APIs, it is crucial to consider different aspects, among others, cost security and privacy. Image Moderation experts at Eden AI tested, compared, and used many Image Moderation APIs of the market. Here are some actors that perform well (in alphabetical order):
For all the companies who use Image Moderation in their software: cost and performance are real concerns. The market is dense and all those providers have their own benefits and weaknesses.
Performances of Image Moderation APIs vary according to the specificity of data used by each AI engine for their model training. This means that some Image Moderation APIs perform well at detecting pornography while others may perform better at detecting violence in images. If you have customers coming from different fields, you must consider this detail and optimize your choice of provider.
Companies and developers from a wide range of industries (Social Media, Retail, Health, Finances, Law, etc.) use Eden AI’s unique API to easily integrate Explicit Content Detection tasks in their cloud-based applications, without having to build their own solutions.
Eden AI offers multiple AI APIs on its platform amongst several technologies: Text-to-Speech, Language Detection, Sentiment analysis API, Keyword Extraction, Summarization, Question Answering, Data Anonymization, Speech recognition, and so forth.
We want our users to have access to multiple Image Moderation engines and manage them in one place so they can reach high performance, optimize cost and cover all their needs. There are many reasons for using multiple APIs:
You need to set up an Image Moderation API that is requested if and only if the main Image Moderation API does not perform well (or is down). You can use confidence score returned or other methods to check provider accuracy.
After the testing phase, you will be able to build a mapping of Image Moderation vendors’ performance that depends on the criteria that you chose (languages, fields, etc.). Each data that you need to process will then be sent to the best Image Moderation API.
You can choose the cheapest Image Moderation provider that performs well for your data.
This approach is required if you look for extremely high accuracy. The combination leads to higher costs but allows your AI service to be safe and accurate because Image Moderation APIs will validate and invalidate each other for each piece of data.
Eden AI has been made for multiple AI APIs use. Eden AI is the future of AI usage in companies. Eden AI allows you to call multiple AI APIs.
You can see Eden AI documentation here.
The Eden AI team can help you with your Image Moderation integration project. This can be done by :
In this article, we explain how the mapping between the input language and the languages supported by the providers is performed to facilitate access to one of our AI engines.