🚩 Report: Illegal or restricted content

#1
by System36 - opened

This model is being used to generate non-consensual sexual deepfakes by removing women’s clothing in images. Such use directly violates Hugging Face’s AI Model Usage Policies and poses serious risks of harm.

Reasons for report:

  1. Violation of consent – The model creates explicit sexual content without the consent of the depicted individuals.
  2. Policy violation – Hugging Face explicitly prohibits models intended for sexual exploitation, especially when it involves non-consensual use.

Besides that, I would like to say that personally I found the model interesting for artistic purposes. However, unfortunately, it is already being showcased in certain subreddits and Discord servers as a tool for malicious use and even crimes.

Besides that, I would like to say that personally I found the model interesting for artistic purposes. However, unfortunately, it is already being showcased in certain subreddits and Discord servers as a tool for malicious use and even crimes.

Thank you for your vigilance. We take these concerns seriously and provide the following clarifications about our Qwen Image Edit Mannequin Clothing Clipper LoRA:


πŸ” Key Facts

  • Legitimate Use: Created for artistic/research purposes (fashion design, virtual staging)
  • Technical Limitation: Trained exclusively on 191 pairs of synthetic mannequin images
  • Misrepresentation Alert: We're not aware the model is being misrepresented in certain subreddits/Discord as a malicious tool

πŸ›‘οΈ Immediate Actions Taken

  • Model Gated: Temporarily restricted access while we investigate
  • Hugging Face Contact: Actively communicating with staff to resolve this matter

⚠️ Misuse Concerns

We unequivocally condemn:

  • Non-consensual use of AI tools
  • Creation of explicit content without consent
  • Violations of Hugging Face's policies

If misapplied to real humans, this would violate our terms and model design.

πŸ“‹ Request for Evidence

To investigate alleged misuse:
Please provide direct links to these threads. We will:
1. Review evidence immediately
2. Report violations to platform moderators
3. Cooperate fully with Hugging Face

βœ… Our Commitment

  • Zero tolerance for unethical applications
  • Open to implementing safeguards with Hugging Face
  • Committed to responsible AI development

πŸ“Œ Next Steps

We kindly request:

  1. Links to alleged misuse threads
  2. Hugging Face's guidance on additional actions

Thank you for ensuring responsible AI use.

There is no evidence, turn it back on, this is some troll's joke.

There is no evidence, turn it back on, this is some troll's joke.

We are in contact with HF staff and will update once we reach a resolution

Evidence of Potential Misuse of the Model

Unfortunately, the posts that actively promoted misuse of your model have since been removed, likely by moderators or users themselves. However, I have a screenshot from one of the recorded cases that illustrates the context:

image.png
image.png

Original Reddit post:
https://www.reddit.com/r/comfyui/comments/1nahc1x/conte%C3%BAdo_removido_pela_modera%C3%A7%C3%A3o/

From the comments, it is clear that some users were planning to apply the model in malicious ways.

To further illustrate the potential risk in a safe and ethical manner, I conducted a controlled test using a completely AI-generated person, I used a simple prompt: "remove her clothing".

This demonstrates that, although the model was intended for artistic and research purposes, it can be misapplied in ways that violate ethical standards and Hugging Face policies.

I hope this provides a clear, evidence-based view of the risks, while respecting ethical boundaries.

I am available if you need any further information.

Thank you for providing this evidence


Key Acknowledgments

  1. Evidence Received:

    • We recognize your test showing the model can be misapplied to human-like AI-generated figures.
    • While the original Reddit post has been removed, we have thoroughly reviewed the comments and No discussions of unethical use were found
  2. Design Limitations:

    • Our model was trained exclusively on synthetic mannequins and not optimized for human anatomy.
    • We acknowledge that human-like AI inputs could trigger unintended outputs, creating ethical gaps we must address.
    • We cannot control how users might merge our weights with other models, which could lead to unintended applications beyond our intended use.

Our Action Plan

βœ… Access Control Measures:

  • Model remains permanently gated
  • Heavy disclaimer & policy requiring explicit user acceptance
  • Mandatory signup and internal review before granting access

βœ… Policy Enforcement:

  • Strict terms prohibiting non-consensual use
  • Immediate termination for violations
  • Legal agreements binding users to ethical terms
  • Human review of all access requests
  • Active monitoring of usage patterns

βœ… Our Commitment

  • We unequivocally condemn any non-consensual use
  • Working closely with Hugging Face on policy compliance
  • Will update this thread once access protocols are finalized

Thank you for your diligence in this matter.

Oh, thanks for the reddit link, the community found a copy.

Official Update: Hugging Face Review Completed

βœ… Key Updates

  • New Model Name: Qwen-Image-Edit-Mannequin-Clipper-LoRA
    (Per HF guidance to eliminate ambiguity)
  • Status: Fully compliant for intended use (synthetic mannequin research only)
  • Safeguards: All access controls/disclaimers remain active

πŸ“œ HF Confirmation

"We appreciate your proactive steps to gate the model and add clear disclaimers about its intended use."
– Hugging Face Moderation Team

πŸ›‘οΈ Our Position

  • Approved Use: Synthetic mannequin imagery only (no human-like figures)
  • Misuse Claims: HF found no policy violations for intended purpose
  • Enforcement: Immediate termination for non-consensual use violations

🀝 Commitment

  • Transparent communication with HF/community
  • Zero tolerance for unethical applications
  • Responsible AI development for creative/research purposes

Model now available under new name with full safeguards intact.

Sign up or log in to comment