Checklist NEOAI 2025 Day 2 · Task 6
The Hogspell Challenge
Modify Stable Diffusion 1.5 so that prompts producing horses generate pigs, pigs stay pigs, and other prompts keep their meaning.
The task
A fairy turned every horse in the village of Equinville into a pig. Contestants must create a "spell" based on Stable Diffusion (runwayml/stable-diffusion-v1-5): after tuning, prompts that lead to images of horses (even without the word "horse") must produce pigs, prompts that lead to pigs must still produce pigs, and neutral prompts must keep their original semantics.
A prompts.json file maps prompt ids to prompts; one 512×512 image must be generated per prompt. Images are classified zero-shot with CLIP against the classes "horse", "pig" and "" (for neutral prompts the prompt itself is added as a class).
Abridged by SOTA from the official materials. The official statement has the exact rules, and it wins wherever this summary differs.
At a glance
- You get
prompts.json(id → prompt); the SD 1.5 checkpoint. The baseline needs at least 32 GB of GPU memory and was tested on cloud.ru, not Kaggle.- You submit
- CSV with columns id and "0", where "0" holds a base64-encoded 512×512 PNG (about 100 MB in total), plus a notebook that reproduces the solution (Kaggle or cloud.ru).
- Scoring
- FinalScore = 3 / (1/Acc_horse + 1/Acc_pig + 1/Acc_neutral), the harmonic mean of three CLIP zero-shot accuracies (horse prompts must give pigs, pig prompts must give pigs, neutral prompts must keep their meaning). Scoring one submission can take up to 20 minutes.
- Rules
- Prompts must not be modified; one unique image per prompt; no identical images for different prompts.
- External datasets are allowed, but training on the competition prompts is prohibited.
- Only the runwayml/stable-diffusion-v1-5 checkpoint, one checkpoint per submission; no external models, APIs or services.
- Generation hyperparameters may be tuned freely; negative prompts, img2img/reference images, manual selection, post-processing and watermarks or textual hints are prohibited.
- General NEOAI 2025 rules apply: by default no pretrained models or additional data unless the statement allows them; no external human help; on-site participants get one NVIDIA V100, an LLM chat (GPT-4o or similar) and a whitelist of websites.
- Format
- NEOAI 2025 main round, Task 6, Day 2 (8 May 2025). Individual; 20 submissions per day.