漫画工厂ai-comic-factory 文字2漫画

• 人工智能

demo入口https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory

最终展示

漫画工厂ai-comic-factory 文字2漫画

大概流程：

  1. 选漫画分格
  2. 输入需要将啥故事X
  3.  X 通过Llama2 70B 生成具体的每个分割图的描述Y
  4. Y 通过SDXL 生成图

LLM: llama-2 is used to generate the captions of 4 comic panels (prompt source code)

Stable Diffusion:

– I run SDXL 1.0 (no fine-tuning, no LoRA) 4 times, one for each panel (prompt source code)

– 25 inference steps

– various resolutions to change the aspect ratio (1024×768, 768×1024, also did some testing with 1024×512, 512×1024)

其中核心部分就是prompt生成

漫画工厂ai-comic-factory 文字2漫画

https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory/blob/main/src/app/queries/getStory.ts#L17-L32

参考：

GitHub – jbilcke-hf/ai-comic-factory: Generate comic panels using a LLM + SDXL. Powered by Hugging Face 🤗

https://www.reddit.com/r/StableDiffusion/comments/163ikmd/wip_comic_factory_a_web_app_to_generate_comic/

https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory/blob/main/src/app/queries/getStory.ts#L17-L32

本文来自网络，不代表协通编程立场，如若转载，请注明出处：https://net2asp.com/46f31dd49f.html

赞 (0)
« 上一篇 1天前
下一篇 » 1天前

相关推荐