Flux PuLID简介
在之前的文章中已经介绍过Flux模型中的最新风格一致性保持和迁移组件:Pulid-Flux。这是字节Pulid团队继SDXL的Pulid版本沉淀基础上再次出发布的PuLID-FLUX-v0.9.0 Flux版本风格一致性组件。能够提供了一个无需调整的身份ID一致性和定制化解决方案,能够被应用于风格一致性保持领域包括:人物写真、连续多图漫画展示和视频等领域作为核心问题之一。更多内容参见之前文章:[ComfyUI]Flux:写真新篇章!字节PuLID率先开启一致性风格迁移,无损画手和优质画面保持。本文将配合Flux_小红书真实风格丨日常照片丨极致逼真LORA模型出图,模型详情参见:[ComfyUI]Flux:超真实!小红书真实风格|假期打卡|日常照片|极致逼真。
- 在线体验地址:https://huggingface.co/spaces/yanze/PuLID-FLUX
- github地址:https://github.com/ToTheBeginning/PuLID
- ComfyUI-PuLID-Flux地址:https://github.com/balazik/ComfyUI-PuLID-Flux
PuLID-Flux ComfyUI体验
社区插件ComfyUI-PuLID-Flux已支持PuLID-FLUX-v0.9.0 模型了。需要通过ComfyUI插件管理器Git安装该插件。
- ComfyUI插件地址:https://github.com/balazik/ComfyUI-PuLID-Flux
- Pulid_flux_v0.9.0.模型下载:模型放置到目录/ComfyUI/models/pulid/下。下载地址:https://huggingface.co/guozinan/PuLID/blob/main/pulid_flux_v0.9.0.safetensors?download=true
- EVA02-CLIP-L-14-336下载:该模型会在首次运行时自动下载到huggingface缓存目录,如未自动下载请使用下列hf_hub_download方案。
- facexlib模型:模型将在首次运行时候自动下载。
- AntelopeV2模型:AntelopeV2模型会自动下载并解压到目录/ComfyUI/models/insightface/models/antelopev2下。注意:这里插件有个bug,在解压时会多一个目录/antelopev2/antelopev2,需要手动去掉多余目录。下载地址为:https://github.com/deepinsight/insightface/releases/download/v0.7/antelopev2.zip
EVA02_CLIP_L_336_psz14_s6B手动安装:
from huggingface_hub import hf_hub_download
hf_hub_download('QuanSun/EVA-CLIP' ,'EVA02_CLIP_L_336_psz14_s6B.pt')
Flux 文生图工作流
关于Flux模型本地ComfyUI工作流体验参见之前文章:FLUX[续篇]:12B参数23G最大开源文生图模型,Dev版直出惊艳美图欣赏.
本文涉及ComfyUI工作流和模型均可在LIBLIBAI上下载或在线运行体验:
- FLUX.1哩布在线可运行-黑暗森林工作室:https://www.liblib.art/modelinfo/488cd9d58cd4421b9e8000373d7da123
- Flux_小红书真实风格丨日常照片丨极致逼真:https://www.liblib.art/modelinfo/d9675e37370e493ab8bf52046827a2b0
- Boreal-FD: (Boring Reality Flux-Dev LoRA):https://civitai.com/models/639937/boreal-fd-boring-reality-flux-dev-lora?modelVersionId=810340
- 工作流-Flux文|图生图+LORA+CN+提示反推一键切换工作流:https://www.liblib.art/modelinfo/782aacd70f604da39e83368c696a02a8
PuLID-Flux工作流
PuLID-Flux工作流仅需在基础文生图工作流基础上,增加PulidFluxModelLoader、ApplyPulidFlux、PulidFluxInsightFaceLoader、PulidFluxEvaClipLoader4个核心节点即可。
PuLID-Flux工作流全貌
PuLID-Flux工作流可在LIBLIB平台下载体验:https://www.liblib.art/modelinfo/500f83a315f343a98a9ae765b4776c8b 。
注意:PuLID-Flux插件同时支持GGUF版本运行,GGUF详情参见:[ComfyUI]Flux:社区欲放弃NF4投向GGUF?更低质量损失,最低6G显存福音。另外,作者提到:该项目受到 cubiq/PuLID_ComfyUI 插件的启发。当前版本只是一个原型版本,使用了编码器的一些hacks技巧实现。在之后版本将会使用更正式的方式重新实现插件。
输入图像
(网图侵删)
01. 出海打卡
xhs, This is a high-resolution digital photograph of a young East Asian woman with a fair complexion and delicate features, A woman enjoying a sunny day on a boat, casually leaning on the railing and smiling warmly at the camera, her dark brown hair pulled back into a braid with a few strands blowing in the wind, wearing sunglasses, a black off-the-shoulder top, and denim shorts, creating a relaxed and comfortable look, with a calm body of water in the background and a shoreline dotted with trees and buildings, suggesting a peaceful, scenic setting, captured in a casual style with natural lighting adding warmth to the scene.
02. 骑行打卡
xhs, Nikon D3S professional digital SLR camera with lens, Asian girl, which is a high-resolution photograph featuring a young Asian woman in a rural outdoor setting. The woman is standing beside a red road bike, positioned slightly off-center to the left. She has long, wavy black hair cascading over her shoulders and is wearing a white cycling helmet with a sleek design. Her outfit consists of a form-fitting, light pink and white tie-dye short-sleeved cycling jersey and matching cycling shorts, emphasizing her slender physique. The jersey has a front zipper, and she is wearing white cycling socks with black stripes and white sneakers. Her expression is serene and contemplative as she gazes off into the distance, possibly enjoying the scenery. The background features a vast, golden-brown field stretching out to the horizon, with a few scattered trees and a cloudy sky, suggesting a late spring or early summer day. The overall mood of the image is calm and serene, capturing a moment of peaceful reflection in a serene rural setting.
03. 司机出游
xhs,Asian girl, a close-up of a young woman with long brown hair sitting in a car, looking directly at the camera,a close-up of a woman with long brown hair and brown eyes, wearing gold hoop earrings,a close-up of a woman's face with long brown hair and a black shirt,a close-up of a woman wearing a delicate gold chain choker with a small heart-shaped pendant