Joy Caption Model Introduction
Today's article topic will introduce you to an excellentImage Inversion Model:Joy CaptionThis is by the authorFancy FeastThe Joy Caption model developed is based on Google's SigLIP model and Meta's latest Llama3.1 model, using the Adapter adaptation mode and the well-trained excellent image reverse description LLM model. It can output corresponding image description prompts with rich details according to the user's set parameters.
- Google's SigLIP (Sigmoid Loss for Language Image Pre-Training) is an improved multimodal model, similar to CLIP, but with a better loss function. Download address: https://huggingface.co/google/siglip-so400m-patch14-384
- Meta-Llama-3.1-8B-bnb-4bit is an optimized LLM large language model based on Meta's Llama 3.1 architecture. It uses the BitsAndBytes library for 4-bit quantization, which greatly reduces memory usage while maintaining model performance and accuracy. Download address: https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit.
- Online experience address: https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha
Flux Joy Caption prompts reverse push experience
The current community already has ComfyUI plug-in support: Comfyui_CXH_joy_caption. You only need to download the corresponding model and install the plug-in to start the experience. Due to the complex environment operation or local resource bottlenecks, the operation of large models has become a threshold for local deployment. This article will introduce a free way to use the previous article.BizyAir Plugin, you can easily use joy_caption's excellent image inversion capabilities without any barriers.BizyAir PluginPlease refer to the previous article for installation: Flux: Are you still worried about Flux consuming video memory? BizyAir does not require video memory. Local ComfyUI experience cloud resource acceleration, free Dev ultra-fast drawing experience
If you are confident that you can handle the deployment environment, you can also try the Comfyui_CXH_joy_caption plug-in in case the free period ends. For detailed instructions, please refer to the Github plug-in homepage. Plug-in address: https://github.com/StartHua/Comfyui_CXH_joy_caption
Flux Wensheng Diagram Workflow
The Flux Wensheng graph model has been introduced in the previous article. For basic installation, please refer to the article:FLUX [Sequel]: 12B parameter 23G largest open source Wensheng graph model, Dev version directly outputs stunning pictures to appreciate
- Flux text | Picture + LORA + CN + prompt reverse one-click switching workflow: https://www.liblib.art/modelinfo/782aacd70f604da39e83368c696a02a8
- Low Video Memory - Flux-Dev - GGUF Workflow (text | image): https://www.liblib.art/modelinfo/bf3320e00f1649a69f5835101ef04276
Joy Caption+Flux Wenshengtu Workflow
Just add a BizyAir inverse node to the above Wenshengtu workflow. The workflow has been uploaded to the LIBLIB platform, the workflow address is: https://www.liblib.art/modelinfo/3e9699c20bea4582aada692c4adccf20
Notice: If the image is too large to be supported, you can set it in the workflowImage scaling 0.5set up.
01. Leopard print
chinese girl, This is a high-resolution photograph featuring an East Asian woman with long, dark brown hair cascading down her back. She has a slender yet curvy figure, with a moderate bust size. Her skin tone is a smooth, porcelain-like complexion. She is dressed in a form-fitting, long-sleeved onesie with a bold, orange tiger stripe pattern on a black background, accentuating her physique. The onesie clings to her body, highlighting her curves. Her expression is calm and inviting, with a subtle, soft smile and closed eyes, giving an impression of serenity. Her makeup is natural and understated, with a focus on enhancing her features without looking too dramatic. The background features a soft, gradient-like texture of beige and light brown fabrics, which creates a warm, cozy atmosphere. A large, glowing orb, likely a softbox light, is positioned to the side, casting a warm, golden light that complements the colors of the onesie and the background. The overall mood of the image is intimate and serene, with a focus on the subject's calm demeanor and striking appearance. The lighting is soft and even, with a warm color tone that enhances the cozy ambiance. The style of the image is contemporary, with a focus on natural light and subtle, elegant posing. The woman's posture is relaxed, with her hands placed on her thighs, adding to the sense of calmness. The image is likely taken in a studio setting, with careful attention to lighting and composition. The overall aesthetic is sophisticated and visually appealing. The tiger onesie adds a playful, whimsical touch to the otherwise serene atmosphere. The image is a blend of fashion and portraiture, focusing on the subject's beauty and the creative use of lighting. The style is reminiscent of high-fashion photography. The model's hands are placed on her thighs , with her fingers splayed, adding a subtle, playful touch to her otherwise serene pose. The image is a beautiful, captivating blend of fashion and portraiture. The overall mood is intimate and serene, with a foc
Chinese Girl, This is a high-resolution photo of an East Asian woman with long dark brown hair that falls down her back. She has a slim, curvaceous figure with a modest bust. Her complexion is smooth and porcelain. She wears a tight, long-sleeved bodysuit with a bold orange tiger print on a black background that accentuates her figure. The bodysuit fits snugly to her body, accentuating her curves. Her expression is calm and inviting, with a subtle smile and closed eyes, giving her an impression of tranquility. Her makeup is natural and understated, with the focus on highlighting her features without looking too exaggerated. The background has a soft gradient texture of beige and light brown fabrics, creating a warm and cozy atmosphere. A large glowing orb (probably a softbox light) is positioned to the side, casting a warm golden light that complements the colors of the bodysuit and background. The overall mood of this photo is intimate and serene, with the focus on the subject's calm demeanor and striking appearance. The light is soft and even, and the warm tones enhance the cozy atmosphere. The style of this photo is modern, with an emphasis on natural light and subtle and elegant poses. The woman's pose is relaxed, with her hands on her thighs, adding to the sense of calm. This image was likely taken in a studio, with great attention to light and composition. The overall aesthetic is sophisticated and visually appealing. The tiger bodysuit adds a playful, whimsical touch to the otherwise serene atmosphere. This image is a fusion of fashion and portraiture, with a focus on the subject's beauty and the creative use of lighting. The style is reminiscent of high fashion photography. The model's hands are resting on her thighs, with her fingers spread, adding a subtle, playful touch to her otherwise serene pose. This image is a wonderful fusion of fashion and portraiture, beautiful and alluring. The overall atmosphere is intimate and serene, with a focus on the subject's calm demeanor and striking appearance. The lighting is soft and even, with warm tones enhancing the cozy atmosphere. The image is modern in style, with a focus on natural light and a subtle, elegant pose. The woman's pose is relaxed, with her hands on her thighs, adding to the sense of calm. This image is a fusion of fashion and
02. Sea Lion
This is a digital artwork featuring a majestic lion's head emerging from the crest of a massive wave in the ocean. The lion's face is serene and powerful, with a thick, fluffy mane that appears almost ethereal, blending seamlessly into the surrounding water. eyes are a piercing blue, giving a sense of calm and wisdom. The wave beneath the lion's head is a deep, rich blue, with foamy white crests that add texture and dynamism to the scene. The background sky is a soft, gradient blue with a few wispy clouds, suggesting a clear, sunny day. The overall mood of the artwork is tranquil and awe-inspiring, capturing the majesty of the lion and the ocean. The digital art style is highly detailed and realistic, with subtle shading and texture that brings the scene to life. The artist has used a blend of soft and hard brushstrokes to create a sense of movement and energy in the wave, while maintaining the lion's calm demeanor. The image exudes a sense of wonder and connection between the natural world and the majestic creature. The style is reminiscent of high-end digital art, with a focus on realism and emotional depth. The entire scene is set against a clean, minimalist background, emphasizing the lion and the wave. The image is a powerful and evocative representation of nature's beauty. The colors are primarily blues and whites, with subtle hints of gray and beige in the lion's fur. The overall effect is both calming and awe-inspiring. The artwork is likely created using software such as Adobe Photoshop or similar digital art tools. The image's dimensions are standard for a digital artwork, with a wide aspect ratio that allows for an immersive experience. The style is realistic yet fantastical, blending seamlessly into the viewer's imagination. The scene is set in a serene, natural environment, emphasizing the majesty of the lion and the ocean. The entire artwork is a masterpiece of digital art, capturing the essence of nature and the sublime. The artist's use of light and shadow c
In the video, two animated characters are in romantic scenes, transitioning from one scene to another. In the first frame, the male character is wearing a white shirt, dark pants, and sneakers, while the female character is wearing a red top, black skirt, and high heels. They stand together, smiling, as if in an intimate moment.
03. Street Performing Cat
This is a highly detailed, photorealistic digital illustration of a cat playing a guitar on a rainy street. The cat, with orange and white fur, is dressed in a worn, green hoodie and dark blue pants, exuding a casual, street-performing vibe . The cat's large, round eyes are expressive, and its ears are perked up, as if listening to the music. The guitar, an orange-acoustic, is held delicately in the cat's paws, with the strings and fretboard visible.In the foreground , a shallow, metallic bowl filled with coins lies on the wet pavement, glistening with raindrops. The background is blurred, showing a few pedestrians walking by, their faces indistinct due to the rain and distance. The rain is depicted as a gentle, steady drizzle, with droplets visible on the cat's fur and the pavement. The overall mood is one of melancholic, urban charm, with the cat's music providing a poignant contrast to the rainy, gray surroundings. The illustration masterfully captures the textures of the cat's fur, the guitar's wood, and the wet pavement, immersing the viewer in a vivid, atmospheric scene. The colors are muted, with earthy tones and the vibrant orange of the guitar standing out against the drab background. style is reminiscent of photorealistic digital art, with a focus on detailed textures and lighting. The overall effect is both heartwarming and melancholic. | The image is rich in texture and detail, with the rain adding a dynamic, interactive element to the scene. | The style is highly realistic, with a focus on capturing the emotional depth of the scene. | The cat's expression is one of calm, focused creativity, adding to the poignancy of the scene. | The rain adds a sense of movement and energy to the scene, emphasizing the cat's performance. | The background is subtly detailed, with the blurred figures of pedestrians adding depth to the scene. | The mood overall is contemplative and peaceful, with the cat's music serving as a poignant contrast to the rainy surroundings. | The illustration masterfully captures the
This is a detailed, realistic digital illustration of a cat playing guitar on a rainy street. With orange and white fur and dressed in a worn green hoodie and dark blue pants, the cat gives off a casual street performance vibe. The cat's large, round eyes and ears are erected as if listening to music. The orange guitar is carefully held in the cat's paws, with the strings and fretboard clearly visible. In the foreground, a shallow metal bowl filled with coins sits on the wet sidewalk, glistening with raindrops. The background is blurred, showing several pedestrians walking by, their faces obscured by the rain and the distance. The rain is depicted as a gentle, steady drizzle, with water droplets visible on the cat's fur and the sidewalk. The overall vibe is one of melancholy urban charm, with the cat's music contrasting with the rainy, gray surroundings. The illustration skillfully captures the textures of the cat's fur, the guitar's wood, and the wet pavement, immersing the viewer in a vivid, atmospheric scene. The colors are muted, with earthy tones and the bright orange of the guitar standing out against the drab background. The style is reminiscent of photorealistic digital art, with an attention to detail textures and lighting. The overall effect is both warm and melancholic. | The image is rich in texture and detail, with the rain adding a dynamic, interactive element to the scene. | The style is highly photorealistic, with a focus on capturing the emotional depth of the scene. | The cat’s expression is calm, focused, and creative, adding a sense of pathos to the scene. | The rain adds a sense of movement and energy to the scene, highlighting the cat’s performance. | The background details are subtle, with the blurred silhouettes of pedestrians adding depth to the scene. | The overall mood is contemplative and peaceful, with the cat’s music providing a nice contrast to the rainy surroundings. | The illustrations skillfully capture the textures of the cat’s fur, the wood of the guitar, and the wet pavement, immersing the viewer in a vivid, atmospheric scene. | The colors are muted, with earthy tones and the bright orange of the guitar standing out against the drab background. | The style is reminiscent of photorealism
04. Carrying the burden
This is a fantastical, digital artwork depicting a surreal scene. A massive elephant, with its gray skin and wrinkled texture, dominates the foreground, walking across a sun-drenched savannah. The elephant's body is adorned with lush greenery, including a large acacia tree perched on its back, its branches stretching out to the sides. The tree's leaves and branches are intricately detailed, with delicate textures and shades of green.In the background, a majestic, medieval-style castle rises from the elephant's back, its stone walls and towers blending seamlessly into the elephant's hide. The castle's architecture is a mix of Gothic and Romanesque styles, with pointed arches, turrets, and a central keep. The castle's windows and doors are adorned with intricate stone carvings. The sky above is a warm , gradient blue, with soft, fluffy clouds that seem to glow with a golden light, suggesting the late afternoon or early morning sun. The overall mood is one of whimsical wonder, blending fantasy and realism in a dreamlike atmosphere. The image combines detailed textures with a sense of magic and adventure. The elephant's path leads through a landscape of tall grasses and scattered wildflowers, adding to the serene, idyllic atmosphere. The artwork's style is Reminiscent of high-end digital art, with a focus on realism and intricate details.
This is a fantastical digital artwork depicting a surreal scene. A huge elephant with grey skin and wrinkled textures occupies the foreground, walking across a sunlit savannah. The elephant's body is adorned with lush greenery, including a large acacia tree perched on its back, with branches spreading out to either side. The tree's leaves and branches are intricately detailed, finely textured, and feature varying shades of green. In the background, a majestic medieval-style castle rises from the elephant's back, its stone walls and towers blending into the elephant's skin. The castle's architectural style is a blend of Gothic and Romanesque styles, with pointed arches, towers, and a central keep. The castle's windows and doors are adorned with intricate stone carvings. The sky above is a warm gradient blue, with soft, fluffy clouds that seem to radiate a golden glow, reminiscent of afternoon or early morning sunlight. The overall atmosphere is one of whimsical wonder, blending fantasy and realism in a dreamlike atmosphere. The image combines detailed textures with a sense of magic and adventure. The elephants' path weaves through tall grass and scattered wildflowers, adding to the peaceful, idyllic atmosphere. The style of the artwork is reminiscent of high-end digital art, with an attention to realism and intricate detail.
