Article
ArticleNewsWebsite navigation

Luna AI: A fully automatic AI live broadcast system, a real open source project

Luna AIIs an advanced fully automaticAI Live Broadcast System, combines multiple AI technologies such as ChatterBot, GPT, Claude, etc., and supports local and cloud operation. Using Live2D and UE5 technology, it can be used asVirtual AnchorLive interactive broadcasts on platforms such as Bilibili and Douyin, or chat with users locally. The system integrates natural language processing and text-to-speech technologies such as Edge-TTS and VITS-Fast to provide a rich interactive experience. In addition, Luna AI also supports Stable Diffusion drawing functions to add interactive fun to live broadcasts. The project has a clear structure, including configuration files, GUI main programs, and multiple functional folders, and is suitable for multiple operating systems.

Virtual anchors and real-time interaction
Using Live2D, Vtube Studio, UE5 and Audio2Face technology, Luna AI can appear as a virtual anchor on live broadcast platforms such as Bilibili, Douyin, Kuaishou, and Douyu. These technologies give the virtual anchor a realistic appearance and expressions, which can attract viewers and provide an immersive viewing experience.
Natural Language Processing and Text-to-Speech
The project uses a variety of natural language processing and text-to-speech technologies, such as Edge-TTS, VITS-Fast, elevenlabs, bark-gui, and VALL-EX, to generate responses to audience questions. These technologies allow Luna AI to interact with the audience in a natural and fluent way. At the same time, so-vits-svc and DDSP-SVC provide voice-changing functions, which increase the diversity and fun of live broadcasts.
Drawing function
Through specific instructions, Luna AI can collaborate with Stable Diffusion to display paintings. This function not only increases the interactivity of the live broadcast, but also provides visual enjoyment for the audience.
Technology and framework integration
Luna AI integrates many AI technologies and frameworks, including but not limited to ChatterBot (a library for building chatbots), GPT (a powerful text generation model), Claude (a versatile AI language model), langchain (for building and running language chains), chatglm (a chat model based on GPT), text-generation-webui (a front-end interface for text generation), iFlytek Spark (providing speech recognition and synthesis services), and Zhipu AI (providing AI-related services and technologies). The combination of these technologies makes Luna AI extremely powerful in language processing and response.
Luna AI: A fully automatic AI live broadcast system, a real open source project
Project Structure
The project contains several important folders and files:
·config.json: Configuration file that stores all settings and options.
·main.py: GUI main program, which calls each platform program according to the configuration.
·utils folder: contains the encapsulation implementation of chat, audio, and general class related functions.
·data folder: stores data files, banned words, text, etc.
·log folder: stores operation logs, subtitle logs, etc.
·out folder: stores audio files output by TTS and SVC, and audio files output by text.
·Live2D folder: stores Live2D source code and models.
·song folder: stores songs in song request mode.
·docs folder: stores project related documents.
·tests folder: stores test programs for single functional points.
·Cookie folder: stores cookie data required for some functions.
Environmental requirements and installation
Luna AI supports Windows 7 and above, MacOS, and Linux operating systems. The project uses Python 3.10.11, and all dependent libraries are listed in requirements.txt. When installing, be careful to avoid using Chinese paths, spaces, and special characters to avoid causing program operation abnormalities.
Configuration and Customization
The project provides a GUI interface for configuring and customizing various functions. You will see the specific configuration content in the configuration file config.json.
Project Link
https://github.com/0x648/luna-ai

Related content:

  1. How to install and use ChatGPT on Android and iOS?
  2. ChatGPT can now help you with photo editing and AI painting, just say a few words
  3. How to solve the problem that Discord cannot invite Midjourney bots
  4. AI video editing tool spikes.studio functions and usage tutorials, long video to short video conversion, automatic editing and many other innovative functions
statement:The content is collected from various media platforms such as public websites. If the included content infringes on your rights, please contact us by email and we will deal with it as soon as possible.
AI Live Broadcast SystemLuna AIVirtual Anchor
TutorialEncyclopedia

How to write keywords in Ai painting? Remember this universal formula!

2024-1-29 9:46:55

TutorialEncyclopedia

Incredible Midjourney v6: 7 tips to make text and images perfectly combined!

2024-1-30 10:15:44

You may also like
❯
Search

  • Scan to open current page

Top