Bilibili Releases Open-Source Lightweight Index-1.9B Series Models: Base, Control, Dialogue, and Role-Playing Versions Available

Home AI News Bilibili Releases Open-Source Lightweight Index-1.9B Series Models: Base, Control, Dialogue, and Role-Playing Versions Available

Updated on November 14 2024

On June 20, Bilibili announced the open-sourcing of its lightweight Index-1.9B model series, which includes several versions: base model, control group, chat model, and character-role model.

Official Overview:

- Index-1.9B Base: This foundational model features 1.9 billion non-word embedding parameters, pre-trained on a diverse corpus of 2.8 terabytes of Chinese and English data. It consistently outperforms competing models across multiple evaluation benchmarks.

- Index-1.9B Pure: This control model mirrors the base version in parameters and training strategy but excludes all instruction-related data to evaluate the impact of instructions on performance metrics.

- Index-1.9B Chat: Built on the Index-1.9B base, this chat model is refined through Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO). Its training included extensive internet community data, resulting in a more engaging chat experience.

- Index-1.9B Character: This model further enhances SFT and DPO by incorporating Retrieval-Augmented Generation (RAG) for customizable few-shot role-playing. Utilizing the same 2.8TB dataset with a 4:5 language distribution of Chinese to English and 6% code representation, it features a built-in character named "San San," while users can create their own characters.

This new model series strengthens Bilibili's AI capabilities, enhancing user interaction and engagement with its advanced customizable features.

Shanghai AI Lab Releases First Results of AI Gaokao Exams: Total Score of 303 with All Math Questions Failed

China's Meteorological Administration Unveils Three Advanced AI Weather Modeling Systems

Most people like

Sku Fetch

13.3K

Introducing a streamlined service designed to gather, organize, and edit product information from suppliers, then seamlessly distribute it to various listing platforms. This solution simplifies your workflow, ensuring your product data is accurate and ready to engage customers effectively.

product fetching AI Product Description Generator

Notebook.ai

272.8K

Introducing a cutting-edge smart notebook specifically crafted for worldbuilders and writers, designed to help you create and develop vibrant universes.

worldbuilding AI Book Writing

Public Prompts

18.2K

Explore our website, your ultimate resource for public prompts, innovative models, and essential tools designed for creative endeavors. Discover endless inspiration and practical solutions to unleash your creativity today!

AI AI Art Generator

Browse AI

304.5K

Browse AI is an intuitive web automation platform designed for seamless data scraping and real-time monitoring. Whether you need to collect data from websites or track changes, Browse AI simplifies the process, making it accessible for everyone.

data extraction Web Scraping

Find AI tools in YBX