🚀 Chainbase Releases Theia-Llama-3.1-8B Model On HuggingFace
#Chainbase #TheiaLlama #HuggingFace #cryptocurrency #Web3 #LoRA #DeepSpeed #AI #machinelearning #data #CoinMarketCap #TheiaChat
According to PANews, Chainbase, a comprehensive data network, has recently announced the open-source release of its large language model, Theia-Llama-3.1-8B, on HuggingFace. This model, specifically designed for the cryptocurrency sector, surpasses mainstream models in both perplexity and BERT scores, demonstrating a superior understanding of the crypto world compared to most open-source models available in the market.
The Chainbase team has innovatively developed the first professional Web3 dataset, which includes various data from the top 2000 projects listed on CoinMarketCap. This dataset has been meticulously filtered through both manual and algorithmic processes to ensure the accuracy, diversity, and professionalism of the training data. Utilizing this dataset, the team efficiently fine-tuned the model using LoRA technology and accelerated the training process with tools like DeepSpeed. Additionally, the model has been quantized into the Q8 GGUF format, significantly reducing memory usage and enhancing inference speed.
Theia-Llama-3.1-8B represents Chainbase's initial foray into large models within the crypto domain and has already been successfully integrated into Chainbase's interactive application, TheiaChat. This application currently boasts over 300,000 daily active users.#Chainbase #TheiaLlama #HuggingFace #cryptocurrency #Web3 #LoRA #DeepSpeed #AI #machinelearning #data #CoinMarketCap #TheiaChat