Llama-3 META!!!

About Llama

Llama is an open-source project released by Meta (FaceBook) AI, which allows for commercial use and has a huge impact. The previously released Llama 2 supports 4096 context, has excellent performance, and is considered one of the biggest competitors of the GPT series.

Llama-3

Meta has released the Meta Llama 3 series of language models (LLM), including an 8B model and a 70B model. In testing benchmarks, the performance of the Llama 3 model is quite outstanding, and in practicality and security evaluations, it is comparable to popular closed-source models on the market.

Part 1

Just released Llama-3

At 0:00 on April 19, 2024 China time, Meta Llama 3 was released. The model is available in open source form, including two parameter scales of 8B and 70B, covering variants of pre-training and instruction tuning. Llama 3 supports multiple commercial and research uses and has demonstrated its excellent performance in multiple industry standard tests.

Technical information

Transformer architecture

Meta Llama 3 adopts an optimized autoregressive Transformer architecture, which is designed specifically for handling complex text generation tasks and can effectively improve the coherence and relevance of generated text.

Hybrid tuning