Skip to content

Eternity-LLM/Eternity-V1

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Eternity-LLM Organization

Eternity-V1

We're now introducing our first large language model - Eternity-V1, a generative and agentic AI with $x$ parameters in total and $y$ parameters activated for each token. In this work, we introduce a new architecture: StateFormer, a kind of Mamba-Transformer hybrid model.