Pinned Loading

1. i3-papers i3-papers Public

   Official repo for the papers of i3

   2

2. open-i3 open-i3 Public

   A novel hybrid language model combining RWKV time-mixing and standard Multi-Head Attention for efficient training on consumer hardware.

   Python 4

3. Low-Rank-Pretraining Low-Rank-Pretraining Public

   LoRPt (Low-Rank Pretraining) is a novel technique that applies LoRA-style low-rank matrix factorization directly to model pretraining, enabling dramatically reduced memory consumption and faster tr…

   Python

4. netgoat-xyz/koda netgoat-xyz/koda Public

   Netgoat's Open Source threat detection model

   Python 3 1