We’re sharing Genomic Jamba, a small research project combining Mamba2 and FlashAttention2 for DNA sequence modeling. It uses a 75:25 mix of Mamba and attention blocks to balance efficiency and expressiveness.
The model is pretrained on a plant genomics corpus and available on Hugging Face. We’d be grateful for any feedback or suggestions.
GitHub: https://github.com/suzuki-2001/genomic-jamba Model: https://huggingface.co/suzuki-2001/plant-genomic-jamba
Thank you!