Add Mamba2 model support #3257
Description
Candle has Mamba1 but not Mamba2 from "Transformers are SSMs". Mamba2 is 2-8x faster via structured state space duality.
{{ message }}
Candle has Mamba1 but not Mamba2 from "Transformers are SSMs". Mamba2 is 2-8x faster via structured state space duality.