microsoft/bitnet-b1.58-2B-4T-bf16 -> pre-trained before fine tuning?

[dcgrigsby]

I'm wondering if the microsoft/bitnet-b1.58-2B-4T-bf16 variant is the weights before SFT and DPO.

[xennon-sudo]

It's discontinued 😭