Add Experts4bit for 4-bit quantization of fused MoE experts - #1965

Add Experts4bit for 4-bit quantization of fused MoE experts#1965

pjordanandrsn wants to merge 9 commits into

bitsandbytes-foundation:mainbitsandbytes-foundation/bitsandbytes:mainfrom

pjordanandrsn:feature/experts-4bitpjordanandrsn/bitsandbytes:feature/experts-4bitCopy head branch name to clipboard