Not recommended — #27 of 31 Cashmere ranks #27 of 31 fabrics for quick drying. It is a poor fabric for this. Ranked on low moisture regain, low weight, and packability — the inverse of absorbency. The top pick is Polypropylene.
Cashmere measures 50/100 for breathability, 15% moisture regain, 90/100 warmth, at 200 gsm. Fast drying favours low moisture regain: at 15% Cashmere holds water and dries slowly, and 200 gsm keeps it light.