I had the same problem at first. I set the custom cut-off at 12.8V. It did just what yours is doing.
When I plugged it back in to the Castle Link, the custom cut-off was some crazy high number. I had to reset it to the correct voltage, and then it worked for me.
Do you have the latest version of the Castle Link software?