JCETest is a project mainly written in Java, it's free.
A small example for getting started with Java Cryptography.
Updated after finishing the initial set of tests. Things that could be done: