To Load a PKCS12 Keystore a explicit providers has to be used

In Caravan Configuration you can explicit define a keystore to load, if you choose the keyStoreType PKCS12 the instance has to be created with a explicit provider named "SunJSSE"

So a change in io.wcm.caravan.commons.httpclient.impl.helpers.CertificateLoader#getKeyManagerFactory is needed (Line 142) From

to (e.g.)

Or if other Providers are needed it should be a storeProperty.