Not sure that the base problem (soft shadows) does not come from the fact that the envmap is not a real HDR (with physically correct dynamic range). The sun pixels should be something like 30000 to 100000 times brighter than other pixels. In that case, I see no reason why indigo should not produce crisp shadows.
Here are example images, rendered with envmap as only light source.
Image rendered with a clear sky envmap from evermotion. The shadows are soft despite the bright sunlight in the image.
After opening the .exr in photoshop and measuring the pixel values in the sun disc and in the sky, it appears that the contrast is lower than it should be. So I correct by manually painting a sun disc with a brush.
Now the shadows are OK. Indigo seems to suffer from sampling problems, though.
This shows that soft shadows in envmaps are not intrinsically due to the use of envmaps, but to the fact that camera generated envmaps have a too low dynamic range (sun pixels too low). These envmaps should be manually corrected for proper contrast in photoshop or computer-generated to have correct light power values in the sun disc.
Etienne