What time of year are the the dreaded [midge](http://en.wikipedia.org/wiki/Highland_midge)'s in Scotland at their worst?

I've only really been into the Higlands in Winter and I would prefer to avoid the worst time for these if possible.