The metronome is a good thing but there are pitfalls that can affect your phrasing. Have you tried setting the metronome on half speed an think "two and four" instead of all four beats? This is a popular practice technique that does not hamper your swing feel (as much).
I think that playing exercises has it limitations. You should also play tunes, impovise a bit and record them without any backtrack to see how the groove and pulse sounds. It is very revealing. Tap your foot to the recording and you will see what I mean.
Allot of good and great players don't advocate metronomes. They say, just tap your foot and be very critical of yourself. Humans aren't machines and some modulation of beats is desirable for a natural sound, but you should definitely be able to target the "one" at any time in the tune.
Some things to try. I'm sure there will be other opinions.
