No!
Theoretically, if the pack is very rich in low cards (particularly 2s, 3s, and Aces), you will sometimes hit against 2-6 and 8. SW�s Prof BJ gives some indices for this, and they are in the ballpark of -15.
Soft Hands come up very infrequently. Counts of -15 are very infrequent.
I don�t think Hi Lo is very efficient for making this play (because it treats the Ace as a high card). In short, the total gain from this play will be negligible.
Don�t worry about it.