It's your poem Monty. If it sounds better to you leave it. Content and sound come first. It is your poem.
I was just being the poetry form police and pointing out that to comply with the form elements the rhyme should be in the 2nd and 4th lines of each stanza. Does it matter? Not really.