I could just about face Bailey as a mn and then only for sound family reasons. In which case, it could be male or female.
Word names in general are not to my taste, and colour names are particularly silly. Clover could get in sideways as a flower name ... but I don't like them much either, except Daisy and Iris and some of the Rose names, though not Rose itself.
What makes Brecken seem rough-sounding to you? To me, it's just Bracken with a dialectal pronunciation. And Kenny is rather less rough than Ken, surely. I'm baffled!