I don't really like it on either gender, because... it just sounds like a last name, not a first name.
I think people will assume it's a girl because it's more popular for girls. Like earlier this school year, in my lunch, someone mentioned a
Taylor and it was assumed they were female. Turned out they were talking about a boy. The guy they were talking to said "Why'd they give him a girl's name?"
If I had a son named
Madison though, I'd call him
Mads.