I honestly feel that your frustrations are born in your own mind. A woman will probably not think anything of it beyond here is a nice guy who is attracted to me. I think you should go for it and lay aside your fear. The fear is only in your own mind. Just don't convey that her hair is the ONLY reason you are interested in expanding on the relationship.

JR