I see in your title you put with adapter. What adapter are you using?
Did you check to make sure nothing is in the Audio jack hole? Might get a can of compressed air and blow it out. This is the only reason I can think of as to why the reader will not go in all the way. That or the reader jack is bent.
