In my experience, there is always a bit of play, but yours looks a bit unusual.
However, I think it does not matter - and I would NOT hammer any further (there is no room to drive it further in.
Also, I think this play will be reduced once you have installed the axle and secured that with the...