Hi rbeale98
to the Surface Engineering Forum.
Sorry, as yet I've not come across anything specifically relating to effect of embedded grit blast particles on component fatigue life.
In the case where grit blasting is used for substrate preparation for coatings, grit retention/contamination can be an issue, but mainly with that of coating adhesion rather than effect on fatigue strength.
In your specific case, where grit is trap between bore and bushing and particularly where any movement produces scoring marks, I think effect on fatigue could be far more significant.