What are theses white specs on my retainer?

i keep getting these little white specs on my retainer. They are only in the crevices i cant clean. They also have this rancid smell. Whenever i dont rinse my retainer when i take it off it leaves that rancid smell as a taste in my mouth.