If you want to know more about capacitors, I gathered some links for another thread, starting here:
Those are mostly about bypass capacitors for more complex ICs. You should always read the datasheet of your component and follow it, but they don’t always tell you the basics.
You probably shouldn’t use electrolytic cap for smaller values. They are good only as “bulk” capacitors.