Open Finder > Preferences and select Sidebar, then use the check boxes to add or remove respective items from the sidebar. Bonus: The toolbar at the top of Finder windows is even cooler and more customizable; select View > Customize Toolbar and drag what you want into the toolbar area. Note that you can drag in anything from the Desktop: files, folders, applications, whatever.