Yes. In San José and most areas in Costa Rica, tap water is safe to drink. Some beaches might have harder water or well water that may not be appropriate for drinking. So whenever you arrive to a place, simply ask and the guide or your receptionist will tell you. Bring along your reusable water bottle to refill in safe sources.