In most cases, yes, particularly for structural walls, retaining walls, and many types of fences.
Permit requirements depend on the municipality, fence or wall height, location, materials, and type of construction.
Some jurisdictions allow certain small or nonstructural fences without a building permit, but zoning restrictions, property setbacks, visibility requirements, and HOA regulations may still apply.
Always verify the local requirements before installation.