Answer
The pilot must stay within the more restrictive limit that applies to the operation, including the authorization, geographical zone, local notice, or category condition.
Explanation
General rules are only a starting point. A specific authorization or local zone can impose a lower limit for a place and time.