Answer
The downwind side can contain eddies, rotors, and rapidly changing flow. Move to a location with cleaner airflow or increase separation from the obstacle.
Explanation
A solid obstacle disrupts the wind instead of simply stopping it. The lee side can be much less predictable than the upwind side.