Just to add... I did a set-up last weekend... Popped the blind up in the late afternoon, had a decent buck step out 15 minutes before last light. He looked at the blind a few times, but it really didn't faze him.
So I wouldn't worry about spooking them with your hay field set-up...