2sheds,
I'm not very familiar with the area either so I was a little uneasy at first, not wanting to trespass on anyone's land. From 44, I took T south through Newburg, east on Hickory Point Rd (there's a small sign indicating Milldam at this point), and then traveled south on forest road 1735. The first access point is where I ran into the group of strangers, but then I continued on the forest road to the next access point with a loop at the end of the road. I want to say both of these areas are considered "Milldam Hollow," but I can't say that's for certain.
Regardless, it was a good day on the water and I recommend the trip. Olive wooly bugger was the weapon of choice. Cheers.