It's been 35 or so years ago since I've fished in Vermont, but I used to fish the White river and it's tribs. The lower reaches have smallies, you get up around Royalton and you get a mix of rainbows, browns, and smallies.
There used to be a good population of wild browns in what are called the 1st and 2nd branches of the White. You had to cross farm fields or pastures to access the branches, back then the farmers didn't care, but they may have changed since then. But generally if you have to hike a ways back in, the fishing is better.
The main White is a pretty good sized river, but it is wadeable up around Royalton.
I'm sure things have changed since I was last there, but at the time it had pretty good fishing. Real pretty country too.
Get some real maple syrup while you are there, it is good stuff.