I highly would recommend staying at Mill Stone B&B. The hosts, Nita and Marc, were very nice and the breakfast Nita cooked was lovely. I had some special requests on account of allergies and everything I asked for was provided.
The house is a well kept historic structure with some additions. My fiance and I had plenty of space (we were the only guests that night). Even if the other rooms were full it seems like it would still be a comfortable place. If traveling as a family or group of friend and you need 3 rooms this would be a pretty ideal setting.
There were a number of bonuses we weren't necessarily expecting: a small box of chocolates in our room, a variety of snacks available in the kitchen, a coffee machine, locally made toiletries, free wifi, TV with Netflix, and a stack of board games.
If the weather were nicer I think we would have enjoyed a walk outside. Oley is very rural but not too far from Kutztown and some other small towns in the area. If you don't mind driving a bit this place could be a fine alternative to staying in Kutztown, Reading or Hamburg (Cabela's).