Of the ones I have found and tested, I would have to mention the Nong Khai resort pool, it is fairly big and deep enough for small dives.
It's also clean and well maintained, and has a kids pool also adjoining the main one.
The price is 60 baht for adults and 30 baht for children.
There is a restaurant and bar on the premises if you need a drink or a snack, both are pretty well priced.
I have attached a couple of photos.
It is located near to Nong Khai train station, Map ref: E6


There is also a good pool at the T19 resort, a few km's from Nong Song Hong on the main road to Udon, they also have a bar and restaurant:
