Records are nowhere near the best.
In most cases, CDs are good enough,
because few people can hear the difference
between them and higher-resolution formats.
I would stick with CDs for the simple reason that players are Everywhere and affordable.
If you want to try something that is Supposedly better,
there are several from which to choose:
SACD
DVD-A (finding discs and players might be difficult, though)
Pono
various "high res" downloadable formats
Don't expect to hear a difference at all,
and particularly not if you don't have a Very high performance audio system,
by which I mean upwards of $9,000.
The speakers should be about a third of the cost,
so you're looking at about $3,000 or more for
a pair.
You wouldn't have a receiver at the center of this system;
rather, you would have a preamp along with a stereo power amplifier,
or two "monoblock" power amps.
The disc player would represent at least 25% of the cost of the system,
and the preamp and power amp(s) would represent the remainder.
If you wanted a tuner, it would be extra
and should cost about the same as the disc player.
If you are not prepared to spend at least $10,000 for the whole system
including cables and other small bits,
there really is no reason to pursue anything beyond CDs anyway.