"It's reinforcement learning on the results of generated chains of thoughts."

No, that's not how LLMs work.

That is how reasoning models work: https://www.interconnects.ai/p/deepseek-r1-recipe-for-o1

Base models are trained using autoregressive learning. "Reasoning models" are base models (maybe with some modifications) that were additionally trained using reinforcement learning.