Subscribe
Topic

Reasoning

How reasoning models think and how to build them. Posts compare open reasoning models like DeepSeek-R1 distillations and QwQ-32B, explain test-time compute, process reward models and STaR, and cover IBM's Granite 4.2 reasoning release.

Articles

1-18
  1. Self-Taught Reasoner (STaR) and Quiet-STaR: Mathematical Foundations, Rationalization Dynamics, and Bootstrapped Reasoning in Large Language Models

    Self-Taught Reasoner (STaR) and Quiet-STaR: Mathematical Foundations, Rationalization Dynamics, and Bootstrapped Reasoning in Large Language Models Chain-of-thought prompting enables autoregressive transformers to solve multi-step arithmetic, symbolic logic, and commonsense reasoning tasks by emitting intermediate tokens before generating a final answer. However, scaling chain-of-thought capabilities faces a fundamental data bottleneck: supervised datasets of high-quality, human-annotated reaso

    AI
    9 min read
  2. Open-Source Reasoning Models in Production: Comparing DeepSeek-R1 Distillations, QwQ-32B, Sky-T1, and Marco-o1

    Open-Source Reasoning Models in Production: Comparing DeepSeek-R1 Distillations, QwQ-32B, Sky-T1, and Marco-o1 The release of frontier reasoning models demonstrated that allocating test-time compute to explicit chain-of-thought generation significantly elevates problem-solving accuracy in mathematics, software engineering, and scientific reasoning. While proprietary systems conceal their training pipelines and reasoning traces, the open-source ecosystem has produced diverse approaches to replic

    Reasoning
    7 min read
  3. Test-Time Compute and Inference Search in Production: Comparing Best-of-N, Monte Carlo Tree Search, PRM-Guided Beam Search, and Dynamic Budget Allocation Architecture, Token Economics, and Serving Latency

    In standard production Large Language Model (LLM) deployments, generation compute is fixed: a prompt is processed during prefill, and the model generates an answer via greedy autoregressive decoding or low-temperature sampling. Under this paradigm, accuracy on complex reasoning, mathematical derivation, theorem proving, and code synthesis is bounded by the model parameter count and training data distributions. Recent empirical work demonstrates that scaling inference-time compute can achieve pe

    AI
    11 min read
  4. Process Reward Models (PRMs): Mathematical Foundations, Step-Level Credit Assignment, and Inference-Time Search in Large Language Models

    In complex multi-step reasoning tasks such as mathematics, formal logic, and software verification, standard autoregressive language models frequently exhibit compounding logical drift. While a model may produce fluent chain-of-thought derivations, an error introduced early in the chain typically invalidates all downstream deductions. Evaluating these reasoning trajectories has traditionally relied on Outcome-Supervised Reward Models (ORMs), which assign a scalar reward solely based on the final

    AI
    8 min read
  5. IBM Releases Granite 4.2 Open-Weight Reasoning Models with Multi-Stage Agentic RL

    IBM has released Granite 4.2, a new family of dense, decoder-only reasoning language models distributed under an Apache 2.0 open-source license. Available in three parameter sizes (3B, 8B, and 30B), the series introduces native chain-of-thought deliberation, multi-tier reasoning controls, and sandboxed agentic reinforcement learning for open-weight deployments. The release marks a architectural shift from IBM's earlier instruction-following Granite checkpoints toward explicit reasoning and auto

    Open Weights
    3 min read
  6. Latent Reasoning in Large Language Models: How Continuous Thoughts and Recurrent Hidden States Bypass Discrete Tokenization

    Standard autoregressive language models solve multi-step reasoning tasks by generating explicit verbal scratchpads. Under the Chain-of-Thought (CoT) paradigm formalized by Wei et al. (2022), a Transformer expands its effective computational depth by emitting intermediate natural language tokens into the prompt context. Each emitted token provides an additional forward pass through the network's layers, transforming reasoning into a sequence of left-to-right text predictions. While language-base

    AI
    8 min read
  7. Reasoning Model Distillation in Production: Trajectory Curation, Thinking-Token Formatting, Over-Thinking Mitigation, and Student RL Alignment

    Reasoning Model Distillation in Production: Trajectory Curation, Thinking-Token Formatting, Over-Thinking Mitigation, and Student RL Alignment Distilling frontier reasoning models into compact language models has emerged as one of the most effective strategies for deploying low-latency, cost-efficient inference pipelines. Rather than training small models purely on input-output answer pairs, reasoning distillation transfers the intermediate exploration, backtracking, and verification trajectori

    LLM
    5 min read
  8. The Self-Taught Reasoner (STaR): How Iterative Rationale Bootstrapping and Rationalization Scale LLM Problem Solving

    Autoregressive language models often fail when forced to predict answers to multi-step reasoning problems in a single forward pass. Intermediate chain-of-thought generation allows models to allocate additional compute to difficult reasoning steps before emitting a final prediction. However, obtaining high-quality intermediate reasoning traces has traditionally presented a difficult trade-off: either rely on small prompt-based few-shot demonstrations that underperform fine-tuned models, or constr

    AI
    4 min read
  9. Monte Carlo Tree Search in Large Language Models: How Selection, Expansion, Simulation, and Backpropagation Guide Deliberate Reasoning

    Standard autoregressive language models generate text token by token via left-to-right greedy decoding or stochastic sampling. While this System 1 approach suffices for fluency and single-turn synthesis, it struggles with complex mathematical reasoning, multi-step logical deduction, and long-horizon planning. Because autoregressive decoders lack native backtracking mechanisms, an error introduced at step t persists and compounds across all subsequent steps t+1 through T. To overcome this struct

    AI
    7 min read
  10. Tree of Thoughts in Large Language Models: How Search Trees, State Evaluation, and Backtracking Expand Deliberate Reasoning

    Standard autoregressive large language models generate text sequentially from left to right. At each step $t$, the network samples the next token according to a conditional probability distribution over the vocabulary: P(w_t | w_1, w_2, ..., w_{t-1}) While Chain-of-Thought (CoT) prompting (Wei et al., 2022) encourages models to output intermediate reasoning steps, the underlying computational process remains a linear path through token space. If the model makes an early logical error or choose

    AI
    6 min read
  11. ReAct in Large Language Models: How Interleaving Reasoning and Action Traces Built the Foundation of AI Agents

    ReAct in Large Language Models: How Interleaving Reasoning and Action Traces Built the Foundation of AI Agents Before autonomous agents could interact reliably with APIs, search engines, and bash environments, large language models (LLMs) operated in one of two disconnected paradigms: internal reasoning without external interaction, or external action generation without internal deliberation. In pure reasoning paradigms such as Chain-of-Thought (CoT) prompting, models generate intermediate natu

    AI
    10 min read
  12. Self-Consistency Decoding: How Sampling Diverse Reasoning Paths Eliminates Single-Trajectory Fragility in LLMs

    Self-Consistency Decoding: How Sampling Diverse Reasoning Paths Eliminates Single-Trajectory Fragility in LLMs Standard inference pipelines in large language models rely on greedy decoding or low-temperature sampling to generate answers. For tasks requiring direct factual recall or basic classification, greedy token selection generates fluent and accurate outputs. However, when large models are tasked with complex multi-step reasoning, greedy generation exhibits severe structural fragility. In

    AI
    6 min read
  13. Reinforcement Learning with Verifiable Rewards: How Programmatic Oracles Eliminate Reward Hacking in LLM Reasoning

    Post-training paradigms for large language models have undergone a fundamental architectural shift. While the initial wave of alignment relied on Reinforcement Learning from Human Feedback (RLHF) and direct preference optimization (DPO), frontier reasoning systems increasingly depend on Reinforcement Learning with Verifiable Rewards (RLVR). Traditional RLHF relies on neural reward models trained on human pairwise comparisons. These neural proxies suffer from reward overoptimization, vulnerabili

    AI
    6 min read
  14. GLM-5.3 Scores 60 on Artificial Analysis Intelligence Index, Matching Kimi K3

    Independent AI evaluation platform Artificial Analysis has published its benchmark results for Z.ai's GLM-5.3, awarding the reasoning model a score of 60 on its Intelligence Index v4.1.1. The result places GLM-5.3 level with Moonshot AI's Kimi K3 and three points behind frontier leader Claude Opus 5 (63). The evaluation tested GLM-5.3 at its maximum reasoning effort configuration across a nine-part battery that measures agentic tool execution, terminal coding, graduate-level scientific problem-

    AI
    2 min read
  15. Process Reward Models: How Step-by-Step Supervision and Search Drive LLM Reasoning

    When large language models tackle complex multi-step reasoning (such as formal mathematics, algorithm synthesis, or multi-hop logic), evaluating only the final answer creates a severe credit assignment bottleneck. An outcome-based verifier can confirm whether a final numerical result is correct, but it cannot determine whether the underlying derivation was logically sound or reached the right answer through compounding hallucinations and lucky cancellations. Process Reward Models (PRMs) resolve

    AI
    7 min read
  16. Study finds RL for reasoning changes only a few tokens, and you can copy the effect

    A new analysis of reinforcement learning for LLM reasoning suggests the field's biggest gains come from a surprisingly small change. RL is not rewriting how models think. It is nudging a tiny slice of the output. What the researchers measured Across several model families and common methods like GRPO and PPO, reinforcement learning reranks only 1.0 to 4.1 percent of tokens. The token it promotes is almost always already one of the base model's top five choices. Training, in other words, pushe

    AI
    1 min read