Subscribe
Category / page 17

Models & Assistants

1121 articles

Articles, page 17

321-340 of 1121

  1. LLM Fine-Tuning and Post-Training Frameworks in Production: Comparing Unsloth, Axolotl, Torchtune, and LLaMA-Factory

    Post-training has transitioned from a specialized research task into a standard production engineering discipline. As open-weight base models such as Llama 3.1, Qwen 2.5, and DeepSeek-V3 establish competitive baselines, the primary engineering challenge has shifted toward domain adaptation, instruction alignment, and reasoning distillation. However, selecting a post-training framework requires balancing competing architectural trade-offs: low-level kernel fusion, distributed multi-node scaling,

    AI
    6 min read

  2. Hugging Face Unveils Microduck, a 99 Open-Source Bipedal Robot for Embodied AI

    Hugging Face has introduced Microduck, a 10-inch-tall, 1.7-pound bipedal open-source robot priced at $399. Developed in partnership with Pollen Robotics and manufactured by Shenzhen-based hardware specialist Seeed Studio, the device is designed as an accessible hardware platform for embodied AI research and reinforcement learning experimentation. The compact biped features integrated visual sensors, microphone arrays, audio output, and wireless connectivity over Wi-Fi and Bluetooth. Commercial

    AI
    1 min read

  3. OpenAI Introduces Advertising to ChatGPT Free and Go Tiers in India

    OpenAI has begun displaying commercial advertisements to users on its Free and Go subscription tiers in India. The initiative marks the latest expansion of OpenAI's advertising monetization framework, following initial rollouts across the United States and selected European and Asia-Pacific markets earlier this year. India represents one of OpenAI's largest consumer bases globally, with over 100 million weekly active users recorded in early 2026. A substantial majority of this user volume acces

    AI
    1 min read

  4. State Space Models (SSMs) and Mamba: Mathematical Foundations of Continuous-Time Discretization, Selective Scan Mechanics, and Structured State Space Duality

    Autoregressive Large Language Models (LLMs) built on the standard Transformer architecture rely on softmax self-attention. While self-attention provides expressive in-context learning and dense token-to-token associative recall, it exhibits fundamental algorithmic scaling limits: prefill compute scales quadratically with sequence length ($O(L^2 d)$), and autoregressive token generation requires maintaining a Key-Value (KV) cache that grows linearly with sequence length ($O(L d)$). At context win

    AI
    12 min read

  5. Embedding Models and Rerankers in Production: Comparing Dense Bi-Encoders, ColBERT Late Interaction, Cross-Encoders, and Serving Architectures

    Production retrieval-augmented generation systems depend heavily on the retrieval pipeline that precedes generation. While frontier language models receive the bulk of engineering attention, the accuracy, latency, and operational cost of a RAG application are often determined by the interplay between embedding models and rerankers. Deploying search infrastructure requires navigating three distinct architectural paradigms: dense bi-encoders, multi-vector late interaction engines, and cross-encod

    AI
    6 min read

  6. Anthropic Opens 250,000 Claude Conversations to External Researchers Across Stanford, Oxford, and METR

    Anthropic's Societal Impacts team has released initial results from a research pilot that opened aggregate, real-world Claude conversation data to outside academic teams. The initiative partnered with researchers from Stanford University's Social and Language Technologies (SALT) Lab, the University of Oxford's Human Information Processing Lab, and the model evaluation non-profit METR. Each group conducted independent studies across a sample of approximately 250,000 conversations recorded on Clau

    AI
    2 min read

  7. OpenAI Details Custom Inference Chip 'Jalapeño' at Hot Chips, Targeting 700W Efficiency Against Nvidia Blackwell

    OpenAI has revealed architectural specifications and benchmark data for its first in-house artificial intelligence accelerator, code-named Jalapeño. Presented by hardware lead Richard Ho at the Hot Chips conference at Stanford University, the application-specific integrated circuit (ASIC) is engineered specifically for large language model inference rather than model training. Developed over an 18-month partnership with Broadcom and manufactured by TSMC, the chip targets large-scale token gener

    AI
    2 min read

  8. Low-Rank Adaptation (LoRA) and QLoRA: Mathematical Foundations, Intrinsic Rank Parameterization, NF4 Quantization, and Double Quantization Mechanics

    Low-Rank Adaptation (LoRA) and QLoRA: Mathematical Foundations, Intrinsic Rank Parameterization, NF4 Quantization, and Double Quantization Mechanics Parameter-efficient fine-tuning (PEFT) has become the standard operational methodology for adapting large language models to domain-specific tasks, downstream instruction following, and structured tool use. Full-parameter fine-tuning of frontier architectures requires updating and tracking optimizer states for tens or hundreds of billions of parame

    AI
    11 min read

  9. StreamingLLM and Attention Sinks: Mathematical Foundations of Softmax Normalization Artifacts, Initial Token Anchoring, and Infinite-Context Rolling KV-Cache Mechanics

    StreamingLLM and Attention Sinks: Mathematical Foundations of Softmax Normalization Artifacts, Initial Token Anchoring, and Infinite-Context Rolling KV-Cache Mechanics In autoregressive Large Language Models (LLMs), long-context deployment is constrained by the quadratic compute complexity of attention and the linear memory growth of the Key-Value (KV) cache. For an LLM processing a sequence of length $L$ with batch size $b$, hidden dimension $d$, and $n_{kv}$ key-value heads across $N_L$ trans

    AI
    11 min read

  10. Multi-Head Latent Attention (MLA): Mathematical Foundations, Low-Rank KV Compression, Decoupled RoPE Mechanics, and Matrix Absorption

    Multi-Head Latent Attention (MLA): Mathematical Foundations, Low-Rank KV Compression, Decoupled RoPE Mechanics, and Matrix Absorption Autoregressive inference in large language models is fundamentally constrained by memory bandwidth rather than floating-point computation throughput. During the generation phase, the transformer must load the Key-Value (KV) cache of all prior tokens from high-bandwidth memory (HBM) to on-chip SRAM for every newly generated token. As context lengths scale to hundr

    AI
    12 min read

  11. SoftBank in Talks to Acquire Majority Stake in Humanoid Robotics Maker 1X at $6 Billion Valuation

    SoftBank Group is in advanced discussions to acquire a controlling majority stake in humanoid robotics manufacturer 1X Technologies in a deal valuing the startup at approximately $6 billion, according to reporting by The Information and Reuters. 1X Technologies, founded by Bernt Øivind Børnich and backed by the OpenAI Startup Fund, designs autonomous bipedal and wheeled robots for industrial logistics and home assistance. Deal Structure and Strategic Context The negotiations mark a valuation

    AI
    2 min read

  12. DeepSeek Prepares $7.4B Funding Round at $74B Valuation to Build Custom Silicon and Compute Infrastructure

    Chinese frontier artificial intelligence laboratory DeepSeek is preparing to secure approximately $7.4 billion (50 billion yuan) in fresh funding at a $74 billion (500 billion yuan) pre-money valuation, according to reporting by The Wall Street Journal and Reuters. The funding round follows a period of rapid financial and technical expansion for the Hangzhou-based research lab. DeepSeek completed its initial external capital round earlier this summer at a valuation exceeding $50 billion. The la

    AI
    2 min read

  13. LLM Evaluation Frameworks in Production: Comparing DeepEval, Ragas, Promptfoo, and TruLens Architecture, Synthetic Data Generation, Judge Calibration, and CI/CD Automation

    Automated evaluation is the primary engineering bottleneck in deploying reliable LLM applications. While traditional software engineering relies on deterministic unit and integration tests with binary pass/fail conditions, generative AI systems produce non-deterministic, open-ended natural language outputs. Relying on manual human review or ad-hoc prompting fails to catch regressions across prompt modifications, model version updates, and retrieval pipeline adjustments. To establish rigorous qu

    AI
    8 min read

  14. Byte-Pair Encoding (BPE) and Modern Subword Tokenization: Mathematical Foundations, Merge Dynamics, Byte-Level Encodings, and Vocabulary Compression Mechanics

    Tokenization is the discrete boundary interface between raw textual sequences and the continuous vector representations of autoregressive large language models. Before an attention block computes a single inner product or a feed-forward network applies an activation function, an input string must be mapped into an ordered sequence of discrete integer identifiers drawn from a finite vocabulary $V$. The design and mathematical properties of this mapping govern key operational characteristics of l

    AI
    11 min read

  15. Consumer AI Agent Startup Instinct Raises $250 Million Series B at $2.5 Billion Valuation

    Artificial intelligence startup Instinct, incorporated under Spear Street Technology, has raised $250 million in a Series B funding round co-led by Index Ventures and Benchmark. The new capital brings Instinct's total funding to $350 million and values the one-year-old startup at $2.5 billion. Consumer Autonomous Agent Architecture Instinct develops a personal AI assistant intended to autonomously manage daily digital logistics on behalf of individual users. Founded by 23-year-old researcher

    Instinct
    2 min read

  16. Post-Training Quantization (PTQ): Mathematical Foundations of Optimal Brain Surgeon, GPTQ Hessian Inversion, AWQ Salient Scaling, and SmoothQuant Outlier Migration

    Post-Training Quantization (PTQ): Mathematical Foundations of Optimal Brain Surgeon, GPTQ Hessian Inversion, AWQ Salient Scaling, and SmoothQuant Outlier Migration Serving modern large language models at scale requires addressing severe hardware constraints. In autoregressive generation, decoding is fundamentally bounded by memory bandwidth rather than floating-point computation throughput. Each generated token requires reading every parameter from High Bandwidth Memory (HBM) into SRAM to perfo

    AI
    10 min read

  17. Speculative Decoding: Mathematical Foundations, Distribution Preservation Proofs, Tree-Structured Verification, and Memory-Bandwidth Amortization

    Autoregressive large language model (LLM) generation suffers from an acute hardware efficiency mismatch during inference. While the prefill phase (processing the input prompt) processes tokens in parallel and achieves high arithmetic intensity on modern matrix accelerators, the decode phase (generating text token-by-token) is fundamentally memory-bandwidth bound. At small batch sizes, each generated token requires transferring the model's entire multi-billion-parameter weight matrix from High-Ba

    AI
    13 min read

  18. OpenAI Allocates $400 Million to Second Startup Fund as Sole Investor

    According to regulatory filings submitted to the U.S. Securities and Exchange Commission (SEC), OpenAI has established a $400 million venture vehicle for its second startup fund. In a notable structural shift from its inaugural vehicle, OpenAI is serving as the sole investor, committing capital directly from its corporate balance sheet. The launch marks a significant departure from the mechanics of the original OpenAI Startup Fund, established in 2021. That initial $175 million fund was raised

    OpenAI
    2 min read

  19. LLM Observability and Tracing in Production: Comparing Langfuse, Arize Phoenix, LangSmith, and OpenLLMetry

    Moving language models from single-turn prompt wrappers into multi-agent architectures, recursive Retrieval-Augmented Generation (RAG) graphs, and autonomous tool-calling loops fundamentally changes system dynamics. LLM applications behave as distributed state machines where failure modes are rarely deterministic. Latency spikes can stem from vector store indexing bottlenecks, context window bloat, or slow token generation, while quality degradations emerge through subtle prompt drift, context c

    AI
    7 min read

  20. Zhipu's GLM-5.3-Flash Runs Fully on Domestic Chinese Chips, Challenges NVIDIA Dominance

    Zhipu's GLM-5.3-Flash Runs Fully on Domestic Chinese Chips, Challenges NVIDIA Dominance Zhipu AI's GLM-5.3-Flash model, initially released as the mysterious "Niu Lai" (Ox Alpha) model, has been confirmed to run entirely on domestically produced Chinese accelerator chips, marking a significant milestone in China's AI self-sufficiency efforts. The 320B parameter mixture-of-experts model activates only 18B parameters and achieves performance comparable to Claude Opus 4.8 while operating at 1/40th

    AI
    2 min read