Subscribe
Archive / page 35 of 123

Latest articles, page 35

  1. OpenAI Introduces Advertising to ChatGPT Free and Go Tiers in India

    OpenAI has begun displaying commercial advertisements to users on its Free and Go subscription tiers in India. The initiative marks the latest expansion of OpenAI's advertising monetization framework, following initial rollouts across the United States and selected European and Asia-Pacific markets earlier this year. India represents one of OpenAI's largest consumer bases globally, with over 100 million weekly active users recorded in early 2026. A substantial majority of this user volume acces

    AI
    1 min read

  2. State Space Models (SSMs) and Mamba: Mathematical Foundations of Continuous-Time Discretization, Selective Scan Mechanics, and Structured State Space Duality

    Autoregressive Large Language Models (LLMs) built on the standard Transformer architecture rely on softmax self-attention. While self-attention provides expressive in-context learning and dense token-to-token associative recall, it exhibits fundamental algorithmic scaling limits: prefill compute scales quadratically with sequence length ($O(L^2 d)$), and autoregressive token generation requires maintaining a Key-Value (KV) cache that grows linearly with sequence length ($O(L d)$). At context win

    AI
    12 min read

  3. Embedding Models and Rerankers in Production: Comparing Dense Bi-Encoders, ColBERT Late Interaction, Cross-Encoders, and Serving Architectures

    Production retrieval-augmented generation systems depend heavily on the retrieval pipeline that precedes generation. While frontier language models receive the bulk of engineering attention, the accuracy, latency, and operational cost of a RAG application are often determined by the interplay between embedding models and rerankers. Deploying search infrastructure requires navigating three distinct architectural paradigms: dense bi-encoders, multi-vector late interaction engines, and cross-encod

    AI
    6 min read

  4. Anthropic Opens 250,000 Claude Conversations to External Researchers Across Stanford, Oxford, and METR

    Anthropic's Societal Impacts team has released initial results from a research pilot that opened aggregate, real-world Claude conversation data to outside academic teams. The initiative partnered with researchers from Stanford University's Social and Language Technologies (SALT) Lab, the University of Oxford's Human Information Processing Lab, and the model evaluation non-profit METR. Each group conducted independent studies across a sample of approximately 250,000 conversations recorded on Clau

    AI
    2 min read

  5. OpenAI Details Custom Inference Chip 'Jalapeño' at Hot Chips, Targeting 700W Efficiency Against Nvidia Blackwell

    OpenAI has revealed architectural specifications and benchmark data for its first in-house artificial intelligence accelerator, code-named Jalapeño. Presented by hardware lead Richard Ho at the Hot Chips conference at Stanford University, the application-specific integrated circuit (ASIC) is engineered specifically for large language model inference rather than model training. Developed over an 18-month partnership with Broadcom and manufactured by TSMC, the chip targets large-scale token gener

    AI
    2 min read

  6. Low-Rank Adaptation (LoRA) and QLoRA: Mathematical Foundations, Intrinsic Rank Parameterization, NF4 Quantization, and Double Quantization Mechanics

    Low-Rank Adaptation (LoRA) and QLoRA: Mathematical Foundations, Intrinsic Rank Parameterization, NF4 Quantization, and Double Quantization Mechanics Parameter-efficient fine-tuning (PEFT) has become the standard operational methodology for adapting large language models to domain-specific tasks, downstream instruction following, and structured tool use. Full-parameter fine-tuning of frontier architectures requires updating and tracking optimizer states for tens or hundreds of billions of parame

    AI
    11 min read

  7. StreamingLLM and Attention Sinks: Mathematical Foundations of Softmax Normalization Artifacts, Initial Token Anchoring, and Infinite-Context Rolling KV-Cache Mechanics

    StreamingLLM and Attention Sinks: Mathematical Foundations of Softmax Normalization Artifacts, Initial Token Anchoring, and Infinite-Context Rolling KV-Cache Mechanics In autoregressive Large Language Models (LLMs), long-context deployment is constrained by the quadratic compute complexity of attention and the linear memory growth of the Key-Value (KV) cache. For an LLM processing a sequence of length $L$ with batch size $b$, hidden dimension $d$, and $n_{kv}$ key-value heads across $N_L$ trans

    AI
    11 min read

  8. Multi-Head Latent Attention (MLA): Mathematical Foundations, Low-Rank KV Compression, Decoupled RoPE Mechanics, and Matrix Absorption

    Multi-Head Latent Attention (MLA): Mathematical Foundations, Low-Rank KV Compression, Decoupled RoPE Mechanics, and Matrix Absorption Autoregressive inference in large language models is fundamentally constrained by memory bandwidth rather than floating-point computation throughput. During the generation phase, the transformer must load the Key-Value (KV) cache of all prior tokens from high-bandwidth memory (HBM) to on-chip SRAM for every newly generated token. As context lengths scale to hundr

    AI
    12 min read

  9. SoftBank in Talks to Acquire Majority Stake in Humanoid Robotics Maker 1X at $6 Billion Valuation

    SoftBank Group is in advanced discussions to acquire a controlling majority stake in humanoid robotics manufacturer 1X Technologies in a deal valuing the startup at approximately $6 billion, according to reporting by The Information and Reuters. 1X Technologies, founded by Bernt Øivind Børnich and backed by the OpenAI Startup Fund, designs autonomous bipedal and wheeled robots for industrial logistics and home assistance. Deal Structure and Strategic Context The negotiations mark a valuation

    AI
    2 min read

  10. DeepSeek Prepares $7.4B Funding Round at $74B Valuation to Build Custom Silicon and Compute Infrastructure

    Chinese frontier artificial intelligence laboratory DeepSeek is preparing to secure approximately $7.4 billion (50 billion yuan) in fresh funding at a $74 billion (500 billion yuan) pre-money valuation, according to reporting by The Wall Street Journal and Reuters. The funding round follows a period of rapid financial and technical expansion for the Hangzhou-based research lab. DeepSeek completed its initial external capital round earlier this summer at a valuation exceeding $50 billion. The la

    AI
    2 min read