Subscribe
Archive / page 55 of 123

Latest articles, page 55

  1. Generalized Advantage Estimation: How Exponential Weighting Balances Bias and Variance in Policy Optimization

    Policy gradient algorithms form the theoretical backbone of modern policy optimization, ranging from continuous robotic control to reinforcement learning from human feedback (RLHF) in frontier large language models. A persistent challenge in policy optimization is variance: estimating the gradient of expected cumulative reward over stochastic trajectories generates high-variance Monte Carlo signals that require massive sample sizes and risk destabilizing gradient updates. Generalized Advantage

    AI
    6 min read

  2. IBM Unveils 2nm Dual-Architecture Mainframe Processor with Native Arm and On-Chip AI Acceleration

    IBM unveiled the industry's first dual-architecture mainframe processor at the annual Hot Chips conference, detailing custom silicon capable of natively executing both IBM Z (s390x) and Arm (Arm64) instruction set architectures on the exact same physical cores. Fabricated on a leading-edge 2-nanometer process node, the upcoming processor is engineered to bridge traditional enterprise transaction processing with the modern, Arm-dominated software ecosystem, particularly containerized AI framewor

    IBM
    3 min read

  3. ByteDance Consolidates TRAE and Coze into Doubao, Readies 'Doubao Work' Enterprise Brand

    ByteDance has initiated an internal organizational restructuring to consolidate its enterprise AI developer tools and agent platforms under the Doubao ecosystem. The company is merging the teams and technologies behind its AI programming suite TRAE and agent-building platform Coze into Doubao, preparing to launch a unified enterprise AI suite branded "Doubao Work." The restructuring concentrates disparate AI tools into a single corporate pillar to compete against domestic rivals, notably Tencen

    ByteDance
    2 min read

  4. Hierarchical Tree-Organized Retrieval (RAPTOR) in Production RAG: Recursive Summarization, Gaussian Mixture Clustering, and Cross-Scale Querying

    Standard retrieval-augmented generation (RAG) architectures operate on flat document chunks. Corpora are split into fixed token windows (typically 256 to 1024 tokens), mapped into vector space via dense embedding models, and queried through approximate nearest neighbor (ANN) search. While this setup efficiently resolves localized factual lookups ("What is the termination clause in contract X?"), it systematically fails on thematic synthesis, cross-document comparison, and high-level aggregation

    RAG
    7 min read

  5. Data Pruning and Core-Set Selection in Deep Learning: How EL2N, GraNd, and Memorization Dynamics Break Power-Law Scaling

    Modern foundation models are trained on tens of trillions of tokens, requiring millions of GPU hours. Yet empirical analyses consistently reveal that massive portions of web-crawled corpora and large-scale vision datasets are either highly redundant, uninformative, or dominated by unlearnable noise. Standard empirical scaling laws (such as those formulated by Kaplan et al. and Chinchilla) model generalization error as a power-law function of total training samples ($L(N) \propto N^{-\alpha}$). H

    AI
    7 min read

  6. Alibaba Launches Wan 3.0 AI Video Model with Native 30-Second Generation and Document Inputs

    Alibaba Tongyi Lab has launched a public beta of Wan 3.0, the latest iteration of its video generation model family. Available on Alibaba Cloud Model Studio and Qwen Cloud under the model identifier wan3.0-video, the model produces up to 30 seconds of continuous video in a single pass at resolutions up to 1080p. Unlike predecessor models such as Wan 2.7, which capped single-pass output at 15 seconds, Wan 3.0 consolidates video synthesis into a unified architecture and expands supported input mo

    AI
    2 min read

  7. Long-Context Evaluation in Production: Why Synthetic Needles Fail, Multi-Hop Stress Testing, and Benchmarking Effective Context Size

    Frontier model providers frequently market sequence lengths spanning 128K, 1M, or 2M tokens. However, engineering teams deploying these models in production environments for codebase refactoring, multi-turn agent execution, or complex document analysis regularly observe severe retrieval failures and reasoning breakdowns well before hitting context boundaries. The primary culprit behind this disconnect is the widespread reliance on vanilla Needle In A Haystack (NIAH) evaluations. While standard

    AI
    6 min read

  8. Energy-Based Models: How Energy Landscapes, Contrastive Divergence, and Langevin Dynamics Unify Generative Learning

    Energy-Based Models: How Energy Landscapes, Contrastive Divergence, and Langevin Dynamics Unify Generative Learning Probabilistic modeling in machine learning fundamentally centers on estimating data distributions over high-dimensional spaces. Standard generative architectures achieve this by enforcing structural constraints: autoregressive models factorize joint distributions through causal chains, normalizing flows constrain network architectures to invertible bijections with tractable Jacobi

    AI
    9 min read

  9. Tabular RAG in Production: Table Serialization, Row-Column Chunking, NL-to-SQL Hybridization, and Dense Entity Linking

    Tabular RAG in Production: Table Serialization, Row-Column Chunking, NL-to-SQL Hybridization, and Dense Entity Linking Standard Retrieval-Augmented Generation (RAG) architectures excel when indexing unstructured prose. Dense semantic embeddings, recursive character chunking, and bi-encoder vector similarity match user queries against passages that follow linear syntactic structures. However, when these pipelines encounter tabular data (such as financial statements, medical registries, inventory

    AI
    7 min read

  10. NVIDIA Releases Magpie Multilingual TTS: 364M Open-Weight Model for Sub-200ms Voice Agents

    NVIDIA has released Magpie Multilingual TTS, a 364-million parameter open-weights text-to-speech model engineered for low-latency conversational AI agents. Released under the NVIDIA Open Model License, the model is available as open checkpoints on the Hugging Face Hub and as an optimized microservice container within NVIDIA NIM. The release expands language support to 12 languages: English, Spanish, French, German, Italian, Vietnamese, Mandarin, Hindi, Japanese, Modern Standard Arabic, Korean,

    AI
    2 min read