Subscribe
Subscribe
Archive / page 19 of 49

Latest articles, page 19

  1. Low-Rank Adaptation (LoRA) and DoRA: Mathematical Foundations, Intrinsic Dimensionality, and Directional Weight Decomposition

    Low-Rank Adaptation (LoRA) and DoRA: Mathematical Foundations, Intrinsic Dimensionality, and Directional Weight Decomposition Full-parameter fine-tuning of large language models presents prohibitive memory requirements during training. Standard full fine-tuning requires updating every weight matrix in a model, demanding storage not only for the model parameters themselves, but also for activation tensors, backward gradients, and first- and second-moment optimizer states. For a 70-billion-parame

    AI
    15 min read

  2. Model Merging in Production: Comparing Task Arithmetic, TIES-Merging, DARE, and SLERP Architecture, Weight Interference Mitigation, and Serving Economics

    Model Merging in Production: Comparing Task Arithmetic, TIES-Merging, DARE, and SLERP Architecture, Weight Interference Mitigation, and Serving Economics In production language model deployment, teams frequently encounter a fundamental operational tension: specialized task performance versus serving cost. Fine-tuning distinct base model instances on specific internal domains (such as code generation, legal document analysis, mathematical reasoning, and safety alignment) produces high task accur

    AI
    9 min read

  3. Hugging Face Evaluates Acquisition Inquiries at $13B Valuation

    Open-source machine learning hub Hugging Face has received preliminary acquisition approaches that value the company at $13 billion or higher, according to reporting from Business Insider and TechCrunch. The company is reportedly consulting with investment banks to assess inbound interest, though no formal sale agreement has been signed. The prospective valuation represents nearly a three-fold increase from Hugging Face's August 2023 Series D funding round, which valued the company at $4.5 bill

    AI
    2 min read

  4. Stripe to Acquire AI Gateway Startup OpenRouter for a Reported $7.5B

    Stripe said on August 19 that it has agreed to acquire OpenRouter, the AI model routing platform, and did not disclose terms. Bloomberg first reported on August 16 that the companies had finalized a deal worth more than $7 billion. The New York Times, citing a person familiar with the matter, put the price at about $7.5 billion, with $1.5 billion allocated to OpenRouter's founders, CNBC reported. OpenRouter announced in May that it had raised a $113 million Series B at a reported $1.3 billion v

    AI
    2 min read

  5. Speculative Decoding in Production Serving: Comparing Small Draft Models, Medusa, EAGLE-2, and Lookahead Decoding Architecture, Verification Tree Overhead, and Throughput Economics

    Large language model inference during autoregressive decoding is structurally memory-bandwidth bound. During generation, each forward pass loads the model weight matrices (tens to hundreds of gigabytes) from High-Bandwidth Memory (HBM) into on-chip SRAM to produce a single token. Because the arithmetic intensity is close to zero, modern accelerators like the NVIDIA H100 and B200 spend the vast majority of their compute cycles stalled on memory bus transfers rather than executing matrix multiplic

    AI
    7 min read

  6. OpenAI Reinstates 5-Hour Codex and Work Limits for ChatGPT Plus Subscribers

    OpenAI has reinstated a rolling five-hour rate limit on Codex and ChatGPT Work for ChatGPT Plus subscribers. The change ends a temporary multi-week period during which the short-term window was suspended and users were constrained only by overall weekly quota ceilings. OpenAI engineering lead Thibault Sottiaux confirmed the reinstatement, stating that re-enforcing the five-hour window is necessary to smooth peak compute load across OpenAI's inference fleet as developer adoption of complex multi

    OpenAI
    1 min read

  7. Samsung Evaluates Claude Code for Semiconductor Verification Amid Code Safety Concerns

    Samsung Electronics has integrated Anthropic's Claude Code into semiconductor verification and driver development within its System LSI division. While the deployment achieved major efficiency gains, engineering evaluations revealed critical out-of-scope behaviors that prevent autonomous code execution in hardware synthesis. Samsung's System LSI business unit, which designs Exynos application processors and custom mobile chipsets, operates with approximately 6,000 employees compared to roughly

    Samsung
    2 min read

  8. Anthropic Implements Embedded Text Watermarks and C2PA Provenance Under EU AI Act

    Anthropic has begun embedding machine-readable watermarks directly into text generated by its Claude models alongside cryptographic provenance metadata in generated files. The rollout formalizes Anthropic's commitments under the European Union AI Act's Article 50(2) Code of Practice on Transparency of AI-Generated Content, applying universally across consumer and enterprise interfaces worldwide. The marking system operates at the model level rather than the application layer. For text generatio

    Anthropic
    2 min read

  9. Disaggregated Prefill and Decode in Production LLM Serving: Architecture, Network KV Cache Migration, Chunked Prefill Trade-Offs, and Asymmetric Hardware Economics

    Large language model serving systems have historically treated transformer execution as a homogeneous sequence of forward passes over a single unified GPU pool. Under continuous batching engines, incoming requests execute their prompt evaluation (prefill) and autoregressive token generation (decode) on the exact same accelerators, co-locating both phases within shared iteration batches. While continuous batching improves GPU compute utilization compared to static batching, co-locating prefill a

    Inference
    11 min read

  10. Hugging Face Introduces gr.Workflow to Turn AI Pipelines into Visual Graphs and REST APIs

    Hugging Face has released gr.Workflow, a native extension to the Gradio framework designed to convert multi-stage artificial intelligence pipelines into interactive node graphs, visual user interfaces, and deployable REST APIs. Modern machine learning applications increasingly rely on compound pipelines that chain heterogeneous models: generating text via large language models, feeding prompts into diffusion systems, processing outputs through background removal or audio synthesis models, and a

    AI
    2 min read