Subscribe
Archive / page 37 of 123

Latest articles, page 37

  1. OpenAI Unveils Jalapeño Custom Inference Chip Benchmarks at Hot Chips 37

    OpenAI presented the first architecture and benchmark disclosures for its custom inference chip, code-named Jalapeño, during the 37th Hot Chips conference. In published test data and technical disclosures, OpenAI reported that Jalapeño achieves 1.5x to 1.9x higher performance per watt and 1.7x to 3.6x lower end-to-end latency compared to Nvidia Blackwell GB200 and GB300 systems on production LLM workloads. Developed in co-design partnership with Broadcom, Jalapeño represents OpenAI's initial ha

    AI
    2 min read

  2. Nvidia Agrees to Acquire Hugging Face for $12.9 Billion

    Nvidia has agreed to acquire Hugging Face for $12.9 billion, according to reporting from The Information. Parallel reports from Business Insider, Bloomberg, and Reuters confirm that the companies engaged in advanced acquisition negotiations valuing the open-source artificial intelligence hub between $12.9 billion and $13 billion. The transaction marks the largest software and developer platform acquisition in Nvidia's history, placing the primary distribution nexus for open-weight foundation mo

    AI
    3 min read

  3. AI Assistant Startup Instinct Raises $250M Series B at $2.5B Valuation

    Spear Street Technology, the creator of the personal AI assistant Instinct, has raised $250 million in a Series B funding round that values the one-year-old startup at $2.5 billion. The investment was co-led by Index Ventures and Benchmark, with participation from Greenoaks and Conviction. The capital injection brings Instinct's total funding to $350 million, following a $75 million Series A led by Kleiner Perkins partner Mamoon Hamid earlier in August 2026 and initial seed financing backed by

    Agents
    2 min read

  4. AWS and NVIDIA Expand AI Partnership to Deploy 2 Million Additional Blackwell Ultra and Rubin GPUs

    Amazon Web Services (AWS) and NVIDIA have announced a major expansion of their cloud infrastructure partnership, committing to deploy two million additional high-end NVIDIA GPUs across AWS global data centers in 2027 and 2028. The deployment expands on AWS's previous commitment from GTC 2026 to add one million GPUs starting in 2026, bringing total forward allocations across the multi-year cycle to three million units. The upcoming capacity will comprise NVIDIA Blackwell Ultra, Rubin, and Rubin

    AI
    2 min read

  5. Agent Memory Frameworks in Production: Comparing Mem0, Letta, Zep Graphiti, and Cognee — Architecture, Entity Extraction, Temporal Graph Indexing, and Serving Economics

    Large language model agents deployed in production environments face a fundamental architectural bottleneck: LLM context windows are stateless, ephemeral, and computationally expensive. While context window capacities have expanded to 1M+ tokens in modern frontier models, naive context stuffing (re-injecting unpruned conversational history on every turn) creates severe operational failure modes: quadratic attention compute overhead, high latency, rapid KV cache invalidation, and severe context d

    AI
    9 min read

  6. Sentence Transformers 6.0 Adds MultiVectorEncoder for ColBERT Late-Interaction Training

    Hugging Face has released Sentence Transformers v6.0, adding native architecture and training workflows for multi-vector late-interaction retrieval models. The update introduces MultiVectorEncoder, bringing ColBERT-style token-level representations directly into the library alongside existing dense embedding, sparse embedding, and cross-encoder reranker classes. While traditional dense retrieval compresses an entire document into a single fixed-dimension vector, multi-vector models preserve ind

    AI
    2 min read

  7. Amazon Acquires DuckLabs to Integrate DuckDB into AWS Analytics and AI Agent Workflows

    Amazon has entered into a definitive agreement to acquire DuckLabs, the Amsterdam-based company behind the open-source columnar database DuckDB. The acquisition brings the DuckLabs development team into Amazon Web Services (AWS), where they will operate as a wholly owned subsidiary starting in early September. Financial terms of the transaction were not disclosed. DuckDB creators and DuckLabs co-founders Hannes Mühleisen and Mark Raasveldt will continue leading the team from Amsterdam, maintain

    AI
    2 min read

  8. NVIDIA Reports $96.2B Quarter as Data Center Revenue Reaches $89B

    NVIDIA Reports $96.2B Quarter as Data Center Revenue Reaches $89B NVIDIA reported second-quarter fiscal 2027 revenue of $96.2 billion, representing a 106% year-over-year increase, the company announced in its earnings release on August 26, 2026. The Data Center segment drove the results with $89.0 billion in quarterly revenue, up 117% from the prior year. Edge Computing contributed $7.2 billion, up 27% year over year. GAAP and non-GAAP gross margins both came in at 75.0%, while GAAP diluted e

    AI
    3 min read

  9. Activation-Aware Weight Quantization (AWQ): Mathematical Foundations, Salient Weight Protection, and INT4 Tensor Core Execution

    Activation-Aware Weight Quantization (AWQ): Mathematical Foundations, Salient Weight Protection, and INT4 Tensor Core Execution Large language models have transformed AI applications, but their deployment remains constrained by memory and compute barriers. A 70B parameter model in FP16 occupies ~140 GB of VRAM — exceeding even the 192 GB of NVIDIA's flagship B200 GPU, let alone edge devices. Quantization addresses this by reducing weight precision from 16-bit floats to 4-bit integers, shrinking

    AI
    6 min read

  10. Deep Cogito Raises $43M Series A to Scale Post-Training and Iterated Distillation

    San Francisco AI research startup Deep Cogito has raised a $43 million Series A round to expand its post-training systems and reinforcement learning infrastructure for open-weight foundation models. The round was led by TQ Ventures, with participation from Benchmark, Nexus Venture Partners, Atreides Management, South Park Commons, and enterprise cloud security provider Zscaler, which acts as both a commercial customer and strategic investor. The financing brings total capital raised by Deep Cog

    AI
    2 min read