Subscribe
Topic / page 2

Edge AI

Articles, page 2

21-28
  1. UK and Ukraine Sign AI Defense Pact to Share Battlefield Sensor Data and Target Detection Models

    The United Kingdom and Ukraine have signed a bilateral artificial intelligence defense partnership, granting British researchers and defense contractors access to Ukraine's battlefield data platform, Avengers AI Labs. The agreement was signed in Kyiv by British Prime Minister Andy Burnham and Ukrainian President Volodymyr Zelenskyy during Burnham's first official overseas visit. Under the framework, Britain becomes the first international partner permitted to access Ukraine's operational datase

    AI
    2 min read
  2. Ukrainian Officials Identify Nvidia Jetson Orin Modules in Autonomous Russian Strike Drones

    Ukrainian forensic examiners inspecting the wreckage of Russian strike drones have recovered Nvidia Jetson Orin microcomputers, confirming that Moscow is deploying commercial edge-computing hardware to run autonomous targeting systems on the battlefield. The findings, detailed in investigations by Ukrainian military specialists and reported by The New York Times, indicate that Russian engineers have integrated off-the-shelf edge AI accelerators into modified uncrewed aerial vehicles, including

    Hardware
    2 min read
  3. Decentralized and Peer-to-Peer LLM Inference in Production: Architecture, Ring Memory Partitioning, and Network Latency

    Decentralized and Peer-to-Peer LLM Inference in Production: Architecture, Ring Memory Partitioning, and Network Latency Frontier open-weight models such as Llama 3.1 405B, DeepSeek-V3, and Command R+ have expanded model capabilities, but their parameter scales exceed the physical memory limits of individual consumer and edge workstations. Running a 405-billion parameter model in 16-bit precision requires over 810 GB of memory, and even 4-bit quantized variants require roughly 230 GB of contiguo

    AI
    7 min read
  4. Waymo Details Custom 5nm ASIC and Heterogeneous Compute Architecture for Robotaxis

    Alphabet subsidiary Waymo has disclosed the architectural specifications of the computing platform powering its sixth-generation autonomous driving system, revealing a custom 5-nanometer application-specific integrated circuit (ASIC) engineered specifically for front-end sensor ingestion and edge machine learning. The disclosure, authored by VP of Engineering Satish Jeyachandran and Compute Lead Daniel Rosenband, details how the company processes raw data from onboard sensor arrays in real time

    Autonomous Vehicles
    2 min read
  5. Liquid AI Releases Quantization-Aware Distilled Q4_0 Checkpoints for LFM2.5 Models

    Liquid AI has released Quantization-Aware Distillation (QAD) Q4_0 GGUF checkpoints for its LFM2.5 model series, allowing edge runtimes to execute 4-bit quantized non-transformer architectures without the accuracy degradation typically associated with standard post-training quantization (PTQ). The release covers four models in the LFM2.5 family: LFM2.5-230M, LFM2.5-350M, LFM2.5-1.2B-Instruct, and LFM2.5-2.6B. The checkpoints are packaged in the standard GGUF format and run across llama.cpp and c

    AI
    2 min read
  6. On-Device LLM Inference in Production: Architecture, Runtimes, and Hardware Constraints

    Deploying generative language models directly onto edge devices such as smartphones, laptops, embedded systems, and browser sandboxes marks a fundamental shift in AI systems engineering. Moving inference from centralized GPU clusters to client silicon eliminates cloud API costs, cuts network latency to zero, guarantees data privacy by keeping user inputs local, and enables offline functionality. However, executing modern autoregressive models on resource-constrained client hardware presents str

    AI
    7 min read
  7. Liquid AI ships LFM2.5-VL-3B, a 3B vision model built for the edge

    Liquid AI has released LFM2.5-VL-3B, a roughly three billion parameter vision-language model designed to run on phones, laptops, and other edge hardware instead of in a data center. The model pairs the LFM2.5-2.6B text backbone with a SigLIP2 NaFlex image encoder. Unlike many recent models, it does not reason step by step. It answers directly, which keeps latency low for real-time and on-device use, and it handles a 32,000 token context. What it is built to do Liquid says the release adds fo

    AI
    2 min read
  8. Liquid AI ships LFM2-VL-3B, a 3B vision model built for the edge

    Liquid AI has released LFM2-VL-3B, a 3 billion parameter vision-language model designed to run on edge hardware rather than in a data center. It is the largest model in the company’s LFM2-VL family, which previously topped out at 1.6B parameters, and is available now under the LFM Open License on Hugging Face and through Liquid AI’s LEAP platform. The model pairs Liquid AI’s densest text backbone, LFM2-2.6B, with a SigLIP2 400M NaFlex vision encoder. That combination lets it take in images at t

    AI Models
    2 min read