AI PORTAL
  • Models
  • Code
  • Tools

About the models on this Arm AI Portal

The Arm AI Portal (the “Portal”) provides details of AI models developed, optimized or tested for use on Arm-based platforms. Models listed on the Portal may have been developed by Arm or by third parties. Unless expressly stated otherwise, Arm did not develop or train the underlying third-party model and is not responsible for its original intended behavior or use.

Information accompanies each model listing and describes the model’s provenance, together with relevant information about the original third-party model, its developer and repository, where applicable. Inclusion on the Portal of a model developed by a third party or based on a third-party model does not constitute Arm’s endorsement or certification of that third-party model or any third-party work relating to it.

Except as expressly stated in the information accompanying a specific model, Arm makes no representation as to the accuracy, safety, security, non-infringement, legal compliance, suitability for production use or fitness for any particular purpose of any model, converted or optimized version, or related outputs.

Inclusion of a model on the Portal does not itself grant you any rights to use that model. Use of each model is subject to the applicable license terms, usage restrictions and documentation. You are responsible for reviewing that information and independently evaluating the model, its outputs and its suitability for your intended use, including compliance with applicable legal, regulatory, safety and security requirements. Any use of or reliance on a model, its outputs or related materials is at your own risk. Where the Portal links to repositories or other materials controlled by third parties, those repositories and materials are outside Arm’s control and may change without notice.

Use of the Portal is subject to the Arm Website Terms and Conditions of Use.

Models

Filters

1

Device Class

Edge Linux

Evaluation Target

vivo X300Raspberry Pi 5AWS Graviton G4Alif DK-E8

Arm Technology

No Arm technologies available

Task

Image ClassificationText GenerationObject DetectionFeature ExtractionImage SegmentationKeypoint DetectionAudio ClassificationImage-to-ImageZero-Shot Image Classification

Vendor

Runtime

Quantization

Format

Execution Backend

Model Size

≤9 GB

Average Memory

≤319 MB

Peak Memory

≤8.79 GB
    57 results

    ResNet-50 INT8

    Raspberry Pi 5

    INT8-quantized 50-layer residual network for 1000-class image classification. It uses symmetric per-channel quantization with XNNPACK support, accepts 224×224 RGB inputs with ImageNet normalization, and returns raw logits for class prediction.

    image-classification25.9 MB
    ExecuTorch

    YOLO11n INT8

    Raspberry Pi 5

    This is an INT8-quantized version of YOLO11n optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static symmetric per-channel quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded, Raspberry Pi).

    object-detection5 MBExecuTorch

    YOLO11n-Pose INT8

    Raspberry Pi 5

    This is an INT8-quantized version of yolo11n-pose (Ultralytics) optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (Raspberry Pi 5, mobile ARM, embedded).

    keypoint-detection5.4 MBExecuTorch

    YAMNet INT8

    Raspberry Pi 5

    An INT8-quantized YAMNet audio classification model for recognizing sound events. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    audio-classification4.1 MBExecuTorch

    ResNet-18 INT8

    Raspberry Pi 5

    INT8-quantized 18-layer residual network for 1000-class image classification, optimized for efficient ARM edge inference with ExecuTorch and the XNNPACK backend. It uses 224×224 RGB inputs with ImageNet normalization and returns logits for top-k prediction, offering a much smaller, faster, and lower-memory alternative to the FP32 baseline while retaining comparable classification quality.

    image-classification11.8 MBExecuTorch

    YOLOX-s INT8

    Raspberry Pi 5

    This is an INT8-quantized version of YOLOX-s optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded).

    object-detection15 MBExecuTorch

    TinyLlama 1.1B Chat INT8

    Raspberry Pi 5

    An INT8-quantized TinyLlama 1.1B Chat causal language model for conversational text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation1.2 GBExecuTorch

    YOLO26s INT8 (640x640)

    Raspberry Pi 5

    This is an INT8-quantized version of YOLO26s, Ultralytics' NMS-free, end-to-end object detector with a one2one Detect head. It is optimized for edge deployment on ARM devices using ONNX Runtime, whose CPU execution provider dispatches INT8 GEMMs to MLAS and KleidiAI on aarch64. The detection head is left quantizable; PT2E-forced shared-scale Q/DQ artifacts around concatenation and permute ops in the head are stripped after conversion to preserve mixed-range box/score outputs.

    object-detection11.3 MBONNX

    DETR ResNet-50 INT8

    Raspberry Pi 5

    An INT8-quantized DETR object detection model combining a ResNet-50 backbone with a transformer-based detection architecture. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    object-detection135 MBExecuTorch

    QuickSRNetSmall INT8

    Raspberry Pi 5

    An INT8-quantized QuickSRNetSmall image super-resolution model for upscaling low-resolution images. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-to-image41.9 KBExecuTorch

    Gemma 2 2B INT8

    Raspberry Pi 5

    An INT8-quantized Gemma 2 2B causal language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation4 GBExecuTorch

    Qwen2.5 0.5B Instruct INT8

    Raspberry Pi 5

    An INT8-quantized Qwen2.5 0.5B Instruct causal language model for instruction-following and text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation806.7 MBExecuTorch

    Llama 3.1 8B Instruct INT8

    Raspberry Pi 5

    An INT8-quantized Llama 3.1 8B Instruct causal language model for instruction-following and text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation9 GBExecuTorch

    YOLOv8s INT8

    Raspberry Pi 5

    An INT8-quantized single-stage object detector for 80 COCO classes, using an anchor-free architecture with 640×640 RGB inputs. It outputs bounding boxes and class scores for common objects, with postprocessing via confidence filtering, box conversion, and per-class non-maximum suppression.

    object-detection13.9 MBExecuTorch

    MobileSAM INT8

    Raspberry Pi 5

    An INT8-quantized, lightweight segment-anything image segmentation family with a compact TinyViT backbone, designed for box-prompted instance mask generation. It produces multiple candidate masks with IoU quality scores from RGB images and bounding-box prompts, offering reduced size and memory use while preserving high mask quality.

    image-segmentation22.8 MBExecuTorch

    Inception v3 INT8

    Raspberry Pi 5

    An INT8-quantized Inception v3 convolutional image classification model using factorized convolutions for visual feature extraction. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-classification25.4 MBExecuTorch

    BGE Base EN v1.5 INT8

    Raspberry Pi 5

    An INT8-quantized BGE Base EN v1.5 English text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction140.9 MBExecuTorch

    CLIP ViT-B/32 INT8

    Raspberry Pi 5

    A quantized vision-language model for zero-shot image classification, pairing an INT8 vision encoder with an FP32 text encoder to produce aligned image and text embeddings for prompt-based similarity scoring and multimodal retrieval-style workflows.

    zero-shot-image-classification343.3 MBExecuTorch

    YOLO26n INT8 (640x640)

    Raspberry Pi 5

    This is an INT8-quantized version of YOLO26n, Ultralytics' NMS-free, end-to-end object detector with a one2one Detect head. It is optimized for edge deployment on ARM devices using ONNX Runtime, whose CPU execution provider dispatches INT8 GEMMs to MLAS and KleidiAI on aarch64. The detection head is left quantizable; PT2E-forced shared-scale Q/DQ artifacts around concatenation and permute ops in the head are stripped after conversion to preserve mixed-range box/score outputs.

    object-detection4.2 MBONNX

    MobileNetV3-Small INT8

    Raspberry Pi 5

    A compact INT8 image-classification CNN using inverted residual blocks, Squeeze-and-Excitation modules, and hard-swish activations to deliver efficient 1,000-class visual recognition with low compute and memory requirements.

    image-classification2.8 MBExecuTorch

    YOLOv5s INT8

    Raspberry Pi 5

    An INT8-quantized single-stage object detection model for 80 COCO classes, using an anchor-based architecture with 640×640 RGB inputs. It provides bounding boxes, objectness scores, and class probabilities, with postprocessing via confidence filtering, coordinate conversion, and per-class non-maximum suppression.

    object-detection7.5 MBExecuTorch

    EfficientNet-B4 INT8

    Raspberry Pi 5

    An INT8-quantized EfficientNet-B4 convolutional image classification model for visual recognition. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-classification22.8 MBExecuTorch

    SqueezeNet 1.1 INT8

    Raspberry Pi 5

    An INT8-quantized, fire-module CNN for efficient 1000-class image classification, using per-channel weights and per-tensor activations. It provides a compact, low-latency alternative to its FP32 counterpart with minimal accuracy impact, fixed 224×224 image inputs, and standard softmax-based top-class prediction outputs.

    image-classification1.3 MBExecuTorch

    OSNet x0.25 INT8

    Raspberry Pi 5

    This is an INT8-quantized version of OSNet x0.25 optimized for edge deployment on ARM devices using ONNX Runtime, profiled on Raspberry Pi 5. The model was quantized using PT2E static post-training quantization and exported to the .onnx format via the shared PT2E-to-ONNX pipeline for efficient inference on ARM Cortex-A processors.

    image-classification1.1 MBONNX

    YOLO12-L INT8

    Raspberry Pi 5

    This is an INT8-quantized version of YOLO12-L optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized with PT2E static post-training quantization (symmetric INT8, per-channel weights) and exported to the .pte format for efficient inference on ARM Cortex-A processors (Raspberry Pi, AWS Graviton, mobile ARM, embedded).

    object-detection35.5 MBExecuTorch

    SmolLM2 INT8

    Raspberry Pi 5

    An INT8-quantized SmolLM2 compact language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation202.2 MBExecuTorch

    SmolLM3 INT8

    Raspberry Pi 5

    An INT8-quantized SmolLM3 language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation3.8 GBExecuTorch

    Phi-3 Mini 3.8B INT8

    Raspberry Pi 5

    An INT8-quantized Phi-3 Mini 3.8B language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation4.1 GBExecuTorch

    Develop on Arm with your AI coding assistant

    The Arm AI Portal MCP Server makes it faster to find optimized models, integrate code examples and deploy to your target device from your agentic coding assistant.

    User guide

    Run the following command in your terminal:

    codex mcp add arm-ai --url https://mcp.api.devplatform.arm.com/ai-portal