AI PORTAL
  • Models
  • Code
  • Tools

About the models on this Arm AI Portal

The Arm AI Portal (the “Portal”) provides details of AI models developed, optimized or tested for use on Arm-based platforms. Models listed on the Portal may have been developed by Arm or by third parties. Unless expressly stated otherwise, Arm did not develop or train the underlying third-party model and is not responsible for its original intended behavior or use.

Information accompanies each model listing and describes the model’s provenance, together with relevant information about the original third-party model, its developer and repository, where applicable. Inclusion on the Portal of a model developed by a third party or based on a third-party model does not constitute Arm’s endorsement or certification of that third-party model or any third-party work relating to it.

Except as expressly stated in the information accompanying a specific model, Arm makes no representation as to the accuracy, safety, security, non-infringement, legal compliance, suitability for production use or fitness for any particular purpose of any model, converted or optimized version, or related outputs.

Inclusion of a model on the Portal does not itself grant you any rights to use that model. Use of each model is subject to the applicable license terms, usage restrictions and documentation. You are responsible for reviewing that information and independently evaluating the model, its outputs and its suitability for your intended use, including compliance with applicable legal, regulatory, safety and security requirements. Any use of or reliance on a model, its outputs or related materials is at your own risk. Where the Portal links to repositories or other materials controlled by third parties, those repositories and materials are outside Arm’s control and may change without notice.

Use of the Portal is subject to the Arm Website Terms and Conditions of Use.

Models

Filters

1

Device Class

Edge LinuxEthos-U NPUMobile CPUCloud CPU

Evaluation Target

Raspberry Pi 5vivo X300AWS Graviton G4Alif DK-E8

Arm Technology

SME2

Task

Image ClassificationText GenerationFeature ExtractionImage To ImageObject DetectionImage SegmentationAutomatic Speech RecognitionAudio ClassificationDepth EstimationKeypoint DetectionAudio Text To TextText To ImageZero Shot Image Classification

Vendor

Runtime

Quantization

Format

Execution Backend

Model Size

≤9 GB

Average Memory

≤3.52 GB

Peak Memory

≤8.79 GB
    118 results

    ResNet-50 INT8

    Raspberry Pi 5

    INT8-quantized 50-layer residual network for 1000-class image classification. It uses symmetric per-channel quantization with XNNPACK support, accepts 224×224 RGB inputs with ImageNet normalization, and returns raw logits for class prediction.

    image-classification25.9 MB
    ExecuTorch

    GoogLeNet INT8

    AWS Graviton G4

    An INT8-quantized GoogLeNet image classification model based on an Inception-style convolutional architecture. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-classification7.1 MBExecuTorch

    YOLO11n INT8

    Raspberry Pi 5

    This is an INT8-quantized version of YOLO11n optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static symmetric per-channel quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded, Raspberry Pi).

    object-detection5 MBExecuTorch

    YOLO11n-Pose INT8

    Raspberry Pi 5

    This is an INT8-quantized version of yolo11n-pose (Ultralytics) optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (Raspberry Pi 5, mobile ARM, embedded).

    keypoint-detection5.4 MBExecuTorch

    YAMNet INT8

    Raspberry Pi 5

    An INT8-quantized YAMNet audio classification model for recognizing sound events. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    audio-classification4.1 MBExecuTorch

    ResNet-18 INT8

    Raspberry Pi 5

    INT8-quantized 18-layer residual network for 1000-class image classification, optimized for efficient ARM edge inference with ExecuTorch and the XNNPACK backend. It uses 224×224 RGB inputs with ImageNet normalization and returns logits for top-k prediction, offering a much smaller, faster, and lower-memory alternative to the FP32 baseline while retaining comparable classification quality.

    image-classification11.8 MBExecuTorch

    YOLOX-s INT8

    Raspberry Pi 5

    This is an INT8-quantized version of YOLOX-s optimized for edge deployment on ARM devices using ExecuTorch with the XNNPACK backend. The model was quantized using PT2E static quantization and exported to the .pte format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded).

    object-detection15 MBExecuTorch

    TinyLlama 1.1B Chat INT8

    Raspberry Pi 5

    An INT8-quantized TinyLlama 1.1B Chat causal language model for conversational text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation1.2 GBExecuTorch

    GoogLeNet INT8

    Alif DK-E8

    An INT8-quantized GoogLeNet image classification model based on an Inception-style convolutional architecture. Exported as an ExecuTorch program using the Ethos-U delegate for inference on Arm Ethos-U NPUs.

    image-classification5.5 MBExecuTorch

    YOLOX-S INT8

    vivo X300

    An INT8-quantized YOLOX-S single-stage, anchor-free object detection model for locating and classifying objects in images. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    object-detection9.7 MBExecuTorch

    ResNet-50 INT8 (per-tensor)

    Alif DK-E8

    A 50-layer residual convolutional neural network for 1000-class image classification, using INT8 per-tensor quantization to reduce size and computation while preserving strong accuracy. It accepts 224×224 RGB inputs with ImageNet-style preprocessing and produces raw logits over 1,000 categories.

    image-classification15.1 MBExecuTorch

    DETR ResNet-50 INT8

    Raspberry Pi 5

    An INT8-quantized DETR object detection model combining a ResNet-50 backbone with a transformer-based detection architecture. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    object-detection135 MBExecuTorch

    MiDaS V2 INT8

    AWS Graviton G4

    An INT8-quantized monocular depth estimation model that predicts relative inverse-depth maps from single RGB images. It uses a ResNet-based backbone and produces dense depth outputs suitable for applications such as AR/VR, robotics, novel-view synthesis, and image editing. Inputs are resized RGB images, and outputs are relative depth maps requiring calibration for metric depth.

    depth-estimation105.4 MBExecuTorch

    QuickSRNetSmall INT8

    Raspberry Pi 5

    An INT8-quantized QuickSRNetSmall image super-resolution model for upscaling low-resolution images. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-to-image41.9 KBExecuTorch

    Gemma 2 2B INT8

    Raspberry Pi 5

    An INT8-quantized Gemma 2 2B causal language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation4 GBExecuTorch

    Qwen2.5 0.5B Instruct INT8

    Raspberry Pi 5

    An INT8-quantized Qwen2.5 0.5B Instruct causal language model for instruction-following and text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation806.7 MBExecuTorch

    Phi-3.5 Mini INT8

    AWS Graviton G4

    An INT8-quantized Phi-3.5 Mini language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation5 GBExecuTorch

    BGE Base EN v1.5 INT8

    vivo X300

    An INT8-quantized BGE Base EN v1.5 English text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction191.8 MBExecuTorch

    Llama 3.1 8B Instruct INT8

    Raspberry Pi 5

    An INT8-quantized Llama 3.1 8B Instruct causal language model for instruction-following and text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation9 GBExecuTorch

    YOLOv8s INT8

    Raspberry Pi 5

    An INT8-quantized single-stage object detector for 80 COCO classes, using an anchor-free architecture with 640×640 RGB inputs. It outputs bounding boxes and class scores for common objects, with postprocessing via confidence filtering, box conversion, and per-class non-maximum suppression.

    object-detection13.9 MBExecuTorch

    YOLOX-S INT8

    AWS Graviton G4

    An INT8-quantized YOLOX-S single-stage, anchor-free object detection model for locating and classifying objects in images. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    object-detection9.7 MBExecuTorch

    Wide ResNet-50 INT8

    vivo X300

    An INT8-quantized Wide ResNet-50 image classification model using a widened residual convolutional network for visual feature extraction. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    image-classification50.6 MBExecuTorch

    MobileSAM INT8

    Raspberry Pi 5

    An INT8-quantized, lightweight segment-anything image segmentation family with a compact TinyViT backbone, designed for box-prompted instance mask generation. It produces multiple candidate masks with IoU quality scores from RGB images and bounding-box prompts, offering reduced size and memory use while preserving high mask quality.

    image-segmentation22.8 MBExecuTorch

    Phi-4 Mini INT8

    vivo X300

    An INT8-quantized Phi-4 Mini language model for text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation5.3 GBExecuTorch

    TinyLlama 1.1B Chat INT8

    vivo X300

    An INT8-quantized TinyLlama 1.1B Chat causal language model for conversational text generation. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    text-generation1.2 GBExecuTorch

    SmolLM2-360M-Instruct 8da4w

    vivo X300SME2

    A compact 362M-parameter decoder-only causal language model for instruction-following, open-ended text generation, and multiple-choice scoring, using 8-bit dynamic activations and 4-bit grouped weights to reduce size and memory needs while preserving core language capabilities.

    text-generation251.7 MBExecuTorch

    ResNet-50 INT8 (per-channel)

    Alif DK-E8

    An INT8 per-channel quantized 50-layer residual network for 1000-class image classification, using residual connections to support deep feature extraction while reducing model size and compute requirements. It accepts 224×224 RGB inputs with ImageNet-style normalization and outputs raw logits for class prediction.

    image-classification22.8 MBExecuTorch

    EfficientSAM-S INT8

    AWS Graviton G4

    INT8-quantized box-prompted image segmentation model with a ViT-Small backbone and lightweight mask decoder. It accepts a 1024×1024 RGB image plus bounding-box coordinates and returns a binary mask for the prompted region, offering reduced model size and faster inference while preserving segmentation quality.

    image-segmentation33.5 MBExecuTorch

    Develop on Arm with your AI coding assistant

    The Arm AI Portal MCP Server makes it faster to find optimized models, integrate code examples and deploy to your target device from your agentic coding assistant.

    User guide

    Run the following command in your terminal:

    codex mcp add arm-ai --url https://mcp.api.devplatform.arm.com/ai-portal