AI PORTAL
  • Models
  • Code
  • Tools

About the models on this Arm AI Portal

The Arm AI Portal (the “Portal”) provides details of AI models developed, optimized or tested for use on Arm-based platforms. Models listed on the Portal may have been developed by Arm or by third parties. Unless expressly stated otherwise, Arm did not develop or train the underlying third-party model and is not responsible for its original intended behavior or use.

Information accompanies each model listing and describes the model’s provenance, together with relevant information about the original third-party model, its developer and repository, where applicable. Inclusion on the Portal of a model developed by a third party or based on a third-party model does not constitute Arm’s endorsement or certification of that third-party model or any third-party work relating to it.

Except as expressly stated in the information accompanying a specific model, Arm makes no representation as to the accuracy, safety, security, non-infringement, legal compliance, suitability for production use or fitness for any particular purpose of any model, converted or optimized version, or related outputs.

Inclusion of a model on the Portal does not itself grant you any rights to use that model. Use of each model is subject to the applicable license terms, usage restrictions and documentation. You are responsible for reviewing that information and independently evaluating the model, its outputs and its suitability for your intended use, including compliance with applicable legal, regulatory, safety and security requirements. Any use of or reliance on a model, its outputs or related materials is at your own risk. Where the Portal links to repositories or other materials controlled by third parties, those repositories and materials are outside Arm’s control and may change without notice.

Use of the Portal is subject to the Arm Website Terms and Conditions of Use.

Models

Filters

1

Device Class

Edge LinuxMobile CPU

Evaluation Target

vivo X300Raspberry Pi 5

Arm Technology

SME2

Task

Text GenerationImage ClassificationObject DetectionFeature ExtractionImage-to-ImageAutomatic Speech RecognitionImage SegmentationDepth EstimationText-to-SpeechAudio ClassificationKeypoint DetectionImage-Text-to-TextText-to-ImageTranslationZero-Shot Image Classification

Vendor

Runtime

Quantization

Format

Execution Backend

Model Size

≤959.5 MB

Average Memory

≤260 MB

Peak Memory

≤923 MB
    15 results

    BGE Base EN v1.5 INT8

    vivo X300

    An INT8-quantized BGE Base EN v1.5 English text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction191.8 MBExecuTorch

    BGE Base EN v1.5 INT8

    Raspberry Pi 5

    An INT8-quantized BGE Base EN v1.5 English text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction140.9 MBExecuTorch

    all-MiniLM-L6-v2 INT8

    vivo X300SME2

    An INT8-quantized sentence embedding model that maps text into 384-dimensional L2-normalized vectors for semantic similarity, retrieval, and feature extraction. It uses WordPiece tokenization with mean pooling and supports inputs up to 128 tokens, offering a compact, efficient representation while preserving high embedding fidelity.

    feature-extraction23.5 MBLiteRT

    MiniLM-L6-v2 INT8

    vivo X300

    An INT8-quantized MiniLM-L6-v2 sentence embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction36.9 MBExecuTorch

    Nomic Embed Text v1 INT8

    vivo X300

    An INT8-quantized Nomic Embed Text v1 text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction168.9 MBExecuTorch

    GTE Base INT8

    Raspberry Pi 5

    An INT8-quantized GTE Base text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction101.6 MBExecuTorch

    MiniLM-L6-v2 INT8

    Raspberry Pi 5

    An INT8-quantized MiniLM-L6-v2 sentence embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction36.9 MBExecuTorch

    E5 Base v2 INT8

    Raspberry Pi 5

    An INT8-quantized E5 Base v2 text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction140.9 MBExecuTorch

    nomic-embed-text-v1 INT8

    vivo X300SME2

    INT8-quantized BERT-based text embedding models that generate 768-dimensional L2-normalized sentence vectors for semantic search, retrieval, and similarity tasks. They support fixed-length tokenized text inputs and follow query/document prefix conventions, offering compact, efficient feature extraction while preserving strong semantic alignment with full-precision embeddings.

    feature-extraction139.7 MBLiteRT

    Nomic Embed Text v1 INT8

    Raspberry Pi 5

    An INT8-quantized Nomic Embed Text v1 text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction218.3 MBExecuTorch

    GTE Base INT4

    vivo X300

    An INT4-quantized GTE Base text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction101.6 MBExecuTorch

    EmbeddingGemma-300M INT8

    vivo X300SME2

    This is an INT8-quantized version of google/embeddinggemma-300m optimized for edge deployment on ARM devices using LiteRT with the XNNPACK backend. The model was quantized with post-training dynamic quantization (weights INT8 per-channel, activations FP32) and exported to the .tflite format for efficient inference on ARM Cortex-A processors (Android, AWS Graviton, embedded).

    feature-extraction317 MBLiteRT

    EmbeddingGemma 300M INT8

    vivo X300

    An INT8-quantized EmbeddingGemma 300M text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction959.5 MBExecuTorch

    E5 Base v2 INT8

    vivo X300

    An INT8-quantized E5 Base v2 text embedding model for semantic search, retrieval, and similarity tasks. Exported as an ExecuTorch program using the XNNPACK backend for inference on Arm CPUs.

    feature-extraction140.9 MBExecuTorch

    bge-base-en-v1.5 INT8

    vivo X300SME2

    A compact INT8-quantized English text embedding model for feature extraction, semantic search, retrieval, and similarity tasks. It uses a BERT-style encoder with mean pooling and L2 normalization to produce 768-dimensional sentence embeddings, supporting efficient cosine-similarity comparison with fixed 128-token inputs.

    feature-extraction111.2 MBLiteRT

    Develop on Arm with your AI coding assistant

    The Arm AI Portal MCP Server makes it faster to find optimized models, integrate code examples and deploy to your target device from your agentic coding assistant.

    User guide

    Run the following command in your terminal:

    codex mcp add arm-ai --url https://mcp.api.devplatform.arm.com/ai-portal