Arm and PyTorch: Accelerating AI from Cloud to Edge
The collaboration between Arm and Meta empowers AI developers to build and deploy high-performance, energy-efficient generative AI (GenAI) applications across cloud, mobile, and edge using PyTorch and ExecuTorch.
Arm at PyTorch Conference: Power Efficient AI Everywhere
Join us onsite to find out how Arm gives you the flexibility, performance, and efficiency you need across the AI lifecycle. Expect insightful talks, hands-on demos, and one-on-one workshops.
Fuel up ahead of the conference with an evening of food, drinks, and good conversation. Whether you’re looking to relax or network, you’ll be in good company with fellow PyTorch engineers and Arm experts.
Deploying LLMs at the Edge: Lessons from the Field
Parichay Das, Principal Architect at LTIMindtree and Arm Ambassador
Wednesday, October 22 | 3:20 pm – 3:50 pm PT
Learn about tools, workflows, and optimizations for deploying LLMs on mobile, and how to overcome challenges like limited memory and compute constraints.
Visit Us at Booth #P1
Workshops to Strengthen Your AI Product
In these one-on-one sessions, you’ll workshop features with design experts and, optionally, AI assistants to improve usability, ensure responsible development, and unlock more value for your users. You'll leave with a product better aligned with your goals and values—avoiding unintended issues before they arise.
These sessions are first come, first served, so register now to secure your spot.
Hands-on Demos
Stop by our booth to explore interactive demos, including training neural graphics models for real-time rendering, running speech recognition using a single framework for training and deployment, generating high-quality audio on mobile and running agentic AI workflows for enhancing everyday productivity.
Try the demos yourself and see power-efficient AI in action – all optimized for Arm hardware and PyTorch or ExecuTorch tools.
Pytorch Repositories and Developer Resources
Learning Path:
- Build and Scale AI With PyTorch on Arm Cloud
- Build an Android Chat App with Llama, KleidiAI, ExecuTorch, and XNNPACK
- Optimize MLOps with Arm-Hosted GitHub Runners
- Run Llama 3 on a Raspberry Pi 5 Using ExecuTorch
- Accelerate Natural Language Processing (NLP) Models from Hugging Face on Arm Servers
- Create and Train a PyTorch Model for Digit Classification
- Use Keras Core with TensorFlow, PyTorch, and JAX Backends
Videos:
- How the Arm ExecuTorch Collaboration Leads to Faster GenAI at the Edge
- How Arm and Meta are Transforming AI Software Development
- AI Performance Boost with KleidiAI and PyTorch on AWS Graviton 4 Demo | PyTorch Conference 2024
- Edge AI Acceleration with KleidiAI and ExecuTorch Demo | PyTorch Conference 2024
- Generative AI Inference with AWS Graviton Processors | AWS AI Infrastructure Day 2024 on AWS OnAir
- Bringing PyTorch Models to Cortex-M | Arm AI Tech Talk
Links to Pytorch and Arm Projects:
Code-Alongs and Webinars:
- Run Llama With PyTorch on Arm-Based Infrastructure
- Accelerating LLM Family of Models on Arm Neoverse Based Graviton AWS Processors with KleidiAI
Blogs and Briefs:
- ExecuTorch Beta: On-Device AI and LLMs, Stability, and Acceleration with Partners
- Arm Joins the PyTorch Foundation as a Premier Member
- Arm Accelerates AI From Cloud to Edge with New PyTorch and ExecuTorch Integrations to Deliver Immediate Performance Improvements for Developers
- PyTorch Grows as the Dominant Open Source Framework for AI and ML: 2024 Year in Review
- Accelerating Generative AI at the Edge on Arm with ExecuTorch Beta Release
- Unleashing the Power of AI on Mobile: LLM Inference for Llama 3.2 Quantized Models with ExecuTorch and KleidiAI
- Accelerated PyTorch Inference with torch.compile on AWS Graviton Processors
- Streamlining MLOps on Arm
- IoT Software Development with GitHub Partnership
- Run Llama3-8b on a Raspberry Pi 5 with ExecuTorch
- Getting Started with PyTorch, ExecuTorch, and Ethos-U85 in Three Easy Steps
Accelerate Your Projects with the Arm Developer Community
The Arm Developer Program connects a global community of developers with expert insights, cutting-edge tools, and exclusive resources. Join to explore the latest trends, get early access to software and demos, attend expert-led sessions, and collaborate with peers solving real-world challenges.
