Visit the Advantech Global website, or choose your country or region below.

America Region

Europe Region

Asia Pacific

Africa & Middle East

MyAdvantech Registration

MyAdvantech is a personalized portal for Advantech customers. By becoming an Advantech member, you can receive latest product news, webinar invitations and special eStore offers.

Sign up today to get 24/7 quick access to your account information.

Panel Button

Advantech Launches MIC-733-AO Edge Generative AI System to Significantly Accelerate Generative AI Development

20-03-2024

Advantech, a leading industrial edge AI solution provider, is thrilled to announce the successful Generative AI demo with Advantech's MIC-733-AO, based on NVIDIA® Jetson AGX Orin™. This showcases AI developers how to benefit from greater immediacy, enhanced security, and reduced internet costs compared to cloud-based generative AI. The Generative AI models from the Jetson AI lab offers a free foundational AI model, enabling customization and significantly reducing development time with the MIC-733-AO Edge Generative AI System.

Generative AI on MIC-733-AO

Advantech's MIC-733-AO Edge Generative AI System, compatible with the NVIDIA Generative AI models from the Jetson AI lab, now efficiently runs large language models (LLMs), vision language model (VLM), vision transformers (ViT), and image generation and Llamaspeak at the edge, thanks to its NVIDIA® Jetson AGX Orin™. The platform's unique offerings span multiple layers, including accelerated computing, vital AI software, and pre-trained models, facilitating the creation, customization, and deployment of generative AI models suitable for various applications and locations.

With Generative AI models from the Jetson AI lab, developers can leverage the retrieval-augmented generation (RAG) technique, connecting LLMs and VLMs to a company’s knowledge base. This approach eliminates the need for traditional AI model training, allowing simple conversational interactions with the system to yield AI inferences, significantly shortening development time.

The Advantech MIC-733-AO boasts high AI performance and multiple video interfaces, such as IP camera, USB/gigE industrial cameras, GMSL cameras, LiDAR, and more, enabling edge-based Generative AI model operation. Its exceptional thermal design prevents hot crashes, even when the NVIDIA® Jetson AGX Orin™ operates at full capacity.

Generative AI at the Edge for High Responsiveness Application

Generative AI is revolutionizing human-computer interaction by creating new content from various inputs and outputs, such as text and images. The shift in demand from the cloud to the edge positions GenAI as ideal for high-responsiveness and low-latency environments.

Edge-based Generative AI offers several advantages over cloud-based solutions:

Immediate Response

Edge computing systems, integrating data sources like cameras and sensors, enable prompt GenAI responses without the delays associated with cloud uploads.

Information Security

Data remains within the edge system, avoiding the cybersecurity risks associated with cloud data transmission.

Stable Network Connection

Operable without a wireless network, the edge system stores data locally until network restoration, unlike cloud-based AI, which ceases function without a network.

Low Transmission Costs

Edge AI incurs no transmission costs if backend communication is unnecessary, needing only low-bandwidth transmission, more cost-effective than the higher bandwidth costs of cloud uploads.

Generative AI at the edge represents the future of the AI era. The MIC-733-AO Edge Generative AI System, integrated with the NVIDIA Generative AI models from the Jetson AI lab, offers a straightforward solution for AI developers and is now available on the market. We invite you to participate GTC 2024 in Advantech booth (booth number: 232) to see the real GenAI demo, or you can register here for MIC-733-AO Live LLaVA Demo Application Note and start building your edge-based generative AI applications today.