EasyAR Sense now supports image recognition and tracking on Meta Quest 3 and Meta Quest 3S. Developers can identify real-world images and associate them with 3D models, animations, videos, and interactive information, turning posters, artworks, cards, packaging, and flat graphics on merchandise into entry points for mixed reality content.

The Meta XR extension for EasyAR Sense Unity Plugin enables developers to build image-based Quest MR applications in Unity, connecting existing printed materials with digital content and expanding how users view and interact with that content through a headset.

Recognize Images and Keep Virtual Content Aligned

Image recognition identifies a configured target image. Image tracking continuously updates its position and orientation so that associated virtual content can remain aligned with the physical image.

As users move or rotate an image, or view it from another angle, applications can update the content using the tracking results. This provides a foundation for intuitive MR experiences, such as 3D explanations on exhibition panels, animated models on learning cards, or instructions associated with product packaging.

Image tracking example: Virtual content is associated with a physical image and follows changes in its position and orientation.

Recognize and Track Multiple Images Simultaneously

EasyAR Sense supports simultaneous recognition and tracking of multiple images. Each target can have its own virtual content, with different content presented together in the same MR view.

Developers can create experiences in which several image targets participate at once. Learning cards can present different models, products can display individual information, and exhibition panels can form a connected set of interactive content. Application menus, animations, and interaction logic can give users further ways to explore that content.

Multi-image example: Different targets present their associated virtual content within the same view.

Extend Recognition to 100,000 Images with EasyAR CRS

For applications with large image collections, EasyAR Sense can be combined with EasyAR CRS (Cloud Recognition Service) to recognize targets from a cloud-based library.

Each EasyAR CRS cloud library supports up to 100,000 target images. Developers configure their targets in CRS, and the application uses cloud matching to identify them. EasyAR Sense can then provide image tracking and content presentation on the device.

This combination suits applications built around product catalogs, publication series, exhibition materials, and marketing content. CRS handles target identification across the large library, while Sense provides continuous tracking after recognition. Explore EasyAR CRS

New MR Possibilities for Exhibitions, Education, and Retail

Wall-mounted art exhibitions: Image targets can extend beyond handheld cards to large paintings on gallery walls. Associate an artwork with 3D content so its bridges, buildings, and scenery extend into MR, giving visitors more ways to explore the work from different angles.

Concept illustration: Recognize wall-mounted artworks and extend their painted scenes into 3D.

Original comic art and scene recreation: Use original comic artwork as an image target, connecting its characters, cityscapes, and story settings to digital content. Visitors can appreciate the original drawing while exploring content that extends beyond its printed panels.

Concept illustration: Use original comic artwork as an image target to recreate its characters and scenes in MR.

Museum exhibitions: Associate display panels or information cards with 3D explanations. Printed materials can present digital models of architecture or artifacts, helping visitors examine and understand exhibition content from different angles.

Concept illustration: Recognize exhibition images and bring their stories into 3D.

Education and training: Use learning cards, textbook illustrations, or instruction panels to present models, animations, and step-by-step guidance.

Concept illustration: Turn learning cards into 3D models for more intuitive explanations.

Retail and product experiences: Connect packaging and brochures to product models, feature explanations, or usage instructions that users can explore.

Concept illustration: Connect product images to 3D explanations of design and functionality.

Brand experiences and entertainment: Use posters, cards, and promotional materials as entry points for characters, animations, and interactive MR experiences.

Bring Fridge Magnets, Merchandise, and Toy Graphics into MR

Everyday objects can also carry image targets. Fridge magnets, illustrated badges, thin charms, and acrylic standees with relatively flat graphic surfaces can use their clear front-facing artwork as configured targets. Applications can display virtual characters, animations, or information alongside the physical item, updating the content's position and orientation from the image tracking results as the item moves or rotates.

Concept illustration: A fridge magnet's printed graphic acts as an image target, connecting physical merchandise to an interactive virtual character.

For designer toys and other collectibles, developers can use collector cards, packaging images, graphics printed on display bases, or relatively flat, visible decorative graphics on the toy itself. These targets can connect character actions, interactive content, and backstories to the physical collectible. Acrylic standees and illustrated bases can also participate in multi-image experiences, with each item presenting its own digital content.

Concept illustration: Image targets on a standee or display base extend toys and collectibles with character interaction and digital content.

In these applications, EasyAR Sense recognizes and tracks the image target on the item, linking virtual content to the physical merchandise through its graphic. Developers can follow the image target preparation guidelines, choose clear artwork with distinctive details, and validate the experience with the intended materials, lighting, and viewing angles.

Start Building Image-Based MR on Quest

Developers can use EasyAR Sense Unity Plugin, configure the Meta XR extension according to the documentation, prepare image targets, and associate them with digital content. Projects that need a large target library can add EasyAR CRS, combine cloud recognition with on-device tracking, and validate the application on Quest 3 / 3S.

EasyAR Sense gives Quest developers new ways to connect physical printed images with mixed reality content that users can view and interact with.

Explore EasyAR Sense · Explore EasyAR CRS · Browse the developer documentation

EasyAR Team