Table of Contents

Object tracking with EasyAR Mega

EasyAR Mega's core capability lies not only in locating entire physical spaces, but also in applying high-precision 3D tracking to specific, known physical objects. This allows you to precisely track a preset object (such as industrial equipment, an exhibit, or a retail product) using the exact same development approach as Mega, and overlay rich virtual content onto it.

Basic principles and workflow

The principle of Mega object tracking is similar to that of Mega large-scale spatial applications. It combines the object's own visual features with advanced cloud-based localization algorithms, achieving more stable and precise results than traditional object tracking.

Mega object tracking can be viewed as a special case of Mega spatial localization applied to specific object targets. The localization process is identical, with only minor differences in the mapping side due to the specific nature of the object.

Workflow as follows:

  1. Map construction:

    • Use a smartphone with good SLAM capabilities and the dedicated Mega Toolbox App to collect data around the target object. Data Capture
    • Upload the collected *.EMP data via the EasyAR mapping management backend.
    • The cloud processing platform will process the collected data, using advanced AI algorithms to extract visual features of the target object, generating a 3D point cloud and building a dense mesh with texture mapping.
    • The final output of the mapping system will also exist in the form of a "Mega Block map".
  2. Real-time tracking:

    • When a user device scans the target object, it first utilizes the Mega localization function for real-time positioning to recover the device's current pose.
    • It then fuses this with the device's own SLAM system, aligning the coordinate system of the Mega map with the coordinate system of the device's SLAM system, thereby achieving continuous real-time tracking.
Tip

Reference reading: Principles of Mega spatial localization.

Differences and comparison with Mega spatial localization

Compared to Mega spatial localization, Mega object tracking is technically consistent, but its focus and application scenarios differ:

Feature Mega spatial localization Mega object tracking
Core purpose Enables user navigation in macro environments, spatial anchoring of virtual content Enables digitization of specific objects, information overlay, virtual-real interaction
Spatial computation Localizes via Mega cloud localization service and fuses for tracking on the device Identical to Mega spatial localization
Application scenarios Indoor/outdoor navigation, large-scale AR games, city-level digital twins Industrial equipment inspection, exhibit guide, retail product AR trial

Differences and comparison with EasyAR Sense 3D object tracking

EasyAR Sense also provides powerful 3D Object Tracking functionality, but Mega object tracking differs significantly from it in design philosophy and application scenarios:

Feature 3D Object Tracking Mega object tracking
Localization basis Relies on standard format 3D models, which can come from 3D scanners, 3D reconstruction software, etc. Relies on pre-built Mega spatial maps, generated from phone-collected data processed in the cloud
Tracking stability Good, may be lost during fast movement or partial occlusion Stronger occlusion resistance and interference immunity, more stable tracking
Object requirements Object itself needs rich texture, simple geometric structure Lower requirement for object texture richness, can handle more complex geometric structures
Environment requirements No environment requirements, target object can be in any environment Target object environment can differ from mapping collection time, but the environment cannot be arbitrarily changed during functional use
Internet requirement No internet needed, all data and computation occur on-device Internet required, obtains computation results via Mega cloud localization service
Dynamism Supported. The target object can move within the environment during functional use Not supported. The target object must remain stationary during functional use
Scalability Can support tracking multiple target objects simultaneously; objects are mutually independent Can track multiple objects within the same space; these objects must remain stationary within the space; objects are not mutually independent
Suitable scenarios Objects with simple structure and rich texture, which need to be moved flexibly during the experience (e.g., handled in hand) Objects with complex structure and average texture, which are relatively fixed within the space during the experience (e.g., inspection of factory equipment, museum exhibit guide)

How to choose:

  • If your application scenario involves recognizing an independent, movable object and does not care about its position in the macro environment, EasyAR Sense 3D Object Tracking is a lighter-weight, more direct choice.
  • If your application scenario involves high-precision, high-stability tracking and digitization of one or more fixed objects within a fixed space (e.g., factory, museum, mall), EasyAR Mega object tracking is the optimal choice.