MAC-Ego3D: Multi-Agent Gaussian Consensus for Real-Time Collaborative Ego-Motion and Photorealistic 3D Reconstruction

Xiaohao Xu*, Feng Xue*, Shibo Zhao, Yike Pan, Sebastian Scherer, Xiaonan Huang

University of Michigan, Ann Arbor & Carnegie Mellon University

The full code will be released in 2025 Feb. Please stay tuned! 😃

❤️ Video Demo ⭐ ArXiv Paper

Pipeline: Multi-Agent Gaussian Consensus 🙌

MAC-Ego3D leverages parallel Intra-Agent Gaussian Consensus and periodic Inter-Agent Gaussian Consensus to enable real-time pose tracking and photorealistic 3D reconstruction using a shared 3D Gaussian map representation.

Citation

Please cite our paper if you find this repo useful! 💛 💙 💛 💙

@article{xu2024macego3d,
  title={MAC-Ego3D: Multi-Agent Gaussian Consensus for Real-Time Collaborative Ego-Motion and Photorealistic 3D Reconstruction},
  author={Xu, Xiaohao and Xue, Feng and Zhao, Shibo and Pan, Yike and Scherer, Sebastian and Huang, Xiaonan},
  journal={arXiv preprint arXiv:2412.09723},
  year={2024}
}

Contact

Please feel free to contact Xiaohao Xu (xiaohaox@umich.edu) for questions or discussions.