MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenization
Yiwen Chen, Yikai Wang, Yihao Luo, Zhengyi Wang, Zilong Chen, Jun Zhu, Chi Zhang, Guosheng Lin
2024-08-06

Summary
This paper introduces MeshAnything V2, a new model that generates high-quality 3D meshes based on given shapes. It uses a novel method called Adjacent Mesh Tokenization (AMT) to improve the efficiency and performance of mesh generation.
What's the problem?
Creating detailed 3D meshes can be complicated and resource-intensive. Traditional methods often require a lot of data to represent each part of a mesh, which can slow down the process and make it less efficient. This can be a problem for artists and developers who need to generate 3D models quickly and effectively.
What's the solution?
MeshAnything V2 uses AMT, which simplifies the way meshes are represented by using fewer tokens (data points) to describe the same mesh. Instead of using three points (vertices) to define each face of the mesh, AMT uses just one point whenever possible. This reduces the amount of data needed by about half, making the process faster and more efficient. The new model can create high-quality meshes that are well-structured and easier to work with in various applications.
Why it matters?
This research is important because it allows for faster and more efficient creation of 3D models, which can be used in video games, animations, virtual reality, and other fields. By improving how meshes are generated, MeshAnything V2 helps artists and developers produce high-quality work more easily, ultimately enhancing creativity and productivity in the 3D industry.
Abstract
We introduce MeshAnything V2, an autoregressive transformer that generates Artist-Created Meshes (AM) aligned to given shapes. It can be integrated with various 3D asset production pipelines to achieve high-quality, highly controllable AM generation. MeshAnything V2 surpasses previous methods in both efficiency and performance using models of the same size. These improvements are due to our newly proposed mesh tokenization method: Adjacent Mesh Tokenization (AMT). Different from previous methods that represent each face with three vertices, AMT uses a single vertex whenever possible. Compared to previous methods, AMT requires about half the token sequence length to represent the same mesh in average. Furthermore, the token sequences from AMT are more compact and well-structured, fundamentally benefiting AM generation. Our extensive experiments show that AMT significantly improves the efficiency and performance of AM generation. Project Page: https://buaacyw.github.io/meshanything-v2/