Meta is now testing a Meta virtual try-on feature for furniture on Facebook Marketplace, enabling users to visualise how items would look in their own home. This new functionality relies on Meta’s evolving “Segment Anything” (SAM) process, a system capable of identifying specific objects within a frame and using that understanding to recreate them in realistic 3D a powerful move to bridge the gap between online browsing and real-world spatial awareness.

The heart of this innovation is SAM 3D, the latest model in Meta’s SAM collection, which powers the “View in Room” option now being tested with selected users. Unlike simpler AR tools that place flat images into a scene, SAM 3D can dynamically simulate object placement, scaling, and orientation, allowing a chair, table, or decorative piece to be visualized more realistically in your actual space.

Of course, this is still early days. According to Meta, there are limitations: the system doesn’t always have full access to the spatial dimensions of every object, and accurately mapping real-world environments remains a significant technical hurdle. However, the ambition is clear: if Meta pulls this off, sellers on Marketplace will be able to offer far more immersive and practical previews, and buyers will make more confident decisions, possibly reducing returns and boosting satisfaction.

The long-term implications could be even more significant. As Meta refines its SAM system, this technology could expand beyond furniture into a wide array of product categories. Eventually, Meta may leverage these models for both augmented reality (AR) and virtual reality (VR) experiences, turning the Marketplace into a launchpad for next-generation commerce. (Social Media Today)

For business users, especially small retailers or second-hand sellers on Marketplace, this presents a real opportunity. By offering AR-enabled listings, sellers can differentiate their listings, giving buyers added confidence, particularly for bulky or visually complex items. For Meta, the testing signals a bold vision for the future of shopping: one where 3D object recognition and immersive experiences are integrated into everyday social commerce.

In conclusion, Meta’s virtual try-on test for furniture is a strategic move that could reshape how we shop on Marketplace. While restricted to selected users for now, the “View in Room” feature powered by SAM 3D shows real promise. If rolled out widely, it could offer both buyers and sellers a more immersive, confident way to transact, helping Meta become not just a social platform but a more powerful e-commerce destination.