Publications

2026

1. ECCV

   

   LangLoc: “Tell Me What You See”

   Shaurya Kishore Panwar, Roham Zendehdel Nobari, Shirley Feng Yi Lau, Abu Bakr Rahman Shaik, Manuel Günther, Marc Pollefeys, and Daniel Barath

   In European Conference on Computer Vision (ECCV) , 2026

   ABS PDF Website Bibtex

   We tackle fine-grained indoor localization from natural language: given a free-form description of one’s surroundings, estimate the observer’s 2D position and heading within a known 3D environment. Language queries are lightweight, privacy-preserving, and need no camera - yet prior work stops at coarse scene retrieval and cannot resolve an intra-scene pose. We close this gap with LangLoc, a three-stage pipeline that (i) retrieves the correct scene via a dual-branch GATv2 encoder with CLIP semantic features, surpassing the previous best by 8 percentage points in Top-1 recall; (ii) estimates position and heading by scoring a dense floor grid through ray-cast object visibility, reaching a median error of 0.95 m; and (iii) resolves residual ambiguity through a Bayesian dialog module that asks targeted yes/no questions and updates a pose posterior until the location is pinpointed. To support this task we contribute a benchmark of 13,000+ pose-indexed natural-language descriptions over 1,300+ indoor 3D scans.

   @inproceedings{panwar2026langloc,
     title = {LangLoc: ``Tell Me What You See''},
     author = {Panwar, Shaurya Kishore and Nobari, Roham Zendehdel and Lau, Shirley Feng Yi and Shaik, Abu Bakr Rahman and G{\"u}nther, Manuel and Pollefeys, Marc and Barath, Daniel},
     booktitle = {European Conference on Computer Vision (ECCV)},
     year = {2026},
     doi = {10.48550/arXiv.2607.05077},
   }