A robot may have a floorplan, yet still need a huge prepared database before it can tell where it is. FreeLoc asks a simpler question: can the robot query the map directly, as it moves?
Floorplans provide compact and widely available geometric maps for indoor localization, but existing high-performing floorplan-based methods still convert them into dense scene-specific offline databases, tying accuracy, storage, and runtime to the sampling resolution of the discretized pose space. We present FreeLoc, an online RGB-based floorplan localization framework that treats the floorplan as a directly queryable geometric map. FreeLoc introduces an efficient online geometric querying and diffusion-aided refinement scheme, which retrieves plausible pose anchors through on-the-fly floorplan ray querying and refines them into accurate continuous pose estimates. For sequential localization, FreeLoc develops an online likelihood construction strategy that bridges single-frame localization and probabilistic temporal fusion by constructing likelihoods from coarse-sampled candidates and refined pose hypotheses, enabling histogram-filter-based temporal fusion without offline databases. Experiments demonstrate real-time online inference and state-of-the-art performance in both single-frame and sequential localization, while real-world results validate practical deployability in indoor robotic localization scenarios.
Transcript
A robot may have a floorplan, yet still need a huge prepared database before it can tell where it is. FreeLoc asks a simpler question: can the robot query the map directly, as it moves? The practical challenge is this: given only a floorplan, a robot should be able to query it online and achieve accurate camera-based localization in new environments, without constructing a scene-specific offline database.
That matters because the robot would not need a prepared map database for every new place before it could begin locating itself. FreeLoc treats the floorplan as a directly queryable geometric map rather than a scene-specific offline retrieval database. Think of it like asking a paper map for directions at the moment you need them, instead of photographing every possible route in advance and storing all those photographs.
FreeLoc first retrieves a compact set of plausible pose anchors by querying geometric rays from the floorplan on the fly. These anchors are rough possibilities for where the camera might be, rather than a dense list of every possible position. To refine these approximate anchors, FreeLoc estimates residual pose corrections from the discrepancy between image-side and floorplan-side ray observations.
Instead of relying on one-shot deterministic regression, pose refinement becomes an iterative denoising process that progressively corrects imperfect coarse anchors under geometric guidance. This lets FreeLoc move beyond the resolution of coarse online samples and produce accurate pose hypotheses in continuous pose space, without exhaustive dense sampling or precomputed scene-specific ray databases.
For sequential localization, FreeLoc integrates this online coarse-to-fine estimator into a probabilistic filtering pipeline. Rather than deriving dense observation likelihoods from an offline ray database, FreeLoc constructs them online from coarse-sampled candidates and refines their high-confidence regions using refined pose hypotheses.
This online construction bridges single-frame localization and temporal fusion without reintroducing a scene-specific database. On both tested indoor settings, FreeLoc consistently outperforms all compared methods. Compared with the strongest comparison method, it improves all recall measures by four point seven to eight point seven percentage points in one setting and one point four to eight point nine in the other.
For sequential localization, FreeLoc achieves the best success rate and overall tracking accuracy. Compared with the strongest comparison method, it improves the success rate by thirteen point five percentage points and reduces overall tracking error by eighty-two point eight percent, showing substantially more robust tracking over long trajectories.
A handheld phone can begin with almost no certainty about where it is inside a large building, then gradually narrow that uncertainty as it moves. Here, its estimated route comes together with the known route, supporting the system’s use in real indoor spaces.
The unified coarse-to-fine framework substantially reduces overall localization cost by eliminating the time-consuming scene-specific preprocessing stage. That means a new building can be approached without first spending time preparing a separate database for it.
FreeLoc treats the floorplan as a directly queryable geometric map rather than a dense scene-specific offline database, combining on-the-fly querying with pose refinement to turn plausible anchors into accurate continuous pose estimates. Experiments demonstrate accurate and efficient localization, as well as immediate deployability in new environments.
FreeLoc turns a floorplan into a map the robot can question on the spot, then sharpens rough guesses into continuous positions. That makes accurate indoor tracking more practical in unfamiliar buildings.
A derivative work by Paperi · AI-generated script, voice and captions
· pages and figures unaltered
Made with Paperi.
Drop in a research PDF — get a narrated video walkthrough like this one,
with highlights that follow the narration. Free to start.
An AI can remember something about you perfectly and still bring it up at exactly the wrong moment. The real challenge is not remembering more, it is knowing when a memory belongs in the conversation.An AI companion can remember something perfectly and still use it badly. This paper asks the harder question: before bringing up a memory, should the system decide whether that memory belongs in this moment at all?
An AI can write an entire interactive world, yet a judge may give credit to a forest, storm, or animal that never appears, and miss one that is really there. The problem is not making the world; it is knowing what exists.An AI can generate an entire interactive voxel world, but judging that world is surprisingly difficult: the code may promise features no camera ever sees, while a screenshot may show features the code never clearly names.
Imagine changing the camera angle in a video and having the sound change with it. That only works if every voice and sound exists on its own track, and this system creates those tracks as the scene is made.Most audio-video generators give you one soundtrack, not the individual sounds inside it. SepGen changes that: one model can generate a scene and hand back a separate waveform for every captioned source.