Hey again :D

This one was less about fixing bugs and more about actually building out the pipeline.

MemoryMap is now split into separate modules instead of everything being stuffed together. The project currently consists of:

frame_reader.py: receives and processes incoming video frames
detector.py: handles object detection
handler.py: coordinates detections and memory updates
store.py: persistent memory storage
object_record.py: object history tracking
merge.py: combines duplicate observations
main.py: starts and manages everything

The biggest addition this session was the detection pipeline itself.

Previously, I had the memory system working, but there wasn’t really a complete path from camera feed → object detection → stored memory. That’s now connected together. Frames arrive, detections are produced, records are updated, and the information is written into MemoryStore automatically.

I also started work on observation merging. One issue with object tracking is that the same object can appear multiple times across different frames, creating fragmented records. The merge layer now attempts to consolidate those observations into a single memory entry, making the stored data much cleaner and more useful when querying later.

Another thing I spent time on was restructuring the codebase. It doesn’t sound exciting, but getting clear separation between frame capture, detection, storage, and record management will make future work much easier. Debugging individual components is already significantly simpler.

The project is starting to look less like a prototype and more like an actual system!

Next steps are improving location accuracy, expanding object history tracking, and building the query layer so MemoryMap can start answering natural questions such as:

“Where did I leave my headphones?”

or

“When was the last time the wallet was seen?”

Still a lot to build, but the foundations are finally coming together.

More soon. 🚀