rag-document-qa
- Answers only from a chosen document set
- Cites the chunk behind every sentence
- Picks up new uploads without a restart
The pane on the left is not a video. An agent is reading that canvas pixel by pixel and tapping what it finds, using the detection loop from my Piano Tiles bot unchanged. It is the same approach I run in production against Rush Royale, League of Legends and Tibia, unattended, for hours.
The other half of the work is language. I build retrieval-augmented generation pipelines with LangChain and FAISS that answer from a chosen corpus and cite the chunk behind every sentence, fine-tune open-weight models with LoRA, and have written a Devanagari tokeniser and a decoder-only transformer from scratch. Then I put the result behind a FastAPI endpoint so somebody can actually use it.
A year and a half into the work, mostly computer vision and NLP. At Sandbox I own detection models in production and the retraining that keeps them honest when a game patch moves the interface out from under them.
Backpropagation written out longhand, no library, separating two interleaved moons. Train it past each threshold to open what follows.
Sandbox Pvt. Ltd., Pokhara. Built real-time computer-vision systems that read on-screen state in live game clients such as Rush Royale, League of Legends, and Tibia, training OpenCV and PyTorch detection models and retraining them when UI updates broke detection — letting runs go unattended for 8+ hours and replacing roughly 6 hours of manual play per client each day.
Built an internal RAG assistant over game specs and internal docs that returns cited answers in seconds, cutting the time the team spent searching documentation by around 60%.
Built a multi-agent system where separate LLM agents plan and carry out steps with tool-calling, running multi-step jobs end to end and cutting the manual steps per job by about 70%.
Association of Computer Engineering Students. Organised TechFest 6.0: hackathons, competitive programming and datathon events. Vice coordinator on the hackathon track, working with teams from across Nepal.
Open to machine learning and computer vision roles, remote or in the Kathmandu valley.