Efficient Knowledge Probing of Large Language Models by Adapting Pre-trained Embeddings

Aug 8, 2025·
Kartik Sharma
Yiqiao Jin
Yiqiao Jin
,
Rakshit Trivedi
,
Srijan Kumar
· 1 min read
Abstract
Probing what a large language model knows is essential for safe deployment, but exhaustive probing is prohibitively expensive. We propose an efficient knowledge probing approach that adapts pre-trained embeddings to query LLM knowledge with substantially reduced compute, while preserving the fidelity of standard probing protocols.
Type
Publication
arXiv preprint arXiv:2508.06030

Abstract

Probing what a large language model knows is essential for safe deployment, but exhaustive probing is prohibitively expensive. We propose an efficient knowledge probing approach that adapts pre-trained embeddings to query LLM knowledge with substantially reduced compute, while preserving the fidelity of standard probing protocols.

Yiqiao Jin
Authors
Ph.D. Candidate in Computer Science
My research sits at the intersection of multimodal foundation models, intelligent agents, and spatial/physical intelligence. I build general-purpose models that perceive, reason, learn, and act in interactive virtual and physical environments.