Efficient Knowledge Probing of Large Language Models by Adapting Pre-trained Embeddings

Aug 8, 2025·
Kartik Sharma
Yiqiao Jin
Yiqiao Jin
,
Rakshit Trivedi
,
Srijan Kumar
· 1 min read
Abstract
Probing what a large language model knows is essential for safe deployment, but exhaustive probing is prohibitively expensive. We propose an efficient knowledge probing approach that adapts pre-trained embeddings to query LLM knowledge with substantially reduced compute, while preserving the fidelity of standard probing protocols.
Type
Publication
arXiv preprint arXiv:2508.06030

Abstract

Probing what a large language model knows is essential for safe deployment, but exhaustive probing is prohibitively expensive. We propose an efficient knowledge probing approach that adapts pre-trained embeddings to query LLM knowledge with substantially reduced compute, while preserving the fidelity of standard probing protocols.

Yiqiao Jin
Authors
Final-year Ph.D. Candidate in Computer Science
My research sits at the intersection of multimodal foundation models, intelligent agents, and spatial/physical intelligence. I build general-purpose models that perceive, reason, learn, and act in interactive virtual and physical environments.