Your "Secret" System Prompt Isn't Secret: How Anyone Can Extract It With the Right Questions
Your “Secret” System Prompt Isn’t Secret: How Anyone Can Extract It With the Right Questions TL;DR A Reddit post in r/artificial sparked significant discussion after a team shared their firsthand experience discovering that their supposedly private system prompt could be extracted by users asking the right questions. The post scored 102 upvotes and generated 95 comments, signaling this is a widespread concern in the AI developer community. If you’ve deployed a custom AI assistant or chatbot with a hidden system prompt, this vulnerability almost certainly affects you. The uncomfortable truth: most current LLMs are not designed to keep system prompts truly secret, and treating them as sensitive credentials is a mistake many teams are making right now. ...