System prompt exposure: how AI image generators may leak sensitive instructions

by harisecon 11/12/2024, 1:03 PMwith 1 comments

by harisecon 11/12/2024, 1:03 PM

Recraft’s image generation service could leak its internal system prompts due to its unique architecture combining Claude (an AI language model) with a diffusion model. Unlike other image generators, Recraft could perform calculations and answer questions, which led to the discovery that carefully crafted prompts could expose the system’s internal instructions.