Jailbreaks against multimodal large language models (MLLMs) typically operate through image-text inputs. After each target response, the attacker must decide how the new feedback should shape the next image-text query: which clues should be stated in the text, which should appear as visual evidence, and how the text should refer to the image.Existing multimodal attacks typically rely on fixed image-text pairs or candidate search, limiting their ability to adapt across turns.Text-only multi-turn attacks can adapt to prior responses, but they do not decide how response-derived clues should be expressed across image and text.In this paper, we formulate this missing step as trace-to-query realization and propose  ̲Memory- ̲Augmented  ̲Visual  ̲Querying (MAViQ), a black-box framework that converts response-derived clues into visual and textual constraints, refines the query after observing the generated image, and propagates feedback to subsequent turns.Extensive experiments on two benchmarks across six target MLLMs show that MAViQ achieves average attack success rates (ASRs) of 70.60% on MM-SafetyBench and 82.13% on JailbreakV-mini, outperforming the strongest baseline by 5.90% and 8.32%, respectively. Our code is available at https://github.com/jixingtian/Maviq.