I created a daily challenge for Prompt Engineers to build the shortest prompt to break a system prompt.
You are provided the system prompt and a forbidden method the LLM was told not to invoke. Your task is to trick the model into calling the function. Shortest successful attempts will show up in the leaderboard.
Give it a shot! You never know what could break an LLM.
Comments URL: https://news.ycombinator.com/item?id=43814080
Points: 43
# Comments: 25
Login to add comment
Other posts in this group
tldr; skip to the --------
Last time I "Asked HN", I was in a very different place. Fresh out of a bootcamp, right at the peak, and subsequent collapse of the Covid hiring. It didn't go well. Ho
Article URL: https://github.com/SureScaleAI/cleverbee
Comments URL: https://ne
Article URL: https://mariozechner.at/posts/2025-04-20-boxie/
Article URL: https://news.lehigh.edu/new-material-gives-copper-superalloy-like-strength-0
Comments
