Brazilian lawyers busted for attempting to manipulate court’s AI with prompt injection hidden in filing

Brazilian lawyers busted for attempting to manipulate court's AI with prompt injection hidden in filing

Jowi Morales Social Links Navigation Contributing Writer Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics.

rooyar It is crazy that AI is being hijacked, as all platforms use it and make it more dangerous. Reply

bill001g I think I am just as concerned that court itself is using AI. Now the secret is out. I can guarantee college students do this since they know their papers are read by AI. How many people are doing this on job applications that are all AI read. Just tell the AI to give you the job with hidden prompts. Reply

bit_user Wow, this sort of thing really should be grounds for getting disbarred. It sounds like that could still happen. Whether or not you think courts should be using AI to help automate & streamline their workflows, an effort to maliciously manipulate such systems is a blatant attempt at circumventing justice and the legal system itself. Reply

derekullo bit_user said: Wow, this sort of thing really should be grounds for getting disbarred. It sounds like that could still happen. Whether or not you think courts should be using AI to help automate & streamline their workflows, an effort to maliciously manipulate such systems is a blatant attempt at circumventing justice and the legal system itself. It was obviously wrong for him to do so, but I do think this needs to be tested more regularly to make sure prompt injection isn't influencing cases … if they must use AI to review cases. Just because they found a 12 point white font prompt injection doesn't mean a 1 point white font prompt injection couldn't slip through if they are requiring a person to catch the injection. Reply

husker derekullo said: Just because they found a 12 point white font prompt injection doesn't mean a 1 point white font prompt injection couldn't slip through if they are requiring a person to catch the injection. 1 point? I guess that would mean they wrote the prompt in morse code. Actually, I believe the A.I. would immediately recognize that as easily as plain text and a better way to hide it. If discovered it might be dismissed as some kind of decoration or separator. Reply

derekullo husker said: 1 point? I guess that would mean they wrote the prompt in morse code. Actually, I believe the A.I. would immediately recognize that as easily as plain text and a better way to hide it. If discovered it might be dismissed as some kind of decoration or separator. Word accepts a 1 point font … it is incredibly tiny but you can make out the text if you zoom in. This was directed at a human catching the prompt injection … not a computer/other AI. https://courses.lumenlearning.com/wm-compapp/chapter/fonts/The font size is a number that indicates how many points are in the height of the text, or high tall the text is in points. A point is 1/72 of an inch, so a 12-point font would be 12/72 of an inch. Most people are comfortable reading 10-point fonts or higher, so a 10- or 12-point font is a good choice for writing a paragraph of text. Reply

bit_user derekullo said: The font size is a number that indicates how many points are in the height of the text, or high tall the text is in points. A point is 1/72 of an inch, Thanks for the reminder! I always had a sense it was something like that, but not sure if I knew the specifics. After this incident, I've got to say there's something sort of elegant about the IETF's use of ASCII text for their RFCs. You can even hide hidden payloads in Unicode plain text, but not ASCII! https://en.wikipedia.org/wiki/Request_for_Comments Reply

Key considerations

  • Investor positioning can change fast
  • Volatility remains possible near catalysts
  • Macro rates and liquidity can dominate flows

Reference reading

More on this site

Informational only. No financial advice. Do your own research.

Leave a Comment