
Florian Tramèr
Florian Tramèr is a professor at ETH Zurich, specializing in the security of artificial intelligence systems. His research focuses on the vulnerabilities of AI agents, particularly the risks associated with 'prompt injection' attacks, where malicious commands are hidden within data inputs. Tramèr argues that the mixing of commands and data in AI systems poses significant security challenges, highlighting the need for stricter separation to prevent unauthorized actions. He is also a scientific advisor for Invariant Labs, a startup dedicated to addressing AI security issues, and has discussed the implications of AI manipulation within academic contexts, recently gaining attention for his insights into hidden messages in research papers aimed at influencing AI evaluations.
Country presence
Recent news mentions
Florian Tramer, an assistant professor at ETH Zurich who researches machine-learning security, compared the process to human learning.
What is AI model distillation and why is it becoming a US-China flashpoint? AI模型蒸餾是什麼?為何成為美中科技角力新戰場?Florian Tramèr researches the safety of artificial intelligence at ETH Zurich.
Ist das das Ende für Open AI und Anthropic?Florian Tramèr, a professor at ETH Zurich, discusses the fundamental security problems of AI systems.
Wie das Hacking von KI-Agenten funktioniert
