Doctoral Researcher @KITinformatik (@KITKarlsruhe) | Formal Methods for Software & AI (Focus on CPS and Fairness Verification)
Karlsruhe, Baden-Württemberg
Joined March 2021
- Tweets121
- Following376
- Followers96
- Likes313
Pinned Tweet
You want to ensure that your neural network *never* crashes your control system?
Our (now accepted 🥳) #NeurIPS paper introduces:
- Reusing control theory for NN verification
- Verifying *nonlinear arithmetic* specs on NNs
This guarantees your NN won't behave like this (1/12):
ALT A schematic plot of two planes flying towards each other at equal vertical positions. An orange line indicates the original flight trajectory of the plane on the left, and a blue line indicates an updated trajectory that was proposed by a neural network. The latter would lead to a crash of the two planes.
If anyone in Edinburgh is interested in learning more about this work:
I will give a talk about it at the LFCS Seminar @InfAtEd on Tuesday, 29th of October, at 4 pm.
web.inf.ed.ac.uk/lfcs/events…
You want to ensure that your neural network *never* crashes your control system?
Our (now accepted 🥳) #NeurIPS paper introduces:
- Reusing control theory for NN verification
- Verifying *nonlinear arithmetic* specs on NNs
This guarantees your NN won't behave like this (1/12):
ALT A schematic plot of two planes flying towards each other at equal vertical positions. An orange line indicates the original flight trajectory of the plane on the left, and a blue line indicates an updated trajectory that was proposed by a neural network. The latter would lead to a crash of the two planes.
This project was joint work with Stefan Mitsch and @AndrePlatzer. We started working on this project during my visit to @SCSatCMU and continued working on it @KITinformatik. I'm looking forward to presenting it at #neurips2024 in Vancouver.
Preprint: arxiv.org/abs/2402.10998
Our verification tool for polynomial arithmetic specifications (possibly with prepositionally complicated structure) for (ReLU) neural networks is also open source and can be found here:
github.com/samysweb/NCubeV
Want to learn how we can harness well-established program analysis techniques to analyse fairness properties?
Drop by my #AAAI poster (number 204) this evening!
#AAAI2024 #AAAI24
