The option I was looking for is %config(noreplace) but that does obviously not work on service files.