Removing "DBusActivatable=True" from the application's .desktop file seems to fix this issue. However, since other distributions and DE's don't have this problem, this is only temporary fix.