More info: Mails on stopping fail2ban (restart the system, fail2ban stop, fail2ban restart) are not sent reliable. Sometimes it works, but mostly not. (Re)starting fail2ban and banning IPs seem to be mailed always.