Pardon me for reviving this thread from the grave, but I was in this precise situation and found a solution.
Chances are you don't have sendmail configured. I commented out all sendmail[] statements in /etc/fail2ban/jail.conf and I can now start and stop fail2ban as I please!