Yes. Log into your dashboard and click on SETTINGS > ACCOUNT USERS at the top. next to every user you have set up. Click that button and the user will be removed right away and will no longer be able to log in.