Behat & Flow (using Flowpack.Behat): resetting the database after every scenario?

Should the database get reset automatically after every Behat scenario when you use Flowpack.Behat? The documentaion says so - but my database will not get reset. Is there something you have to do here to make sure the database gets reset?

These contexts should share the same database to work properly. Make sure to create a new database for the Behat tests since all the data will be removed after each scenario.