You can't delete responses on Collect. Instead, you can use response tagging to mark bad data as "Archived".
Collect doesn't allow you to delete collected responses for maintaining data security and integrity.
To make your data cleaning easier, instead you can use response tagging to tag the response as "Archived". Using this, you can apply relevant filters while viewing and after downloading your data to ensure that you only view and consider the correct data.