Remember to ensure you have good backups before automating a task that goes around deleting files and folders.
I would also recommend you use the Trash a File action rather than the Delete a File action (and in any event, the Downloads folder tends to be full of packages which are folders, so you would need to use the very dangerous Recursively Delete a File action).