You should be able to delete the default VPC if there are no resources attached to it.

I thought it looked weird that the default VPC is only created when you create a droplet in a datacenter and otherwise your VPC for a particular datacenter isn't there, but there's no way to delete the default VPC for a given datacenter even after you've emptied it of attached resources.

I'd like to be able to clean up unused VPCs