If any items are not selling, should we just delete them?

You should try adding a description and/or lowering the price.

Also, look at similar products that are listed on eBay.

Only after 30 days with no sale should you delete the product