Are we allowed to do ordinary dropshipping from Overstock?

Yes, absolutely! The gist is that any website besides Amazon is fair game for dropshipping.