I am from Switzerland, so what should I do if the shipping charge is more to send?

You can change this in your shipping policies. You can also tell the buyer that it will cost ‘x’ more to ship to Switzerland. If he says no longer wants the item, you can cancel the order, and mark it as buyer requested.