You can:
Drop items by dragging the item out of your inventory into some empty space,
Sell items by dragging the item to a merchant, if you have built enough homes and gathered at least 1 gold.