No you never put your worker on an offer space, you just take the goods.
This means that if your worker is in a building and you take a pile of goods, your worker stays in that building.
This means that if your worker is in a building and you take a pile of goods, your worker stays in that building.