A wallet address (where money is sent to) is the public key hashed. This money can than be spent with a transaction containing both the signature and the public key.

This is one of the reasons it is advised never to reuse an address. After using it once, your private key may still be private but your public key is exposed, reducing security.