To embed a podcast you simply go to the episode in the Spotify app, click the three dots ... next to the episode as shown below, choose share and copy embed code. You then embed this code into your website where you want the player to appear. It is a great way of sharing podcasts.
It would be nice if there were APIs or the ability to jump straight to a specific audio segment, as there is with YouTube, and hopefully this will come in time.