Make the axial tilt of the planet be parallel to its orbital plane
Uranus does this already with an axial tilt of about 97 degrees off orbital plane though this isn't a great example because Uranus is just cold all the time. All it's a gas giant while the OP is implying a rocky planet.
Torque required to keep the hot pole pointing towards the star
The trade-off to this approach is that without a source of torque to keep the hot pole pointing towards the star, the poles will alternate between extreme heat and extreme cold as the planet orbits the star. While this sounds a bit counter-intuitive, try it with a gyroscope. Pick an object to represent the sun. Spin up the gyroscope then suspend it from string. Walk all the way around the "sun". You'll notice that the gyroscope continues to point in the same direction, not towards the sun. 188
To get it to always point towards the sun, you'll need to move it by hand.
Temperature Profiles
This is going to be a very interesting planet to build an ecosystem on. The sun will always move from North to South.
The North and South hemispheres will always alternate between extreme hot and extreme cold. Just like on earth, the equator will always receive sunlight though being on the border between the two temperature extremes will make for very interesting living. How fast the planet rotates along its axis will have a huge influence on the ambient temperature. Too slow and everything freezes in the winter. Too fast causes other problems.
There is no comparable climate zone on earth to what this planet will experience. In some respects it is close to the Arctic climate zone in that there are wild temperature swings between summer and winter but different in that summer at the poles will get the equivalent of equatorial solar radiation for the entire day.
The sun is always up until it dips below the horizon, thus bringing on winter. Astronomers on this planet will notice the gentle spiral of the sun as the year goes by. 188