I"m not sure what I did wrong and what I did right here. There seems to be a few bugs in rubber.
In the end I made a new app, deployed the way it's done in the second half of the Railscast (with individual instances). After that I logged into AWS, clicked in the instance -> actions -> connect. There you can see the "correct" way to connect to the instance.