Could not find 'railties' (>= 0) among 46 total gems

This happened in a Rails 5 alpha installation. Use:

bundle exec rails -v
bundle exec rails c

to resolve this issue.