Yeah. Me too.
I've done some casual riding. We had an informal group here that drank coffee and occasionally rode somewhere to breakfast or lunch. I'd ride with them on the Freeway or straight and level 2 lane roads, but I was busy if they were planning something other.
There were 3 guys in that group that I'd ride anyplace with, and sometimes did. One at a time :)
I think groups of riders can sometimes get out of control - Remember I rode sports bikes not cruisers, and some of those dudes used to ride with were mental. I stopped going with them. It became a race rather than an enjoyable ride and so I lost interest.
I've had two guys (in 50 years) that I've trusted with High Speed Riding. One is dead and the other is in serious love and unavailable right now (he'll be back :)).
I don't like race riding. When I am on a real good road I ride "The Pace". Pick a gear and stay in it. Braking is considered bad form as is shifting. Crossing the centerline is forbidden. Then let the big dog eat! I have a few I'll ride like that with (includes 3 women). But not many and never more that 3 or 4 at a time.
I like that sort of riding. Sounds enjoyable and like you'd not be in fear of coming off and breaking yourself in two all the time. It was that sort of feeling I stopped riding with those dudes. Didn't seem worth it.
Yeah, Born to Ride-Ride to Die doesn't get it with me. Born to Ride, Ride to Live is more like it.