Rob Lowe and Madonna Like Totally Could Have Been the Hottest '80s Couple Ever

Rob Lowe could have been the inspiration for Madonna's "Crazy for You," but things took a very different turn.

The 49-year-old "Parks and Recreation" alum has been married to wife Sheryl for 23 years, but in a new memoir coming out on April 8 called "Love Life," he details a missed love connection he had with none other than the Material Girl.

[Related: 7 Reasons Why Rob Lowe Is the Ultimate '80s Icon]

In the book he says their moment took place in the mid-1980s — after he wrapped 1985's "St. Elmo's Fire" and she was making headlines with her provocative "Like a Virgin" tour. While her music wasn't his thing, he was invited to check out one of her concerts at the Universal Amphitheatre in Los Angeles — she had a series of concerts there in April 1985 — and a security guard came over to Lowe's second-row seat after the show and said Madonna wanted to meet him backstage.

"I was taken to her dressing room. I expected it to be packed with the L.A. scenesters, but it was just me, some folks from her tour, and a rep from the record company," he wrote. "Madonna entered wearing a white cotton robe… She had flawless skin and eyes that imparted secrets from the moment you saw them."

After talking about her show with its "wedding gown/virgin shtick," as he described it, he told her about his saxy role in Brat Pack flick "St. Elmo's."

"'I play the bad boy,'" he recalled telling her. "She just smiled. She seemed to like that."

They kept in touch and ended up meeting up in New York City when he was in the city for a Rolling Stone photo shoot and she had a concert there, which, by our estimate, was June of that year. They connected at the Palladium, a club he said was "filled with rabid 'boy-toy' doppelgangers fans of both sexes."

"It was a madhouse," he said. "I could feel our fledgling 'date' going awry from the beginning. As I tried to enter the club, someone noticed me, word spread and things got unruly. There was a lot of grabbing and pawing."

He was whisked away by a bouncer to meet Madge in the VIP section. As "Holiday" and "Material Girl" were being played by the DJ, they talked about sneaking off somewhere to be alone. However, it didn't happen.

"She suddenly jumped up and said, 'Let's dance!'" Lowe remembered. "After my chaotic entrance to the club I couldn't fathom what would happen to us on the dance floor while they played her music."

He told her he wouldn't be joining her, which she wasn't thrilled about."'Suit yourself,'" he recalled her saying and then adding, "'I'm just not going to let success f--k up my fun.'" She then disappeared into the crowd to dance with her fans and he didn't see her again.

It was just two months later — on her birthday in August 1985 – that Madonna married Sean Penn. Their stormy marriage lasted until 1989. Lowe —who dated Melissa Gilbert on and off in the 1980s, ending an engagement in 1987—married Sheryl in 1991.

Lowe said he didn't see Madonna again until 20 years after their date when they were both at premieres with their families. But he often thinks about how she said she wouldn't let success ruin her fun, and, as he gets old, he knows he has a "great life partner" in his wife and whatever comes ahead for them, as their teen sons head off into the world, "will be fun."