NFL star Rashod Bateman is accused of family violence in Georgia after he allegedly smashed the windows of his baby mama's car ... while his 3-month-old was inside ... TMZ has learned.

According to court docs, obtained by TMZ, the alleged victim told cops the incident happened around 6 AM on June 3.

Authorities claim Rashod used an object to break the windshield and driver's side window of the alleged victim's 2021 Benz.

According to the arrest warrant, glass shattered and caused multiple small lacerations to the alleged victim's face. The officer noted they saw some glass in her face when talking to her and multiple contusions to her face.

The docs say the couple's 3-month-old was sitting in a car seat in the back row.

Attorneys for Rashod say the Baltimore Ravens wide receiver surrendered to the Walton County Sheriff the same day.

A couple of weeks later, Rashod asked the court to remove the no-contact order, claiming the alleged victim indicated she wanted to have contact with him. The court signed off on the request but still ordered the NFL star not to have violent contact with his baby mama.

The judge ordered that Rashod is allowed to see his baby mama once he completes a class.

The case is ongoing.

We reached out to the Ravens and Rashod's camp ... so far no word back.