Though Brad Pitt ‘almost no contact’ with his adult children, he does get to see his younger children

Maddox, Zahara, Shiloh, Pax, Knox, and Vivienne are the six children that Angelina Jolie and the actor have together.

According to a family-close source, Brad Pitt has “virtually no contact” with his adult children but still receives visitation with his younger children, one month after Angelina Jolie and Brad Pitt’s 18-year-old daughter Shiloh filed to have “Pitt” removed from her last name.

He hardly interacts with the grown children at all. Due to his filming schedule, he hasn’t spent as much time with the younger children in recent months, the insider said. Pitt is filming his next racing picture, F1, on site in Europe right now.

Pitt, 60, and Jolie, 48, are parents to six children together: Maddox, 22, Zahara, 19, Shiloh, Pax, 20, and the twins, Knox and Vivienne, 15. Additionally, according to the source, the couple’s custody agreement grants their minor children visiting rights.

“[Angelina] has the kids most of the time, but per their agreement, he has visitation with the younger kids.”

The father of six is “aware and upset” over Shiloh’s name change, a source close to Pitt told PEOPLE recently. According to the June report, “He’s aware and upset that Shiloh dropped his last name.”

It is naturally difficult for Brad to be reminded that he has lost his children. He is in love with and misses his kids. It’s quite depressing,” the source said.

The source went on, “He’s still happy with Ines [de Ramon], but he aches from being apart from his kids.”

“He still has a great love for all of his children,” a second person close to Pitt told PEOPLE. “For the entire family, this entire process has been extremely difficult.”

Shiloh’s docs were submitted on Monday, May 27, which also happened to be her 18th birthday, as someone with knowledge of the situation revealed to PEOPLE. The teenager wants to go by “Shiloh Jolie” and is requesting a new legal name.

Not just Shiloh, the child of Jolie and Pitt, seems to have a distinct name. PEOPLE has confirmed that the adolescent is listed as “Vivienne Jolie” rather than “Vivienne Jolie-Pitt” on the Playbill for the new musical The Outsiders, which their daughter Vivienne co-produced with mother Jolie.

Whether Vivienne has formally changed her name at this point is likewise unknown.