Aaron and Frances moved into their custom Paul R. Williams' Colonial Modern in nearby Holmby Hills in 1944. Holmby Hills was a 400-acre estate district on the most desirable section of the ranch. The residential lots ranged from 1 to 4 acres and all houses cost at least $25,000 and $5,000 more than the construction minimum in beau monde Bel Air. Williams' utilization of natural stone, recessed lighting, and smooth, unadorned ceilings gave the Lilien home an open, modern feel. His repeated use of the curved shape found in the metal entry stairway and throughout the details of the house including room dividers, custom lighting fixtures and the fireplace andirons unified the design. Banks of large windows and sliding glass doors with views of the landscaped pool area, opened and extended the living space.

Holmby Hills was the address for many film greats of the time: Bing Crosby, Judy Garland, Gary Cooper, and Gregory Peck. Although Aaron Lilien was a successful owner of the Los Angeles Meat Company, he wanted the same elegant traditional architecture as the Hollywood crowd. The Lilien home was a refined slimmed-down version of the Colonial-style desired in Hollywood.