The main body of the Hans Arp Museum is situated on a heavily wooded escarpment high above the Rhine River. The building, designed by Richard Meier, seamlessly integrates the historic site with the new building. One of the unique features of the region, is the series of medieval castles situated along the river Rhine. The museum is intended to respond and echo the historic relics.

The Museum is accessed through the former Rolandseck railway station, situated immediately below. The station is linked by an underpass with a gallery for special exhibitions linked to the main museum via an elevator which leads into a tower. At the upper landing of the tower a short bridge connects to the permanent collection, which is located on two floors. While the lower gallery receives a certain amount of lateral illumination, the upper gallery is lit entirely from above.