The Rocks. The historic district of The Rocks lies in the center of Sydney. The neighborhood is house to some of Sydney's oldest and most historic structures, like restored 19th-century sandstone buildings, cobbled laneways, and heritage-detailed websites. Readers can take a strolling tour of the region, Checking out the winding streets and alleys