Investigating Stellar Mass Build-up and Quiescence of Massive Galaxies In the Early Universe Using Wide-Field Imaging