Optical Properties of Dielectric Cavity-Coupled Two-Dimensional Van der Waals Materials: Theoretical and Experimental Studies