The open-ended coaxial probe (OECP) method is frequently used for the microwave dielectric property (DP) characterization of high permittivity and conductivity materials due to inherent advantages including minimal sample preparation requirements and broadband measurement capabilities. However, the OECP method is known to suffer from high measurement error. One well-known contributor to the high error rates is tissue heterogeneity, which can potentially be managed through the selection of a probe with a proper sensing depth (SD). The SD of the OECP is dependent on many factors including sample DPs and probe aperture diameter. Although the effects of sample DPs on SD have been investigated to some extent in the literature, the probe aperture diameters, particularly small diameters, have not been fully explored. To this end, the SDs of probes with three different apertures (0.5, 0.9 and 2.2 mm-diameters) were analyzed in this study. Probes' SDs were first investigated with simulations using a double-layered sample configuration (skin tissue and olive oil). Next, experiments were performed using a commercial OECP with a 2.2 mm aperture diameter. The SD was categorized based on 5%, 20% and 80% DP change. Among these threshold values, a 5% DP change was selected as the benchmark for SD categorization. The findings suggest that probes with a smaller aperture size and correspondingly smaller SD should be utilized when measuring the DPs of thin and multilayered samples, such as healthy and diseased skin tissues, to increase the measurement accuracy.