We analyzed COVID-19 influences on the design, implementation, and validity of assessing the quality of primary health care using unannounced standardized patients (USPs) in China. Because of the pandemic, we crowdsourced our funding, removed tuberculosis from the USP case roster, adjusted common cold and asthma cases, used hybrid online-offline training for USPs, shared USPs across provinces, and strengthened ethical considerations. With those changes, we were able to conduct fieldwork despite frequent COVID-19 interruptions. Furthermore, the USP assessment tool maintained high validity in the quality checklist (criteria), USP role fidelity, checklist completion, and physician detection of USPs. Our experiences suggest that the pandemic created not only barriers but also opportunities to innovate ways to build a resilient data collection system. To build data system reliance, we recommend harnessing the power of technology for a hybrid model of remote and in-person work, learning from the sharing economy to pool strengths and optimize resources, and dedicating individual and group leadership to problem-solving and results.