August 11, 2025: Improved deduplication logic

We’ve enhanced our deduplication logic in the data pipeline for patient and observation resources.

The process can now more intelligently determine when records with minor variations represent the same underlying resource, allowing us to create new records only when there are meaningful differences and reduce unnecessary duplication.

As a result, you can expect to see fewer duplicate patients from the same managing organization and fewer duplicative observations, particularly in social history. We are continuing to refine this process and exploring opportunities to improve duplicate identification across the remaining resource types.