2024-04-30 DMRWG Meeting Notes

Meeting Date

The DMRWG meets bi-weekly on Tuesdays at 12:00-13:00 PT / 16:00-17:00 UTC. Check the ToIP Calendar for meeting dates.

Zoom Recording & supporting material

Attendees

Main Goal of this Meeting

A presentation by Burak Serdar on Selective Disclosure using Layered Schema

Notes (including all relevant links)

TimeAgenda ItemLeadNotes
5 min
  • Start recording
  • Welcome & antitrust notice
  • Introduction of new members
  • Agenda review
Chairs
  • Antitrust Policy Notice: Attendees are reminded to adhere to the meeting agenda and not participate in activities prohibited under antitrust and competition laws. Only members of ToIP who have signed the necessary agreements are permitted to participate in this activity beyond an observer role.
  • New Members:
55 minsPresentation by Burak SerdarAll

Burak Serdar discussed the technical aspects of data schemas, selective disclosure, and the integration of data transformation pipelines. He focused on the application of schema and overlays in managing data privacy and governance.Selective Disclosure:

    • Introduced the concept of selective disclosure using data schemas and overlays. This involves defining sensitive data elements that need to be protected or hidden based on user permissions or other criteria.
    • Demonstrated how data can be filtered and transformed as it passes through a pipeline, ensuring only authorized data is exposed.
  • Schema and Overlays:

    • Described the use of JSON schemas and overlays to manage data attributes and privacy settings. Overlays are used to mark certain data fields as sensitive within the schema, controlling visibility based on the overlay settings.
    • Explained how these schemas and overlays are bundled together to form a comprehensive rule set that governs data access and transformation.
  • Data Transformation Pipeline:

    • Detailed the operational mechanism of data transformation pipelines which ingest, transform, and export data according to the defined schemas and overlays.
    • Showcased how these pipelines are configured to handle data selectively, applying filters and transformations to ensure data privacy and compliance with governance models.
  • Practical Applications:

    • Highlighted the application of this technology in API interoperability, where data needs to be exchanged between systems securely and efficiently.
    • Stressed the importance of translating user-defined data access rules into machine-readable formats using schemas and overlays, allowing dynamic data handling and transformation based on specific use cases.

Technical Insights:

  • Graph Data Models: Discussed the representation of data using graph models which enhance the ability to query and manage complex data relationships.
  • Pipeline Configurations: Mentioned the use of YAML files for defining pipeline operations, which improves readability and ease of configuration.
  • Dynamic Schema Application: Talked about how applications can dynamically generate overlays and schema bundles based on real-time data requirements and governance rules.

Steven Milstein: Asked about the functionality and extendibility of pipelines, the feasibility of multiple disclosure levels through the pipeline, and how new data fields are governed under existing data agreements.

Carly Huitema: We discussed "governance as overlay," for example, defining a query to filter/sub-set the data.


Supporting Material:

Selective Disclosure using Layered Schema (LSA)

Presentation (PDF)

ToIP-selective disclosure using LSA.pdf