Data Lineage & Data Flow Orchestration (RPA)
Design documentation of a data lineage and data flow orchestration UI. As a data experience designer, I leveraged different design artifacts to communicate with different stakeholders to drive product direction and define future features.
Target Users:
Data ProducerData Engineer
Data Scientist
Data Analyst
Design Problem: How to provide visibility of data set dependency
Design Process & Stakeholders
Case Studies
Workflows Design
Use user journey map to drive product conversation with PM
Ideation Sketching
Apply pen & paper ideation sketches to discuss IA & interactions with other designers.
Low-Fidelity Wireframing
Use wireframes to engage with engineers as early as possible
Design Exploration
EA version
We released the EA version data lineage feature to selected customers
Collect Feedback
After the EA release to users, I collected feedback from both internal stakeholders and external users.
Final Deliverable
GA and future Data Lineage UI includes enhancements like: Directed Acyclic Graph (DAG) diagram, data field error tracing, searching and filtering, data integration and publishing orchestration, foldering and security access control, etc.
1.Prototype - Error data Field tracing in data pipeline
2.Full data lineage view
3.Semantic zooming of data lineage
4.Prototype - Filtering on lineage
5.Prototype - Drag & drop interaction to left join two datasets
6.Prototype - Automate and orchestrate data pipelines
7.Prototype - Assign selected datasets into project
8.Different data sets in a variety of folders
9.Apply security to projects on data lineage
10.Projects in data set lineage view
