Data Products - Technical Feasibility Assessment

Success

• This document is intended for technical audience mainly consisting of Solution Architects and Data Engineers

• This document is a guidebook for the audience to fill the Architecture Feasibility Outcome

Resources to be Used

• Feasibility Outcome Template

• Feasibility Outcome Example

• High Level Architecture drawing

• Ingestion Patterns

• Data Governance Enforcement

Guidelines

• The Architecture Feasibility Outcome template has sections which can be filled once the Feasibility Outcome Template is filled. An example is provided above.

• Ensure asking relevant questions as outlined but not limited to by the Feasibility Outcome Template and the Data Product Workshop.

• Map the requirements obtained from the workshop to business processes, functions and objectives.Consider meeting Product Owner and other Business Stakeholders in case of new or missed information. Goal is to have as much clarity as possible.

• Utilize known Ingestion Patterns outlined above to establish what is already done in NN and is doable and design solutions accordingly.

• Consider assessing risks in the IT solution reference to come

• Consider Data Governance requirements that are not obvious and ask relevant questions. Refer Data Governance Enforcement-Technical Analysis of Requirements in the resources above

• Consider outlining a technical capability which maps the business process

  Examples

  • Data Collection using Databricks Autoloader or DLT or equivalent

  • Data Discovery using Unity Catalog

  • Access control using Novoaccess, Immuta or equivalent