Modular Architecture

The Sentinel Data Platform’s modular architecture opens a smarter, more controlled and more efficient way to work. Code for transformation, matching, cleansing and more can be reused saving massive amounts of developer time.

Once a model is coded other objects can be hooked into this function rather than duplicate it. This allows greater control; model owners can look after transformation or matching code that may play a role in hundreds or thousands of connected data objects. Modular architecture eliminates duplication and consolidates control into the right places.

Modular architecture also enables a decentralized method of working; code models can be housed peripherally or centrally, particularly useful if a key code model requires a particular department or specialist’s input; management and update of the key code model can be maintained as a code-once satellite function that serves many. 


Improved system cohesion and agility with Sentinel Modular Architecture


Simplify your code using modules. Store queries and code snippets as a reusable model. Reduce code duplication and shield complexity by encapsulating your business logic into a word or phrase that can be called from anywhere.


Combine the speed of tables with the flexibility of a view. Define complex queries that can be represented as tables and periodically updated to give you the most recent data without slowing down your queries


Incorporate existing scripts or create new ones to enhance your data pipeline. Make use of the best language for the job including; Python, Java, Javascript, Bash, R, Machine Learning Models, Azure Compute Services and many more

Write queries and transformations once, use them everywhere

Build reusable code snippets for complicated transformations

  • Reduce duplication - repeated code can be replaced with a module
  • Shield complexity - encapsulate business logic inside modules and abstract it into a callable reference
  • Simplify updates - edit a module once, that code is updated everywhere

Create an ideal dataset for your analytics to simplify and speed up queries

Materialise your models as tables, incremental tables, or views

  • Improve query preformance by creating an ideal dataset for your usecase with materialisations to pre-calculate complex joins and transformations
  • Always work with up-to-date data by choosing your materialisation refresh frequency
  • Define materialisations in code. Set your materialisation logic to be in line with your SQL transformations
  • Materialise tables for transformations for faster warehouse work. Save processing time by running code once rather than multiple times for different builds

Don't be shackled by language constraints, run the code that works for you

Hook out to external processes and code. Bring in what you need, avoid duplication and utilise satellite functions. 

  • Run your existing scripts or create new ones
  • Automatically execute scripts as part of your data pipeline
  • Compatible with any scripting language
  • Store and process the output of your script with various destinations

Modular Architecture for large scale Data Migration and Transformation projects

In company transformation projects requiring large volumes of data to be lifted and shifted from legacy systems to new target systems the management of how values are transformed and cleansed can pose challenges.

Common problems are transformation desynchronisation and dependency management. Where multiple build objects created for migration use the same sets of transformations these can slip out of sync and cause problems. This emerges from the risks of duplicating a set of transformations across multiple build objects and developers.

Using modular technology, these transformations can be owned by a specialist but used for many different build objects. Control is consolidated, slippage is avoided and workloads are reduced.  

Long-running SQL transformations can consume development time and increase cloud data storage costs. Our modular technology allows you to only run transformation code on the new data that needs it.

Why use modular architecture?

  • Faster updates to code and transformations
  • Greater control and visibility of code
  • Build a foundation for large projects
  • Improved organisation of code for agile working
  • Support large data projects
  •  Easier management of trusted data
  • Agnostic of databases and technology

Transform data use in your organisation

Book your free data assessment today, and find out how much of an impact Sentinel's Master Data Management tools can have on your business.

  • Strict control and monitoring of data quality
    and completeness
  • Built using the ICO's "data protection by design"
  • Trusted by public sector organisations and local authorities
  • Experienced, dedicated team of data integration and data sharing specialists

Take the hassle out of data management. Call us on +44(0)800 612 2116 or email us [email protected].