Case study

Data integrity service

Data corruption in a live platform arrives as support tickets. We led a project to stop it arriving that way, building a service that detects unintended software behaviour and repairs the damage it causes.

Client Qfact
Sector B2B SaaS and analytics
Period 2018 to 2024
The challenge

Why this needed doing

Detection had to be reliable in both directions. A service that misses corruption is useless, and one that repairs healthy data is dangerous.

It also had to sit inside an existing event driven architecture and use what was already there rather than duplicating it.

What we delivered

  • Research into data integrity practice, and stakeholder interviews to establish what correct actually meant for each part of the platform.
  • A Python service that monitors software behaviour, identifies unintended actions and repairs corrupted data.
  • Integration with the existing event store, using recorded chains of behaviour as the evidence behind every integrity check.
  • Iterative testing and refinement against real production behaviour.

The result

Corruption started being caught and corrected before users ran into it, which took a recurring category of work off the customer support team.

More work

Related projects we have delivered

Qfact

SaaS platform development and engineering leadership

A microservices platform for complex analysis workflows, built and led from 2018 to 2024. We introduced measurable sprint velocity where there was none and removed whole classes of recurring bugs.

Qfact

QIntelligence automated content analysis

A system that reads user uploaded documents, extracts what matters and generates project suggestions from it, built on large language models.

Qfact

QIntelligence document indexing platform

The indexing and full text search foundation underneath QIntelligence, built on Python and Elasticsearch and designed to outlive the requirements it started with.

Have a project that looks like this one?

Tell us what you are building and where it hurts. We will tell you straight whether we are the right partner for it.

Book a 15 minute introduction
Modern development workspace