Skip to content
All projects
Data Pipelines & MigrationAirtel X Labs

GCP Reporting & SMS Insights

Ab Initio pipelines that reintegrate reports into GCP, and automated SMS Insights reporting on the bulk SMS aggregator market, delivered to AWS S3.

Context

Two reporting workstreams that moved data across cloud boundaries.

Problem

Reports had to reach the GCP ecosystem with their integrity intact, and the bulk SMS aggregator market needed transparent, regularly generated reporting.

My role

I led the GCP Reporting pipelines and delivered SMS Insights.

Approach & architecture

  • GCP Reporting: Ab Initio pipelines to extract, transform and reintegrate reports into GCP, with a focus on data integrity and efficiency.
  • SMS Insights: automated generation of multiple CSV reports, pushed to AWS S3.

Results

  • Reports reintegrated into the GCP ecosystem.
  • SMS Insights brought transparency to the bulk SMS aggregator market.

Tech stack

  • Ab Initio
  • GCP
  • AWS S3
  • SQL

What I'd do next

  • Add schema and row-count validation on every delivered report file.