Data Architect – Dynamic Pricing & Decision Intelligence Platform

About the role

TechBiz Global is seeking a Data Architect to design and govern the end‑to‑end data ecosystem for the ValueX platform. You will shape data ingestion, processing, modeling, storage, orchestration and governance for a high‑scale, real‑time decisioning environment.

Key responsibilities

• Define the complete data architecture across batch, streaming and real‑time layers, including logical, physical and semantic models for Customer 360 and Offer 360.
• Architect data ingestion pipelines from telco sources such as OCS, CRM, Kenan, Billing, DWH, Adobe AEP, Pricefx and external APIs, and design real‑time event ingestion patterns.
• Establish data contracts for Kafka topics, API payloads and Adobe/CDP integrations, and set up data versioning and lineage frameworks.
• Implement data quality, lineage, catalog and access policies using tools like DataHub, Collibra or Amundsen, and enforce validation with Great Expectations or Deequ.
• Design scalable, cost‑efficient solutions for 50 M+ customer profiles, optimizing lakehouse storage (Z‑Order, Delta caching, compaction) and monitoring query performance.
• Collaborate with Data Engineers, Data Scientists and Application Developers, lead architecture review boards and maintain design documentation.

Required profile

• Proven experience designing end‑to‑end data architectures for large‑scale, real‑time platforms.
• Hands‑on experience with telco data sources (OCS, CRM, Kenan, Billing, DWH, Adobe AEP, Pricefx).
• Strong knowledge of data governance, metadata management and data quality frameworks.

Required skills

• Kafka (topic design, contracts)
• API design and payload handling
• Adobe AEP, Pricefx integration
• Cloud storage technologies (AWS S3, Delta Lake)
• Data orchestration tools (n8n, DecisionRules.io, KNIME)
• Metadata/catalog tools (DataHub, Collibra, Amundsen)
• Data quality frameworks (Great Expectations, Deequ)
• Lakehouse optimization techniques (Z‑Order, Delta caching, compaction)