Data and Analytics Platform
Architected and delivered a modern Data and Analytics Platform at USAA, enabling real-time, large-scale data processing, advanced analytics, and AI/ML for enterprise-wide business impact.
Project Overview
At USAA, I led the design and implementation of a next-generation Data and Analytics Platform that became the digital backbone for the organization's analytics and AI transformation.
The platform ingested, processed, and curated 15-18 billion records and over 800,000 files daily, moving more than 250TB of data to AWS S3 and other cloud destinations.
I architected modular orchestration, parallelized ingestion, and dynamic workload partitioning, supporting real-time and batch analytics, regulatory reporting, and machine learning at scale.
The platform integrated with AWS SageMaker, EMR, and Kinesis for advanced analytics and ML, and provided secure, governed access to data for business, risk, and compliance teams.
This initiative established a foundation for predictive analytics, self-service BI, and data-driven decision making across the enterprise.
Key Features
- Real-time and batch data processing at petabyte scale.
- 20x scalability improvement and 90% reduction in data latency.
- Integrated with AWS SageMaker, EMR, Textract, Rekognition, and Macie for advanced analytics and AI/ML.
- Enabled secure, governed data access and regulatory compliance (SOX, GLBA, etc.).
- Self-service analytics and BI for business users via OpenShift and IBM SPSS integration.
- Automated data quality, validation, and monitoring for end-to-end reliability.
- Empowered cross-functional teams to deliver insights and drive business value.
Technologies Used
Project Details
Client
USAA
Timeline
2018 - 2021
Role
Lead Data Platform Engineer & Architect
More Projects
© 2025 Muthu. All rights reserved.