
OWAIS AHMAD
Data Engineer | AI/ML Engineer | Software Developer
Building Reliable Data Pipelines & Scalable Lakehouse Solutions
Data Engineer specializing in scalable ETL/ELT pipelines, Lakehouse architectures, data integration, and analytics-ready solutions. Skilled in Python, SQL, PySpark, Databricks, Apache Spark, Delta Lake, PostgreSQL, FastAPI, Docker, and Power BI, with a focus on transforming raw data into reliable, high-quality, and actionable datasets.
About Me
I am a Data Engineer and AI/ML Engineer specializing in scalable data pipelines, Lakehouse architectures, intelligent automation, and AI-powered applications. I build reliable data platforms, backend services, and machine learning solutions using Python, SQL, PySpark, Databricks, Delta Lake, PostgreSQL, FastAPI, Docker, and Power BI.
My experience spans Bronze-Silver-Gold Medallion Architecture, incremental processing, data validation, REST API development, quality-assurance CRM workflows, and operational reporting. I also build backend integrations and automate business workflows, with a focus on scalable, reliable, and maintainable systems.
With a background in Data Science and AI/ML, I also enjoy building intelligent solutions that combine data engineering, machine learning, and modern software technologies to solve real-world problems.
Medallion Architecture
Structured Bronze-Silver-Gold data layers for clean, audited, and analytics-ready datasets.
Incremental Processing
Efficient Delta MERGE & Auto Loader routines minimizing batch latency and compute overhead.
Data Quality & Governance
Centralized schema validation, deduplication rules, and Unity Catalog access control.
Medallion Lakehouse Architecture
How raw data flows from disparate sources into Bronze, Silver, and Gold Delta Lake layers for analytics & reporting.
Data Sources
Raw transactional data, system logs, and hardware device feeds entering the data platform.
Ingestion Layer
Ingestion framework handling file arrival, schema preservation, and network retries.
Bronze Layer
Raw data landed directly into Delta Lake tables maintaining auditability without initial transformation.
Silver Layer
Cleansed, structured, and validated data tables ready for downstream business logic.
Gold Layer
Curated, aggregated data models optimized for business decision-making and KPI metrics.
Analytics & BI
Reporting layer connecting downstream analytics tools directly to trusted data.
Work Experience
Data Engineer & Developer
Developing quality-assurance CRM capabilities and backend services while integrating, validating, and automating operational data workflows.
Key Engineering Responsibilities:
Designing, building, and maintaining production-grade Lakehouse architectures and data pipelines for scalable analytics.
Key Engineering Responsibilities:
Data Entry Operator
Worked as a Data Entry Operator at Oasis House General Contracting Co. L.L.C. in Abu Dhabi, UAE. Employment was from January 2023 to January 2025.
EMPLOYMENT DETAILS:
Technical Skills
Technologies, frameworks, and tools for data engineering, backend development, integrations, and Lakehouse architectures.
Programming
Data Engineering
Big Data & Lakehouse
Cloud
Databases & Warehousing
BI & Analytics
APIs & Integration
DevOps & Orchestration
Tools
Featured Projects
Data Engineering projects, Databricks workflows, PySpark processing, and REST API integrations.

End-to-End Data Engineering & AI Pipeline
Metadata-driven Lakehouse automation with Databricks, Delta Lake, & Unity Catalog
Built an automated end-to-end Data Engineering pipeline using Databricks, PySpark, Delta Lake, and Medallion Architecture.

FMCG Data Engineering & Analytics Pipeline
Scalable sales, product, and customer analytics platform for FMCG data
End-to-end FMCG data engineering pipeline transforming raw sales and inventory records into Gold-layer analytics.

Online Retail Lakehouse & Analytics Pipeline
Transactional analytics processing over 540K records with Power BI
Processed 541,909 raw retail transactions to yield 527,390 valid records, powering Gold-layer sales KPIs and Power BI dashboards.

Automated ETL Pipeline
Batch processing framework with data quality checks & monitoring
Automated extraction, transformation, validation, loading, and monitoring system for distributed batch data processing.

Anviz Attendance Data Integration Pipeline
Biometric attendance sync pipeline linking hardware API to PostgreSQL & Odoo ERP
Automated biometric punch-record ingestion with validation, employee ID mapping, duplicate prevention, and Odoo ERP sync.
LinkedIn Connection Tracker
REST API & OAuth 2.0 application tracking connection lifecycle states
FastAPI REST service with OAuth 2.0 tracking LinkedIn connection lifecycles across Pending, Accepted, Rejected, and Withdrawn states.
AI-Based Knee Osteoarthritis Detection
Deep Learning and Vision Transformer-Based Medical Image Analysis
Academic AI system for analyzing knee X-rays and classifying osteoarthritis severity across KL0-KL4 using deep learning and explainability.
QA CRM & Quality Management System
Enterprise QA Workflow Automation and CRM Integration
Active-development quality assurance CRM for call evaluations, workflow visibility, structured data, reporting, and VICIdial integration.
AI Data Scientist Agent
Intelligent Data Analysis and AI-Powered Analytical Automation
An AI-assisted system for data profiling, analytical workflows, insight generation, and automated reporting.

AI Personal Assistant
FastAPI & Streamlit assistant application for workflow automation
AI-powered personal assistant application using FastAPI REST endpoints and Streamlit for workflow automation.
Certifications & Training
Technical training and course credentials across Databricks Academy, IBM, and regional IT boards.
Artificial Intelligence & Machine Learning
Get Started with Databricks for Data Engineering
Training for Snowflake
Introduction to Data Engineering
Data Analytics and Business Intelligence
Introduction to Data Mining Course
BI Dashboards with IBM Cognos Analytics and Google Looker
Get Started with Data Engineering
Education
Bachelor of Science in Computer Science
Let's Build Reliable Data Systems
I'm open to Data Engineering opportunities, collaborations, and projects involving scalable data pipelines, Lakehouse platforms, analytics infrastructure, and API integrations.