I have been working as a data engineer for 5 years using Azure and AWS platforms, using methodologies like ETL, and Python, SQL. I have hands-on experience building data solutions in Azure using data lake, devops, data factory, databricks, postgres, sql server, synapse, stream analytics.

I am highly skilled in writing complex SQL queries for data manipulation and analysis. Additionally I have good experience in Python and Pyspark.

I have strong communication and collaboration skills.

Professional Experience
Senior Data Engineer
Nimbus UK | April 2024 - October 2024

• Building scalable data architectures, models and ETL pipelines for big datasets like geospatial data using Azure (Data Factory, Data Lake, Key Vault), Databricks (PySpark, Python, SQL, Delta Lake, Medallion architecture), Postgres, SQL Server, GeoServer
•  Integration of data from disparate sources maintaining data quality, security and performance of pipelines
• Optimization of existing datasets
• Debugging of issues in pipelines, providing support and creating detailed documentation

Data Engineer Consultant
GlobalLogic, Edinburgh | January 2023 - April 2024

• Worked for a fintech client NatWest using AWS SageMaker, CloudFormation, S3, Athena to help their more than 50 teams migrate, deploy and maintain their ML models.
• Issues debugging and providing solutions to teams using bank’s best practices
• Developed new packages and improved old packages for bank’s templates using Python
• Built and deployed rules and vocabs using Amazon Connect, Firehose and dashboards in Amazon Quicksight, Terraform, TeamCity and Bitbucket

Data Engineer
Forth Point, Edinburgh | January 2022 - January 2023

• Worked on Azure (Data Factory, Data Lake, Key Vault, Logic Apps, DevOps), Azure Databricks
• (Python, SQL, PySpark) to build end to end ETL pipelines from deploying infrastructure to delivering data and documentation for a renowned book publishing company Hachette
• Worked for a US based health sector client to create ETL pipelines for their Workplace Optimizer using
• GCP(Vertex-AI, Python, BigQuery), and Airflow.
• Coordinated with data science team for data delivery
• Communicated with clients from the first phase of requirements gathering till handover, documentation and training

Data Engineer
Indicia Worldwide KMMS, Edinburgh | September 2019 - January 2022

• Worked on ETL processes using Matillion, Python and AWS for ITV and BBC.
• Used Redshift, Snowflake and SQL Server for big data querying and management.
• Used Adobe Campaign and Braze for data federation and campaigns management.

• Junior Software Developer | Zultec Pvt. Ltd, Karachi | November 2016 - October 2017
• Junior Software Developer | Softech Microsystems, Karachi | January 2016 - November 2016
• SQA Engineer | Softech Microsystems, Karachi | September 2015 - December 2015
• SQA Engineer | Ensign Communique, PAF, Karachi | March 2015 - August 2015

Certifications
- Azure Data Engineer Associate (DP-203), October 2024
- AWS Certified Solutions Architect - Associate, December 2023
- AWS Certified Cloud Practitioner, March 2023

Key Skills

Clouds Platforms & Tools:

• Azure, Databricks, AWS, GCP, Airflow, TeamCity, Matillion, Terraform

Databases:

• Snowflake, Redshift, BigQuery, MS SQL Server, Postgres

Languages:

• Python, C#, APIs

Other Tools:

• Adobe Campaign, Braze, Bitbucket, GitLab, JIRA, Confluence

Education
MS - Data Engineering & Information Management
NED University of Engineering & Technology, Karachi (June 2017 - May 2019)
CGPA: 3.69/4.00

BE - Software Engineering
Mehran University of Engineering & Technology, Jamshoro (January 2011 - February 2015)
CGPA: 3.93/4.00