Hey
, I'm Sudeep!
πΌ Experienced AWS Data Engineer with 2+ years specializing in scalable applications, data pipelines, and AWS cloud solutions.
π¨βπ» I am passionate about Python, AWS, Data Engineering, Machine Learning & I enjoy learning new things.
3 Years of experience working in Python.
- Led the design and implementation of healthcare data solutions on AWS, utilizing services such as S3, EC2, PostgreSQL, Glue, CloudWatch, Lambda, EventBridge, Secrets Manager, SNS, SQS, CloudFormation, and IAM.
- Developed and maintained ETL/ELT pipelines using Python, PySpark, and Boto3, processing large-scale healthcare data by filtering, applying business rules, and transforming it into Parquet format for destination systems.
- Implemented real-time data streaming solutions with Kinesis, ensuring efficient data ingestion and processing in the medical domain.
- Implemented PII detection and masking for Red data of the client using Amazon Comprehend, ensuring sensitive information was identified and protected in compliance with data privacy standards.
- Collaborated with customers/onsite teams, actively involved in requirement gathering and aligning solutions with business needs.
- Wrote and optimized AWS Glue ETL jobs, analyzing source data and ensuring efficient data transformation and loading.
- Applied Agile methodologies, working closely with product managers, engineering teams, and stakeholders to deliver scalable solutions.
- Led a team of four as an Offshore Lead, ensuring timely delivery and code quality.
- Proven ability to quickly learn and apply new technologies, translating business requirements into client-focused solutions.
- AWS Certified Developer Associate (DVA-C02)
- AWS Certified Data Engineer Associate (DEA-C01)
- Azure Fundamentals (AZ-900)
- On the spot Award
- Star of the Month Award