Senior Data Specialist – R01566949

Job description

Senior Data Specialist - R01566949 Senior Data Specialist Primary Skills • Senior AWS Data Engineer Experience: 7 – 12 Years Location: Bangalore | Hyderabad | Pune | Chennai | Gurgaon Company: Brillio About Brillio Brillio is a leading digital technology consulting and solutions company focused on delivering transformative outcomes for enterprises through cloud, data, AI, and digital engineering solutions. Role Overview We are looking for a highly skilled AWS Data Engineer with strong expertise in designing, developing, and maintaining large-scale cloud-native data platforms. The ideal candidate should have extensive experience with AWS data services, Spark-Scala, ETL development, real-time streaming, and data warehousing solutions. Required Technical Skills AWS Services • Athena • SNS • SQS • CloudWatch • Macie • Kinesis • CloudFormation • EMR • OpenSearch • DynamoDB • Amazon API Gateway • AWS SCT (Schema Conversion Tool) • Redshift • AWS DMS Data Engineering & Big Data • Apache Spark (Scala) • Oozie • ETL/ELT Development • Data Modeling • Batch & Real-Time Data Processing • Data Warehousing Concepts Programming • Scala • SQL • Python (Good to Have) Key Responsibilities • Design, build, and maintain scalable data pipelines using AWS native services. • Develop high-performance data processing applications using Spark and Scala. • Build and optimize ETL/ELT frameworks for large-scale structured and unstructured datasets. • Implement real-time streaming solutions using Amazon Kinesis. • Design and manage data warehouses using Amazon Redshift. • Perform data migration and modernization projects using AWS DMS and SCT. • Create and manage workflow orchestration using Oozie. • Implement Infrastructure as Code (IaC) using AWS CloudFormation. • Configure monitoring, logging, and alerting using CloudWatch. • Manage data security, governance, and compliance using AWS Macie. • Develop API-based integrations using Amazon API Gateway. • Optimize performance, scalability, reliability, and cost of AWS workloads. • Collaborate with architects, business stakeholders, and cross-functional engineering teams to deliver cloud-native data solutions. Required Qualifications • Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline. • 7+ years of overall experience in Data Engineering and Cloud Data Platforms. • Minimum 4+ years of hands-on AWS Data Engineering experience. • Strong expertise in Spark-Scala development. • Experience building enterprise-grade data lakes and data warehouses. • Excellent SQL and performance tuning skills. • Experience working in Agile/Scrum environments. Preferred Qualifications • AWS Certified Data Analytics – Specialty. • AWS Certified Solutions Architect Associate/Professional. • Experience with AWS Glue, Airflow, or Databricks. • Exposure to CI/CD, DevOps, and Infrastructure Automation. • Knowledge of data governance and security best practices. Good to Have • Docker/Kubernetes • Machine Learning data pipelines • Data Quality Frameworks • Data Catalog & Metadata Management • Event-driven architecture and streaming platforms Job requirements Senior AWS Data Specialist Experience: 7 – 12 Years Location: Bangalore | Hyderabad | Pune | Chennai | Gurgaon Company: Brillio About Brillio Brillio is a leading digital technology consulting and solutions company focused on delivering transformative outcomes for enterprises through cloud, data, AI, and digital engineering solutions. Role Overview We are looking for a highly skilled AWS Data Engineer with strong expertise in designing, developing, and maintaining large-scale cloud-native data platforms. The ideal candidate should have extensive experience with AWS data services, Spark-Scala, ETL development, real-time streaming, and data warehousing solutions. Required Technical Skills AWS Services • Athena • SNS • SQS • CloudWatch • Macie • Kinesis • CloudFormation • EMR • OpenSearch • DynamoDB • Amazon API Gateway • AWS SCT (Schema Conversion Tool) • Redshift • AWS DMS Data Engineering & Big Data • Apache Spark (Scala) • Oozie • ETL/ELT Development • Data Modeling • Batch & Real-Time Data Processing • Data Warehousing Concepts Programming • Scala • SQL • Python (Good to Have) Key Responsibilities • Design, build, and maintain scalable data pipelines using AWS native services. • Develop high-performance data processing applications using Spark and Scala. • Build and optimize ETL/ELT frameworks for large-scale structured and unstructured datasets. • Implement real-time streaming solutions using Amazon Kinesis. • Design and manage data warehouses using Amazon Redshift. • Perform data migration and modernization projects using AWS DMS and SCT. • Create and manage workflow orchestration using Oozie. • Implement Infrastructure as Code (IaC) using AWS CloudFormation. • Configure monitoring, logging, and alerting using CloudWatch. • Manage data security, governance, and compliance using AWS Macie. • Develop API-based integrations using Amazon API Gateway. • Optimize performance, scalability, reliability, and cost of AWS workloads. • Collaborate with architects, business stakeholders, and cross-functional engineering teams to deliver cloud-native data solutions. Required Qualifications • Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline. • 7+ years of overall experience in Data Engineering and Cloud Data Platforms. • Minimum 4+ years of hands-on AWS Data Engineering experience. • Strong expertise in Spark-Scala development. • Experience building enterprise-grade data lakes and data warehouses. • Excellent SQL and performance tuning skills. • Ex