Senior Data Specialist – R01566949

Job description

# **Senior Data Specialist - R01566949** **Senior Data Specialist** ###### **Primary Skills** - **Senior AWS Data Engineer** **Experience:** 7 – 12 Years **Location:** Bangalore | Hyderabad | Pune | Chennai | Gurgaon **Company:** Brillio **About Brillio** Brillio is a leading digital technology consulting and solutions company focused on delivering transformative outcomes for enterprises through cloud, data, AI, and digital engineering solutions. **Role Overview** We are looking for a highly skilled AWS Data Engineer with strong expertise in designing, developing, and maintaining large-scale cloud-native data platforms. The ideal candidate should have extensive experience with AWS data services, Spark-Scala, ETL development, real-time streaming, and data warehousing solutions. **Required Technical Skills** **AWS Services** - Athena - SNS - SQS - CloudWatch - Macie - Kinesis - CloudFormation - EMR - OpenSearch - DynamoDB - Amazon API Gateway - AWS SCT (Schema Conversion Tool) - Redshift - AWS DMS **Data Engineering & Big Data** - Apache Spark (Scala) - Oozie - ETL/ELT Development - Data Modeling - Batch & Real-Time Data Processing - Data Warehousing Concepts **Programming** - Scala - SQL - Python (Good to Have) **Key Responsibilities** - Design, build, and maintain scalable data pipelines using AWS native services. - Develop high-performance data processing applications using Spark and Scala. - Build and optimize ETL/ELT frameworks for large-scale structured and unstructured datasets. - Implement real-time streaming solutions using Amazon Kinesis. - Design and manage data warehouses using Amazon Redshift. - Perform data migration and modernization projects using AWS DMS and SCT. - Create and manage workflow orchestration using Oozie. - Implement Infrastructure as Code (IaC) using AWS CloudFormation. - Configure monitoring, logging, and alerting using CloudWatch. - Manage data security, governance, and compliance using AWS Macie. - Develop API-based integrations using Amazon API Gateway. - Optimize performance, scalability, reliability, and cost of AWS workloads. - Collaborate with architects, business stakeholders, and cross-functional engineering teams to deliver cloud-native data solutions. **Required Qualifications** - Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline. - 7+ years of overall experience in Data Engineering and Cloud Data Platforms. - Minimum 4+ years of hands-on AWS Data Engineering experience. - Strong expertise in Spark-Scala development. - Experience building enterprise-grade data lakes and data warehouses. - Excellent SQL and performance tuning skills. - Experience working in Agile/Scrum environments. **Preferred Qualifications** - AWS Certified Data Analytics – Specialty. - AWS Certified Solutions Architect Associate/Professional. - Experience with AWS Glue, Airflow, or Databricks. - Exposure to CI/CD, DevOps, and Infrastructure Automation. - Knowledge of data governance and security best practices. **Good to Have** - Docker/Kubernetes - Machine Learning data pipelines - Data Quality Frameworks - Data Catalog & Metadata Management - Event-driven architecture and streaming platforms ###### **Job requirements** **Senior AWS Data Specialist** **Experience:** 7 – 12 Years **Location:** Bangalore | Hyderabad | Pune | Chennai | Gurgaon **Company:** Brillio **About Brillio** Brillio is a leading digital technology consulting and solutions company focused on delivering transformative outcomes for enterprises through cloud, data, AI, and digital engineering solutions. **Role Overview** We are looking for a highly skilled AWS Data Engineer with strong expertise in designing, developing, and maintaining large-scale cloud-native data platforms. The ideal candidate should have extensive experience with AWS data services, Spark-Scala, ETL development, real-time streaming, and data warehousing solutions. **Required Technical Skills** **AWS Services** - Athena - SNS - SQS - CloudWatch - Macie - Kinesis - CloudFormation - EMR - OpenSearch - DynamoDB - Amazon API Gateway - AWS SCT (Schema Conversion Tool) - Redshift - AWS DMS **Data Engineering & Big Data** - Apache Spark (Scala) - Oozie - ETL/ELT Development - Data Modeling - Batch & Real-Time Data Processing - Data Warehousing Concepts **Programming** - Scala - SQL - Python (Good to Have) **Key Responsibilities** - Design, build, and maintain scalable data pipelines using AWS native services. - Develop high-performance data processing applications using Spark and Scala. - Build and optimize ETL/ELT frameworks for large-scale structured and unstructured datasets. - Implement real-time streaming solutions using Amazon Kinesis. - Design and manage data warehouses using Amazon Redshift. - Perform data migration and modernization projects using AWS DMS and SCT. - Create and manage workflow orchestration using Oozie. - Implement Infrastructure as Code (IaC) using AWS CloudFormation. - Configure monitoring, logging, and alerting using CloudWatch. - Manage data security, governance, and compliance using AWS Macie. - Develop API-based integrations using Amazon API Gateway. - Optimize performance, scalability, reliability, and cost of AWS workloads. - Collaborate with architects, business stakeholders, and cross-functional engineering teams to deliver cloud-native data solutions. **Required Qualifications** - Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline. - 7+ years of overall experience in Data Engineering and Cloud Data Platforms. - Minimum 4+ years of hands-on AWS Data Engineering experience. - Strong expertise in Spark-Scala development. - Experience building enterprise-grade data lakes and data warehouses. - Excellent SQL and performance tuning skills. - Ex