Data Bricks and Data Engineer

Job description

**Job Title\\*** Data Bricks and Data Engineer **Experience Level\\*** Min\\* 4 yrs Max\\* 8 yrs **Location\\*** Hyderabad **Work Type\\*** Full-time **Job Requirements and Responsibilitie** s **Sectio** **nDetails / Example Conten** **tJob Requirements** - **\\*Databricks & Spar** k: Hands-on experience with Databricks, Apache Spark, and Pyspark for big data processing - **.Cloud Platform** s: Proficiency in Azure (preferred), AWS, or GCP for data engineering workflow - **sSQL & Data Modelin** g: Strong knowledge of SQL, schema design, and dimensional data modeling - **.ETL/ELT Tool** s: Experience with tools like Azure Data Factory, Informatica, or Talend - **.Data Warehousin** g: Familiarity with technologies such as Azure Synapse, Snowflake, or Big Query - .Strong problem-solving and debugging skills - .Excellent communication and teamwork abilities - .Ability to work in a fast-paced, dynamic environment - .Knowledge of **Event Hub, IoT Hu** b, and streaming analytics - .Exposure to **Power B** I, **Azure DevOp** s, and CI/CD pipelines - .Understanding of **machine learning librarie** s (MLlib) and predictive analytics **.Key Responsibilities** - \\*Design and maintain scalable data pipelines using Databricks and PySpark - .Implement and optimize ETL processes for large datasets - .Collaborate with cross-functional teams to define data requirements - .Ensure data integrity and quality across the lifecycle - .Integrate solutions with cloud platforms and manage large-scale datasets **. Job Qualifications & Skills Secti** **on Doma** in- Fintech Information Servi cesIt focuses **on modernizing financial ecosyst** ems through cloud-native platforms, unified data lakes, and open APIs, enabling faster product launches and cost optimization. Advanced technologies li **ke AI-driven analytics, fraud detection, and blockch** ain power hyper-personalization, compliance automation, and innovative financial produ **ctsSoft Ski** lls- Excellent communicat ion- Team collaborat ion- Documentation and knowledge shar ing- Strong problem-solving and debugging skil **ls.Education Requireme** ntsBachelor's/master’s in computer science or equivalent (can be marked optional or flexib **le)Certificatio** ns GCP Professional Cloud Developer / Microsoft Azure Certified Develo per