Must-Have Skillsets: Proficiency in ETL between different RDBMSs (e.g., Oracle) to Databricks and NoSQL databases Experience working with Mongo DB Working knowledge in Python, PySpark, and Scala Job Responsibilities: Design and implement scalable data processing solutions using Azure Databricks. Collaborate with data scientists and data analysts to understand data needs. Optimize data pipelines and workflows for performance and scalability. Ensure data quality and integrity throughout data transformation and load processes. Develop and maintain data architecture and best practices. Troubleshoot and resolve data-related issues in a timely manner. Set up performance monitoring and alerting for pipeline and data integrity.