We are actually in 8th year of our inception, Dataeaze has been a reliable partner for global big and small businesses, in their data journey. We remain focused on making it easy for organizations to work with data and to build better decision-making mechanisms, by incorporating our domain knowledge and leveraging our customized artificial intelligence and deep learning techniques.
We are looking for Senior Databricks Developer with a strong background in data engineering and Azure cloud technologies. The candidate will have hands-on experience with Azure Databricks (ADB), Azure Data Lake Storage (ADLS), and Azure Devops, and be proficient in building and optimizing scalable data pipelines and will collaborate closely with Functional Analysts (FA) and stake holders to understand requirements, translate them into technical solutions, and deliver high-quality solutions.
Key expected results:
Build and maintain data pipelines that process large amounts of data using Databricks and Apache Spark.
Write code using PySpark to clean, transform, and move data efficiently.
Optimize data processing jobs to ensure they run quickly and use resources effectively.
Work with real-time data and Delta Live Tables (DLT) pipelines to ensure up-to-date information.
Manage and secure data access using Unity Catalog.
Use Azure Cloud services to store and process data.
Collaborate with business teams to understand their data needs and create the right solutions.
Implement CI/CD pipelines and DevOps practices to automate deployments and make processes smoother.
Follow Agile methodologies, adapting to changing project needs.
Communicate effectively with different teams and stakeholders to ensure smooth project execution.
Azure Databricks with hands On Pyspark coding (mandatory) and other azure tech stack is good to have.
Experience Needed:
Must have: 5+ years of experience in data engineering.
At least 3+ years of hands-on experience with Azure Databricks with hands On Pyspark coding (mandatory) and experience with Unity Catalog, Azure Data Lake, Azure DevOps, and Azure Data Factory.
Azure Databricks, PySpark, Unity Catalog, Azure Data Lake, Azure DevOps, Azure Data Factory, Data Engineering, Apache Spark, DevOps, CI/CD.