We are seeking a dynamic and experienced Data Engineer with a proactive attitude and willing to learn. This role requires expertise in analyzing designing and implementing pipelines using DBT framework but also to ensure we follow all the expected best practices and quality measures. The ideal candidate will also have a background in Azure cloud, Azure Devops and CI/CD processes within it and Python code. This position combines some aspects of DevOps engineers, Data Engineers and Business Analyst. We are looking for a candidate who excels in automation and development, rather than merely operational tasks.
Key Responsibilities:
Identify key uses cases, and apply end to end data flow, from ingestion, storage, transformation and catalog.
Democratize the access to the data ensuring security aspects through dashboards and API.
Follow best practices and quality guidelines.
Develop and maintain data analytics solutions, including data pipelines and ETL processes.
Write, optimize, and manage SQL queries and databases and be aware of the results.
Ensure security and compliance of cloud environments.
Collaborate on designing and implementing CI/CD DevOps pipelines.
Conduct performance tuning, troubleshooting, and root cause analysis.
Implement and manage monitoring, logging, and alerting systems.
Technical Knowledge:
Technology Level of expertise.
Priority Must Nice to have:
DBT 3 1 X
Azure Databricks / Spark 3 1 X
Python 3 2 X
Azure Devops 2 2 X
SQL 3 1
Soft Skills:
Customer oriented attitude to our customer willing to provide solutions for any challenge our customer is facing by having “all-ears” to any suggestion. This is really something interesting.
Strong problem-solving skills and ability to work independently. This is a must
Proactive attitude and excellent communication skills. This is a must
Not fear of asking or taking challenges.
DBT, Azure Databricks/Spark, Azure DevOps, and SQL.