Non-negotiables:

• 5+ years Azure Data Engineer with at least 1 year of experience in both Databricks and PySpark

• Strong experience in Azure Functions, Azure Data Factory, Azure SQL, Azure Key Vault

• Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage

• Working experience in migration and modernization projects

• Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL

• Should be amenable to work onsite on a hybrid setup in Taguig

• Amenable to mid to night shift schedule

Position Description:

• We are currently looking for an Azure senior developer with Databricks and Pyspark skills, having at least 3 or more years of experience and who is willing to work late shift to night shift work schedule.


• We are looking for a Senior Azure Data Engineer to join the Digitalization & Automation Services Team.


• You will work alongside our Dev Team and will report to the following: Technical Lead, Service Delivery Manager.


• Your main tasks will include performing application development with exposure on Azure Databricks and PySpark.


• To succeed in this role, you should be able to fit into the technical requirement need and pass the overall technical assessment.

Your future duties and responsibilities:

• Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage.


• Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses.


• Implement a business solution using Azure Databricks.


• Align with the DevOps strategy to promote code into Production.


• Participate in solutioning and delivery optimization (identifying/creating reusable Databricks components).


• Participate in and define steps to transform requirements into an implementation plan.
  
   

Required qualifications to be successful in this role:

• Must have 3-5 years of relevant experience


• Strong experience in Azure Functions, Azure Data Factory, Azure SQL, and Azure Key Vault.


• Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage.


• Working experience in migration and modernization projects.


• Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL.


• Proficient in integrating, transforming, and consolidating data from various structured and unstructured data.


• Knowledge of Autosys jobs, Batch scripts.


• Experience with Agile methodology, Azure DevOps(CI/CD Pipeline).


• Knowledge of streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI.


• Strong communication skills.


• Ability to work independently and effectively within a team.


• Must be amenable to working onsite 2-3 days a week in McKinley, Taguig, on a late mid-shift to a night-shift schedule