Job Title: Senior Azure Data Engineer

Position ID: J1025-1801

Category: Software Development/ Engineering

Location: Taguig City

Work set up: Hybrid (3 days/week onsite)

Salary: PHP 90,000 - 120,000

Work schedule: Mid to Night-Shift

Experience required: 5+ years

Non-negotiables:

• 5+ years Azure Data Engineer with at least 1 year of experience in both Databricks and PySpark

• Strong experience in Azure Functions, Azure Data Factory, Azure SQL, Azure Key Vault

• Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage

• Working experience in migration and modernization projects

• Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL

• Should be amenable to work onsite on a hybrid setup in Taguig

• Amenable to mid to night shift schedule

Position Description:

We are currently looking for an Azure senior developer with Databricks and Pyspark skills, having at least 3 or more years of experience and who is willing to work late shift to night shift work schedule. 

We are looking for a Senior Azure Data Engineer to join the Digitalization & Automation Services Team. You will work alongside our Dev Team and will report to the following: Technical Lead, Service Delivery Manager. Your main tasks will include performing application development with exposure on Azure Databricks and PySpark.

To succeed in this role, you should be able to fit into the technical requirement need and pass the overall technical assessment.

Your future duties and responsibilities:

. Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage

. Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses

. Implement a business solution using Azure Databricks

. Align with the DevOps strategy to promote code into Production

. Participate in solutioning and delivery optimization (identifying/creating reusable Databricks components)

. Participate in and define steps to transform requirements into an implementation plan

Required qualifications to be successful in this role:

. Must have 3-5 years of relevant experience

. Strong experience in Azure Functions, Azure Data Factory, Azure SQL, and Azure Key Vault

. Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage

. Working experience in migration and modernization projects

. Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL

. Proficient in integrating, transforming, and consolidating data from various structured and unstructured data

. Knowledge of Autosys jobs, Batch scripts

. Experience with Agile methodology, Azure DevOps(CI/CD Pipeline)

. Knowledge of streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI

. Strong communication skills

. Ability to work independently and effectively within a team

Skills:

Detail-oriented

DevOps

English