Senior Azure Data Engineer Job at Paul May Associates, New York, NY

ZGFJOE05VUZFd1NRd3AyN295cks5d3lkMEE9PQ==
  • Paul May Associates
  • New York, NY

Job Description

Job Title: Senior AZURE Data Engineer

Primary Location: This is a Direct Hire role that is Remote AND MUST reside in New York (NY), Washington DC ( WDC), BOSTON or CHICAGO IL area.

Position Type: Direct Hire

Compensation - The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications.

Overview

Senior Data Engineer - Candidates must have the following experience: Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Databricks and well versed with Tableau and PowerBi and be able to focus on getting data into Databricks. Candidate must have built pipelines of data and worked on developing frameworks, and ideally come from professional service industries including legal and finance. Must have strong job longevity and communication skills.

What You Bring to the Role. (Ideal Experience)
  • 7+ years of data engineering or BI development experience

  • 3+ years building data solutions in Microsoft Azure Cloud

  • 2+ years using Azure DevOps for automated builds, releases, and orchestration

  • Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2), and Azure Databricks

  • Strong SQL and ELT experience; familiarity with data modeling (e.g., star, snowflake)

  • Hands-on experience with PySpark and Databricks notebooks, including Delta Lake workflows

  • Experience building and managing CI/CD pipelines using Azure DevOps

  • Familiarity with Git, branching strategies, and Azure Repos

  • Understanding of data security and privacy in Azure (RBAC, encryption, managed identities)

  • Experience with structured and semi-structured data formats (Parquet, JSON, Avro)

  • Experience with Power BI datasets and refresh configurations (preferred)

  • Familiarity with Microsoft Purview or other data governance/cataloging tools is a plus

  • Experience in professional services, legal, or financial industries is preferred

  • Bachelor's degree in Computer Science, Engineering, or a related field

What You'll Do. (Skills Used in this Position)
  • Design, build, and manage scalable data pipelines using Azure ADF, ADLS, and Databricks

  • Develop ELT frameworks to ingest and transform data from on-prem and cloud sources

  • Implement CI/CD pipelines with Azure DevOps for code versioning and deployment

  • Monitor and optimize pipeline performance using Azure Monitor and Log Analytics

  • Support Power BI teams by ensuring performant and structured datasets

  • Automate environment setup and permissions using infrastructure-as-code

  • Write modular, testable code using Python/PySpark

  • Perform root cause analysis and production support for data pipelines

  • Maintain documentation for data processes and system architecture

  • Work within Agile teams, participating in sprints, standups, and retrospectives

  • Mentor junior data engineers and champion best practices in DevOps and development

Compensation Information
The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off. is committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable state and federal regulations.


This role requires authorization to work in the U.S. without current or future visa sponsorship.


All offers are contingent upon the completion of a background check, which may include but is not limited to reference checks, education verification, employment verification, drug testing, criminal records checks, and any required certifications or compliance requirements based on the end client's background check policies and applicable laws.

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Job Tags

Remote job, Visa sponsorship,

Similar Jobs

Merck & Co.

Senior Operations Technician Job at Merck & Co.

 ...including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance Search Firm Representatives Please Read Carefully- Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from... 

Altair

Robotics Simulation Engineer Job at Altair

 ...Transforming the Future with Convergence of Simulation and Data Robotics Simulation Engineer Job Summary Our client in Sterling Heights, MI is looking for a Robotics Simulation Engineer. This is a Contract position. The Simulation Discrete Event Engineer Estimate... 

OPNX

Data Entry Clerks - multiple positions (June 2023) Job at OPNX

Why work for OPNX? The company is soon to be global cryptocurrency...  ...for detail-oriented Data Entry Clerks to join our team. The...  ...Requirements: - No prior experience is required, however a basic...  ...benefits Location: Work from home Salary: Negotiable based on... 

Amazon.com Services LLC

Senior Technology BD Manager, Global Partner Development Job at Amazon.com Services LLC

 ...professional or military experience - 5+ years of developing, negotiating and executing business agreements experience - Bachelor's degree - Experience developing strategies that influence leadership decisions at the organizational level - Experience managing programs... 

Las Vegas Petroleum

Assistant General Manager Job at Las Vegas Petroleum

 ...TravelCenters of America as an Assistant General Manager and play a pivotal role in supporting...  ...workplace for both staff and guests. Help manage inventory, ordering, and supplies...  ...possess strong leadership qualities, we want you to be part of our team! Requirements...