Senior Azure Data Engineer Job at Paul May Associates, New York, NY

ZGFJOE05VUZFd1NRd3AyN295cks5d3lkMEE9PQ==
  • Paul May Associates
  • New York, NY

Job Description

Job Title: Senior AZURE Data Engineer

Primary Location: This is a Direct Hire role that is Remote AND MUST reside in New York (NY), Washington DC ( WDC), BOSTON or CHICAGO IL area.

Position Type: Direct Hire

Compensation - The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications.

Overview

Senior Data Engineer - Candidates must have the following experience: Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Databricks and well versed with Tableau and PowerBi and be able to focus on getting data into Databricks. Candidate must have built pipelines of data and worked on developing frameworks, and ideally come from professional service industries including legal and finance. Must have strong job longevity and communication skills.

What You Bring to the Role. (Ideal Experience)
  • 7+ years of data engineering or BI development experience

  • 3+ years building data solutions in Microsoft Azure Cloud

  • 2+ years using Azure DevOps for automated builds, releases, and orchestration

  • Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2), and Azure Databricks

  • Strong SQL and ELT experience; familiarity with data modeling (e.g., star, snowflake)

  • Hands-on experience with PySpark and Databricks notebooks, including Delta Lake workflows

  • Experience building and managing CI/CD pipelines using Azure DevOps

  • Familiarity with Git, branching strategies, and Azure Repos

  • Understanding of data security and privacy in Azure (RBAC, encryption, managed identities)

  • Experience with structured and semi-structured data formats (Parquet, JSON, Avro)

  • Experience with Power BI datasets and refresh configurations (preferred)

  • Familiarity with Microsoft Purview or other data governance/cataloging tools is a plus

  • Experience in professional services, legal, or financial industries is preferred

  • Bachelor's degree in Computer Science, Engineering, or a related field

What You'll Do. (Skills Used in this Position)
  • Design, build, and manage scalable data pipelines using Azure ADF, ADLS, and Databricks

  • Develop ELT frameworks to ingest and transform data from on-prem and cloud sources

  • Implement CI/CD pipelines with Azure DevOps for code versioning and deployment

  • Monitor and optimize pipeline performance using Azure Monitor and Log Analytics

  • Support Power BI teams by ensuring performant and structured datasets

  • Automate environment setup and permissions using infrastructure-as-code

  • Write modular, testable code using Python/PySpark

  • Perform root cause analysis and production support for data pipelines

  • Maintain documentation for data processes and system architecture

  • Work within Agile teams, participating in sprints, standups, and retrospectives

  • Mentor junior data engineers and champion best practices in DevOps and development

Compensation Information
The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off. is committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable state and federal regulations.


This role requires authorization to work in the U.S. without current or future visa sponsorship.


All offers are contingent upon the completion of a background check, which may include but is not limited to reference checks, education verification, employment verification, drug testing, criminal records checks, and any required certifications or compliance requirements based on the end client's background check policies and applicable laws.

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Job Tags

Remote job, Visa sponsorship,

Similar Jobs

Coffeyville Regional Medical Center

Human Resources - Student /General Application Job at Coffeyville Regional Medical Center

 ...Description: This is a general job posting for Medical Field College Students who do not see a position open that they are interested in, but would like for CRMC to have an application on file. This general application and resume will be used until graduation. Your... 

Get It - Hospitality

Travel PCU RN - Progressive Care Unit Registered Nurse Job at Get It - Hospitality

Are you a dedicated Progressive Care Unit (PCU) Registered Nurse looking for an exciting travel opportunity? We're seeking skilled nurses...  ...we provide personalized support, seamless credentialing, and access to assignments across all 50 states. With competitive pay, flexible... 

Gold Standard Staffing

Warehouse Floor Supervisor Job at Gold Standard Staffing

 ...experienced Floor Supervisor to oversee daily operations within our warehouse environment. The ideal candidate will have a strong background...  ...logistics for incoming and outgoing shipments, ensuring timely delivery of products. Train new employees on operational procedures... 

Pride Health

Epic Analyst Job at Pride Health

Pride Global and its entities offer eligible employees comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance, and hospital indemnity), 401(k) retirement savings, life and disability insurance...

Sheffield & Richards LLP

Associate Attorney Job at Sheffield & Richards LLP

We are seeking an associate attorney to join our workers' compensation defense firm. Our ideal candidate has a willingness to learn, regardless of how extensive their background is. We seek to resolve claims in the most cost-effective ways possible, requiring strong analytical...