Senior Azure Data Engineer Job at Paul May Associates, New York, NY

ZGFJOE05VUZFd1NRd3AyN295cks5d3lkMEE9PQ==
  • Paul May Associates
  • New York, NY

Job Description

Job Title: Senior AZURE Data Engineer

Primary Location: This is a Direct Hire role that is Remote AND MUST reside in New York (NY), Washington DC ( WDC), BOSTON or CHICAGO IL area.

Position Type: Direct Hire

Compensation - The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications.

Overview

Senior Data Engineer - Candidates must have the following experience: Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Databricks and well versed with Tableau and PowerBi and be able to focus on getting data into Databricks. Candidate must have built pipelines of data and worked on developing frameworks, and ideally come from professional service industries including legal and finance. Must have strong job longevity and communication skills.

What You Bring to the Role. (Ideal Experience)
  • 7+ years of data engineering or BI development experience

  • 3+ years building data solutions in Microsoft Azure Cloud

  • 2+ years using Azure DevOps for automated builds, releases, and orchestration

  • Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2), and Azure Databricks

  • Strong SQL and ELT experience; familiarity with data modeling (e.g., star, snowflake)

  • Hands-on experience with PySpark and Databricks notebooks, including Delta Lake workflows

  • Experience building and managing CI/CD pipelines using Azure DevOps

  • Familiarity with Git, branching strategies, and Azure Repos

  • Understanding of data security and privacy in Azure (RBAC, encryption, managed identities)

  • Experience with structured and semi-structured data formats (Parquet, JSON, Avro)

  • Experience with Power BI datasets and refresh configurations (preferred)

  • Familiarity with Microsoft Purview or other data governance/cataloging tools is a plus

  • Experience in professional services, legal, or financial industries is preferred

  • Bachelor's degree in Computer Science, Engineering, or a related field

What You'll Do. (Skills Used in this Position)
  • Design, build, and manage scalable data pipelines using Azure ADF, ADLS, and Databricks

  • Develop ELT frameworks to ingest and transform data from on-prem and cloud sources

  • Implement CI/CD pipelines with Azure DevOps for code versioning and deployment

  • Monitor and optimize pipeline performance using Azure Monitor and Log Analytics

  • Support Power BI teams by ensuring performant and structured datasets

  • Automate environment setup and permissions using infrastructure-as-code

  • Write modular, testable code using Python/PySpark

  • Perform root cause analysis and production support for data pipelines

  • Maintain documentation for data processes and system architecture

  • Work within Agile teams, participating in sprints, standups, and retrospectives

  • Mentor junior data engineers and champion best practices in DevOps and development

Compensation Information
The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off. is committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable state and federal regulations.


This role requires authorization to work in the U.S. without current or future visa sponsorship.


All offers are contingent upon the completion of a background check, which may include but is not limited to reference checks, education verification, employment verification, drug testing, criminal records checks, and any required certifications or compliance requirements based on the end client's background check policies and applicable laws.

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Job Tags

Remote job, Visa sponsorship,

Similar Jobs

Certified Fleet Services

Master Diesel Technician Job at Certified Fleet Services

 ...shared vision, we create an environment where each individual can thrive and grow. Whether you're a seasoned technician looking to elevate your career or a newcomer eager to learn the ropes, we provide the support, resources, and opportunities you need to succeed. Join... 

Home Health Advantage INC.

Home Health Visiting RN/LPN South Chicago Job at Home Health Advantage INC.

 ...in Illinois seeking a high-energy, self-initiating, and caring RN/LPN who can work as a field nurse for the city of Chicago North side...  ...well compensated.This is a full time position but Part time or PRN are welcome to apply too. QUALIFICATIONS: 1. Graduate of a state... 

Inabia Software & Consulting Inc.

Project Manager Standard III SCRUM MASTER Job at Inabia Software & Consulting Inc.

 ...maximum 3 pages) in MS Word format, ensuring consistent font size and proper grammar. Job Title:Project Manager Standard III SCRUM MASTER Location: Washington DC (4 DAYS ON SITE IN DC) LOCALS ONLY Duration: Contract Rate: $46 - $48 per hour AZURE DEVOPS... 

LensCrafters

Licensed Optician Job at LensCrafters

 ...leader, Luxottica, our higher standard of quality has made LensCrafters a leader in vision care for over 35 years. The Licensed Optician delivers the brand value proposition & helps establish LensCrafters as the premier destination for all vision needs within the... 

North Florida Sales

Merchandiser Job at North Florida Sales

 ...product for resale. ~ Rotates all product, at every location on every stop, to ensure freshness per North Florida Sales and Anheuser Busch guidelines. ~ Builds displays as directed by Off Premise Sales Reps or store personnel. ~ Organizes and consolidates back stock...