Senior Azure Data Engineer Job at Paul May Associates, New York, NY

ZGFJOE05VUZFd1NRd3AyN295cks5d3lkMEE9PQ==
  • Paul May Associates
  • New York, NY

Job Description

Job Title: Senior AZURE Data Engineer

Primary Location: This is a Direct Hire role that is Remote AND MUST reside in New York (NY), Washington DC ( WDC), BOSTON or CHICAGO IL area.

Position Type: Direct Hire

Compensation - The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications.

Overview

Senior Data Engineer - Candidates must have the following experience: Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Databricks and well versed with Tableau and PowerBi and be able to focus on getting data into Databricks. Candidate must have built pipelines of data and worked on developing frameworks, and ideally come from professional service industries including legal and finance. Must have strong job longevity and communication skills.

What You Bring to the Role. (Ideal Experience)
  • 7+ years of data engineering or BI development experience

  • 3+ years building data solutions in Microsoft Azure Cloud

  • 2+ years using Azure DevOps for automated builds, releases, and orchestration

  • Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2), and Azure Databricks

  • Strong SQL and ELT experience; familiarity with data modeling (e.g., star, snowflake)

  • Hands-on experience with PySpark and Databricks notebooks, including Delta Lake workflows

  • Experience building and managing CI/CD pipelines using Azure DevOps

  • Familiarity with Git, branching strategies, and Azure Repos

  • Understanding of data security and privacy in Azure (RBAC, encryption, managed identities)

  • Experience with structured and semi-structured data formats (Parquet, JSON, Avro)

  • Experience with Power BI datasets and refresh configurations (preferred)

  • Familiarity with Microsoft Purview or other data governance/cataloging tools is a plus

  • Experience in professional services, legal, or financial industries is preferred

  • Bachelor's degree in Computer Science, Engineering, or a related field

What You'll Do. (Skills Used in this Position)
  • Design, build, and manage scalable data pipelines using Azure ADF, ADLS, and Databricks

  • Develop ELT frameworks to ingest and transform data from on-prem and cloud sources

  • Implement CI/CD pipelines with Azure DevOps for code versioning and deployment

  • Monitor and optimize pipeline performance using Azure Monitor and Log Analytics

  • Support Power BI teams by ensuring performant and structured datasets

  • Automate environment setup and permissions using infrastructure-as-code

  • Write modular, testable code using Python/PySpark

  • Perform root cause analysis and production support for data pipelines

  • Maintain documentation for data processes and system architecture

  • Work within Agile teams, participating in sprints, standups, and retrospectives

  • Mentor junior data engineers and champion best practices in DevOps and development

Compensation Information
The expected salary range for this position is 140,000-160,000 for Chicago area and up to maybe $185k for NY and BOS, and maybe up to $170k for WDC per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off. is committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable state and federal regulations.


This role requires authorization to work in the U.S. without current or future visa sponsorship.


All offers are contingent upon the completion of a background check, which may include but is not limited to reference checks, education verification, employment verification, drug testing, criminal records checks, and any required certifications or compliance requirements based on the end client's background check policies and applicable laws.

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Job Tags

Remote job, Visa sponsorship,

Similar Jobs

State of Florida

FINANCIAL EXAMINER/ANALYST II - 43004497 Job at State of Florida

 ...COMPETITIVE EMPLOYMENT OPPORTUNITY***** DIVISION: CONSUMER FINANCE BUREAU: ENFORCEMENT CITY: WEST PALM BEACH COUNTY: PALM...  ...Qualifications for this position include the following REQUIRED ENTRY LEVEL KNOWLEDGE, SKILLS AND ABILITIES: # Knowledge of mathematics.... 

NSNA

Enterprise Systems Engineer Job at NSNA

 ...tier one supplier of instrument clusters and head-up display units for FCA US, General Motors, BMW, Honda, Harley Davidson, Suzuki, Polaris, Arctic Cat and other OEM's. Purpose of Job The Enterprise Systems Engineer will conduct a wide range of regional support and... 

Pride Health

Epic Analyst Job at Pride Health

Pride Global and its entities offer eligible employees comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance, and hospital indemnity), 401(k) retirement savings, life and disability insurance...

Get It Recruit - Educational Services

Barber Instructor - Remote | WFH Job at Get It Recruit - Educational Services

 ...Schedule and Availability: Day and evening positions available, including a partial work-from-home/remote schedule to offer...  ...Ownership Plan (ESOP). Paid Time Off: PTO and paid holidays. Growth...  ...Employer. Employment Type: Part-Time Salary: $ 20.00 23.00 Per... 

Indus International Corpora

Creative Designer Job at Indus International Corpora

Looking for someone for a part time job who has experience with creativity and Arts,painting ,creating gift hampers ,gift baskets for various occasions and functions This is a part time job if you are interested then please connect