Azure Data Engineer/Azure/Capital Markets/Hedge Fund - Hybrid/Dallas , TX - 1 year+ Job at Gandiva Insights, Texas

ZTZZK01kTURIZ2VUenArNm95WEsrQStmMkE9PQ==
  • Gandiva Insights
  • Texas

Job Description

Senior Data Engineer

Location:- Dallas, TX

Duration:- 12+ Months

Job Description:

Education:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field (Engineering or Math preferred).

Technical Skills:

  • Programming & Tools:
    • 10+ years of experience in SQL , Python . .Net is a plus.
    • 5+ years of experience in Azure cloud services , including:
      • Azure SQL Server
      • Azure Data Factory (ADF)
      • Azure Databricks (highlighted expertise)
      • Azure Data Lake Storage (ADLS)
      • Azure Key Vault
      • Azure Functions
      • Logic Apps
    • 5+ years of experience in GIT and deploying code using CI/CD pipelines .
  • Certifications (Preferred):
    • Microsoft Certified: Azure Data Engineer Associate
    • Databricks Certified Data Engineer Associate or Professional

Soft Skills:

  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Ability to work independently and collaboratively within a team.
  • Attention to detail and a commitment to delivering high-quality work.

Responsibilities:

  1. Data Pipeline Development:
    • Create and manage scalable data pipelines to collect, process, and store large volumes of data from various sources.
  2. Data Integration:
    • Integrate data from multiple sources, ensuring consistency, quality, and reliability.
  3. Database Management:
    • Design, implement, and optimize database schemas and structures to support data storage and retrieval.
  4. ETL Processes:
    • Develop and maintain ETL (Extract, Transform, Load) processes to ensure accurate and efficient data movement between systems.
  5. Data Warehousing:
    • Build and maintain data warehouses to support business intelligence and analytics needs.
  6. Performance Optimization:
    • Optimize data processing and storage performance for efficient resource utilization and quick data retrieval.
  7. Documentation:
    • Create and maintain comprehensive documentation for data pipelines, ETL processes, and database schemas.
  8. Monitoring and Troubleshooting:
    • Monitor data pipelines and systems for performance and reliability, troubleshooting and resolving issues as they arise.
  9. Technology Evaluation:
    • Stay updated with emerging technologies and best practices in data engineering, evaluating and recommending new tools and technologies as appropriate.

Thanks

Chandra Shekhar Kumar

[email protected]

Job Tags

Full time, Part time, Internship, Seasonal work,

Similar Jobs

Paws 'n Claws - Girard

Kennel Tech Job at Paws 'n Claws - Girard

 ...kennels, boarding cat condos, and birds. Walking dogs to the outdoor play yard and exercising and / or observing their exercise. Odds and ends tasks to keep our guests happy and safe. Qualifications Must love pets! This is a great starter job for young... 

SAIC

Principal Software Engineer Job at SAIC

**Description**SAIC is seeking a **Principal Software Engineer** to support advanced Very Low Frequency (VLF) communication systems. This candidate will need to be a certified Scrum Master. Join our innovative team in San Diego, CA, and contribute to mission-critical... 

Cumberland Hospital for Children and Adolescents

Teacher - General Education Job at Cumberland Hospital for Children and Adolescents

 ...Responsibilities Cumberland Hospital for Children and Adolescents is a unique acute care, inpatient specialty hospital with 110 licensed beds, including Med Surg. and Residential Treatment Center; staffed by the finest physicians and treatment teams. We treat patients... 

Quantaleap

Senior Data Analyst Job at Quantaleap

Role : Data Analyst Client: State of LA Location: Remote Duration: Longterm The scope of the proposed services will include the following: Support grant management activities with USDA, eScholar and FNS; Produce data... 

Robert Half

Affordable Housing Property Manager - HUD Certified Job at Robert Half

Description We're hiring a Property Manager to oversee the operations of affordable housing properties! Ideal candidates will have expertise in HUD compliance, Tax Credit regulations, Section 8 programs, and income certifications.Key Responsibilities:+ Manage daily...