Senior RunOps Azure Data Engineer Job at Tata Consultancy Services, Deerfield, IL

b0hTUG5lclAxd2VaK3R1czdqc0hHZFJ4VlE9PQ==
  • Tata Consultancy Services
  • Deerfield, IL

Job Description

Role: Senior RunOps Azure Data Engineer

Location: Deerfield, IL ,USA(Onsite)

Job Type: Full Time

Job Description:

Must Have Technical/Functional Skills

• A Minimum of 5 Years' experience

• Design & Develop data pipelines ETL/ELT solutions using Azure Data Factory, Databricks, and Synapse Analytics to process structured and unstructured data.

• Implement and manage Azure Data Lake, Azure SQL Database and other data storage solutions.

• Optimize data workflow and ensure data integrity using SQL/Synapse and other tools on Azure.

• Azure Data Services: - Azure Data Factory, Databrick, Azure Synapse Analytics, Azure Data Lake.

• Databases & Storage: -SQL Server, Azure SQL Database, Blob storage, Synapse Analytics.

• Cloud Integration: Connect and integrate data source from on-prime, cloud and third-party APIs into Azure -based System.

• Performance Optimization: Monitoring and enhance query performance, cost efficiency and scalability of data platform.

• Automation and DevOps: Implement CI/CD pipeline for data workflows using Azure DevOps with tools like ARM templates.

Roles & Responsibilities

Production support & Monitoring:

• Act as the primary escalation point for complex issues related to Azure Data factory, Databricks.

• Monitor and troubleshoot data ingestion pipelines to ensure smooth data flow for digital marketing campaigns.

• Perform root cause analysis (RCA) and implement permanent fixes for recuring issues.

• Working Closely with team, providing guidance and resolving critical incident.

Data Pipeline Management (Azure Data factory & Databricks)

• Manage and optimize ETL/ELT pipeline in Azure Data Factory and Databricks for data ingestion.

• Implement data validation and error -handling mechanisms to maintain data integrity.

Adobe Campaign Classic Support & Digital Marketing data integration:

• Ensure seamless data flow from Azure to Adobe Campaign Classic for marketing campaign execution.

• Support Campaign team by troubleshooting data sync issues, segmentation errors and delivery failures

Incident & Problem management:

• Handle high priority incidents, perform impact analysis and communicate resolution timelines.

• Implement long-term fixes and preventive measures to minimize recurring issues.

• Work with Adobe support and Microsoft Azure team for vendor escalations and resolution.

Performance Tunning & Optimization:

• Monitor and improve Azure data factory pipeline execution times and data bricks cluster performance

• Fine-Tune query performance for large -scale data ingestion.

• Ensure Adobe Campaign classic campaigns run efficiently with o ptimized data input.

Documentation and Knowledge Sharing

• Maintain Detailed SOPs, troubleshooting guides and runbooks.

• Conduct training session for team members on Azure Data factory, data brick and Adobe Campaign classic best practices. Document incident resolutions and RCA reports for future reference.

Generic Managerial Skills, If any

Preferred but not mandatory. The Candidate must primarily be a technical lead with hands-on development expertise.

Job Tags

Permanent employment, Full time,

Similar Jobs

DCPS

Finance - Summer Internship Job at DCPS

 ...Job Description Job Description Position Overview: We are seeking a motivated and detail-oriented Finance Intern to join our team this summer. The successful candidate will work closely with our Finance department, gaining practical experience in financial analysis... 

Keurig Dr Pepper Inc.

Senior Packaging Engineer, R&D Cold Beverage Job at Keurig Dr Pepper Inc.

 ...programs designed to enhance your professional growth and development while ensuring you feel valued, inspired and appreciated at Keurig Dr Pepper. Requirements: ~ Bachelors degree in packing engineering or related engineering field ~5+ years of Packaging... 

Altar'd State

SAP Product Owner Job at Altar'd State

 ...welcoming experiences and warm associates to thoughtfully curated products, our brands are built upon the founding principles of giving...  ...meaningful ways to those in need. The Role The Product Owner is a member of the IT Development Team and has accountability... 

Fisher Investments

Responsible Investment Product Manager Job at Fisher Investments

 ...Investments & asset management Why Fisher Investments: We work for a bigger purpose: bettering the investment universe. We take...  ...may have the opportunity to participate in our hybrid work from home program. This program is subject to change. FISHER... 

Kabam

Preditor / Graphic and Motion Designer (Contractor) Job at Kabam

Preditor / Graphic and Motion Designer (Contractor) PRODUCTION PM - Currently HiringHybridApplication Information Apply with your full LinkedIn profile. Let the employer know what pronouns you use so that they can address you correctly.PhoneCurrent companyLinks LinkedIn...