
Loading…

Loading…

Loading job…
Capgemini [CGEMJP00304774]
Location
Job type
Workplace
Duration
Posted
Compensation
Job Description Description:
"Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential
Submit candidates under their legal name and use only Capgemini template"
Role: 0NTDPI - Lead Data Engineer – Azure Platform Work location: Houston, TX - remote. Background check MANDATORY Request ID: 0NTDPI Pursuit
"The main visas we should accept are the following: H1B L-2 EAD H-4 EAD AOS EAD Green Card Holder US Citizen***"
JOB DESCRIPTION Note: Extension to year end is very likely. Client has asked for additional scope with approval pending.
We are seeking a highly skilled and hands-on Lead Data Engineer with deep expertise in Azure-native services to lead the design, development, and deployment of a large-scale, high-performance data platform. The ideal candidate will architect and implement data pipelines capable of processing structured and unstructured data (including videos and images) at scale, drive data quality, and enable analytics and reporting via Synapse and Azure SQL DB. Key Responsibilities:
? Solution Design & Architecture Lead the design of scalable and maintainable data architectures using Medallion architecture in ADLS. Perform in-depth analysis of data sources (structured, images, and videos) and architect integration strategies. Design for scalability, performance, and cost-optimization.
? Data Ingestion & Integration Design and build ingestion pipelines from on-prem and cloud sources to ADLS Raw Zone. Work on batch ingestion of large media files (videos ~50GB each) and event-driven pipelines for processing upon arrival.
? Data Processing & Transformation Implement data transformations using PySpark, Databricks, and Azure Synapse Pipelines. Extract meaningful frames and metadata from videos/images using Azure AI Services and ACA (Azure Container Apps).
? Data Quality & Governance Build quality checks, reconciliation logic, and validation frameworks in pipelines. Implement metadata capture, lineage, and versioning.
? Security & Compliance Ensure encryption at rest and in transit, access control, and data masking using Azure Key Vault, Managed Identities, and RBAC.
? Data Storage & Reporting Optimize storage structures within ADLS Gen2 for raw, refined, and curated zones. Enable downstream consumption in Synapse and Azure SQL Database.
"Mandatory:
Please use candidate's legal name always Please add the candidate’s ID at the end of resume Videocalls for interviews are a MUST Please add in the comments section for each Candidate the following:"
Please send Candidates with this information Possible 3 Month CTH Legal name: Location (USA, City and State): Relocate? Rate: Travelling availability (if required) Availability: Phone #: Mobile#: LinkedIn: Skype ID: Email address: Visa type: Visa expiring date: Hiring Status: If ex Capgemini employee (Y/N): If yes, please share client's name, manager and email. If the resource has a visa, what company owns it? Are you working directly with the contractor’s visa holder? Had the contractor worked in Capgemini before SKYPE INTERVIEW IS MANDATORY
Resumes will be rejected for the following reasons:
Different format
Missing details in comments section
Missing text box in the header
Photo ID included containing personal information other than legal name and photo
Estefania Ocheita External Resource Manager (ERM) | SubCo Staffing Center Capgemini North America | Guatemala
Enable Skills-Based Hiring
No
Named Job Posting? (if Yes - needs to be approved by SCSC)
try { var fgTooltip = new FG.Tooltip({ element: $('#cf_descz1901221542246011397492e'), text: "To\x20be\x20populated\x20with\x20\x22Yes\x22\x20when\x20Job\x20Seeker\x20to\x20be\x20onboarded\x20is\x20already\x20known\x20at\x20the\x20time\x20of\x20Job\x20Posting\x20creation.\x20Must\x20be\x20approved\x20by\x20SCSC." }).initialize(); } catch(err) {}
Additional Details Global Grade : CNamed Job Posting? (if Yes - needs to be approved by SCSC) : NoRemote work possibility : NoGlobal Role Family : 60242 (P) Data ManagementGlobal Technical Skills Family : 6341 (T) Data Science and AnalyticsLocal Role Name : Lead Data Engineer – Azure PlatformLocal Skills : Hannah MutchLanguages Required: : English