Lead Azure Data Engineer Job at Cloud Analytics Technologies LLC, Alpharetta, GA

VGtEZkk0bm90V2o3TGFzL3FldGRzckpPQmc9PQ==
  • Cloud Analytics Technologies LLC
  • Alpharetta, GA

Job Description

Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks.
• Build and optimize data ingestion, transformation, and processing workflows across batch and real-time data streams.
• Work extensively with ADLS, Delta Lake, and Spark (Python) for large-scale data engineering.
• Lead the development of complex ETL/ELT pipelines, ensuring high quality, reliability, and performance.
• Design and implement data models, including conceptual, logical, and physical models for analytics and operational workloads.
• Work with relational and lakehouse systems including PostgreSQL and Delta Lake.
• Define and enforce best practices in data governance, data quality, security, and architecture.
• Collaborate with architects, data scientists, analysts, and business teams to translate requirements into technical solutions.
• Troubleshoot production issues, optimize performance, and support continuous improvement of the data platform.
• Mentor junior engineers and contribute to building engineering standards and reusable components.

Job Tags

Similar Jobs

UTMB Health

Research Technician, Biochemistry & Molecular Biology (Galveston) Job at UTMB Health

Minimum Qualifications: Associate's degree in basic science or equivalent and 1 year of related experience. Job Summary: We are seeking a motivated, detail-oriented technician to support daily operations of a molecular genetics research laboratory. This role is...

US Veterans Health Administration

Social Worker - Primary Care Mental Health Integration (PCMHI) Job at US Veterans Health Administration

 ...PCL, AUDIT C, etc.) as available in Behavioral Health Laboratory Software (BHL - Web, Touch, or other iterations) or Mental Health Assistant. Treatment Planning/Goal...  ...the Veteran's and family's need for an advocate and acts on the patient and family's behalf when... 

Emmanuel Gospel Center

Bookkeeper Job at Emmanuel Gospel Center

 ...support leaders, and address community needs. We are seeking a Bookkeeper who brings accuracy, consistency, and care to day-to-day...  ...insurance ~ Health insurance ~ Paid time off ~ Retirement plan Work Location: Hybrid remote in Dorchester Center, MA 02124... 

Express Employment - Springfield, IL

Mechanical Systems Reliability Technician — Millwright Job at Express Employment - Springfield, IL

 ...next move? Do you enjoy solving tough mechanical problems and keeping complex machinery...  ...implement fixes fast. Are comfortable installing, aligning, relocating, and dismantling...  ...Drives (VFD) Programmable Logic Controller (PLC) Conveyor systems Servo motors... 

Vista Equity Partners Management, LLC

Remote Product Demo Engineer Job at Vista Equity Partners Management, LLC

 ...prospective partners. The ideal candidate will collaborate with various teams and utilize tools like Axure and Figma. This role is open to remote work across the continental United States and offers competitive compensation along with a comprehensive benefits package. #J-188...