Senior Data Engineer (Databricks) Job at Infinitive Inc, Ashburn, VA

bk5jU0dDNDZuMm5iNytEcVc4RXR2ajJOalE9PQ==
  • Infinitive Inc
  • Ashburn, VA

Job Description

*Candidates must possess work authorization which does not require sponsorship by the employer for a visa.

About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment. Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 7 times most recently in 2024. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”


Job Summary: 
We are seeking a highly skilled Data Architect with extensive experience in Databricks on AWS or Azure to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data architectures, ensuring data integrity, and optimizing data flow and collection. This role requires a deep understanding of cloud-based data solutions and strong expertise in leveraging Databricks to drive data initiatives. 

Key Responsibilities: 

  • Design, develop, and implement data architectures and solutions on Databricks in both AWS and Azure. 

  • Collaborate with stakeholders to understand business requirements and translate them into technical specifications. 

  • Develop and maintain ETL processes to ensure efficient data flow and integration across systems. 

  • Ensure data quality, integrity, and security in all data-related activities. 

  • Optimize data storage and retrieval strategies to improve performance and cost-efficiency. 

  • Lead the implementation of data governance policies and procedures. 

  • Provide technical guidance and mentorship to data engineering teams. 

  • Stay updated with the latest industry trends and best practices in data architecture, Databricks, cloud data warehouses, AWS and Azure. 

Required Skills and Qualifications: 

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field. 

  • Proven experience as a Data Architect, with a strong focus on Databricks. 

  • Proficiency in Databricks, including the ability to build and optimize Spark applications. 

  • Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. 

  • Strong knowledge of Unity Catalog and its application in managing and securing data assets. 

  • Strong knowledge of data modeling, ETL processes, and data warehousing concepts. 

  • Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark). 

  • Familiarity with data governance and data security practices. 

  • Databricks Certified Associate. 

  • Excellent problem-solving skills and attention to detail. 

  • Strong communication and collaboration skills. 

Preferred Qualifications: 

  • AWS Certified Solutions Architect or similar certification. 

  • Databricks Certified Professional. 

  • Experience with other cloud platforms (e.g., Azure, GCP). 

  • Knowledge of machine learning and data science concepts. 

  • Experience with data visualization tools (e.g., Tableau, Power BI). 

  • Prior experience in a leadership or mentorship role. 

Job Tags

Full time,

Similar Jobs

CRH

Ready-Mix Truck Driver Job at CRH

 ...CRH Company, is a leading supplier of aggregates, asphalt, and ready-mixed concrete in Butte, MT and Anaconda, MT. Position...  ...ability to work and communicate well with Supervisors, Truck Drivers, Heavy Equipment Operators, and other employees. Demonstrates... 

Closets by Design Indianapolis

Sales / Designer - Fun & Creative Job at Closets by Design Indianapolis

Sales/Designer - Fun & CreativeYou can help others organize their home. As a Closets by Design Designer, you can enjoy the flexibility of working from your home and our clients' homes. We provide pre-set appointments with nice people just like you, close to your home... 

Adelphi Medical Staffing

Radiology Job at Adelphi Medical Staffing

 ...Job Quick Facts: Specialty: Radiology - General + Flouro, Light IR or Mammo Job Type: Locum Tenens Facility Location: Asheboro, NC Service Setting: Outpatient/Inpatient/Remote Reason For Coverage: Supplemental Coverage Period: Nov 1, 2024 -... 

Banner Health

Academic Minimally Invasive Gynecologist Opportunity | Banner University Phoenix Job at Banner Health

 ...desire to be part of a growing OBGYN Academic Medicine program within Banner University Medicine.Responsibilities include the integration and alignment of all clinical and academic assets of Banner Health and the University of Arizona College of Medicine, Phoenix to... 

WESTERN NEW YORK LAW CENTER INC

Community engagement paralegal Job at WESTERN NEW YORK LAW CENTER INC

 ...community members and municipalities. WNYLC is a nonprofit legal services provider. Founded in 1996, WNYLC exists to promote human and civil rights with an overarching commitment to racial and economic justice. To further that mission, WNYLC provides legal services to...