Data Engineer with Databricks Developer (W2 Position)
Location: Washington, DC
Duration: 6+ Months
Job description :
Need 10+ years of experience as a Data Engineer
Databricks & AWS Big Data Architecture Certification would be plus.
Solid experience with SQL-based database is required.
Two-year experience with Hadoop/Spark in either an administrative, development or support role is required.
Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes.
Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data
Must have excellent coding skills either Python or Scala.
Must have experience in Data Engineering domain.
Must have implemented at least 2 project end-to-end in Databricks.
Must have experience on Databricks which consists of various components as below.
Delta lake
dbConnect
db API 2.0
Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept, Medallion architecture and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Preferred Qualifications/Skills
Good to have Unity catalog and basic governance knowledge.
Good to have MicroStrategy or Tableau reporting experience.
Good to have knowledge of docker and Kubernetes.
Good to have Linux/Unix Admin or development skills.
Please share profile's to sudheer@anveta.com
Overview We are currently seeking a Packaging Operator to join our team at our facility in Los Angeles, CA, 90024. The ideal candidate will have experience with FedEx Ship Manager, hold a Forklift License, and possess a High School diploma or GED. Responsibilities...
...| Front Line Team Members | (Programa de Beneficios de ABM) Basic Qualifications: Must be 18 years of age or older No high school diploma, GED or college degree required No experience required and on the job training provided Preferred Qualification: ~...
...into our systems and ensuring the integrity of the data. This is a remote position that offers flexibility and the opportunity to work from home. Responsibilities: Enter data accurately and efficiently into the company's database Verify data for accuracy and...
...efficient operation of our bakery department. Your expertise in assisting customers, preparing and packaging bakery products, and... ...sanitize daily Prepare bakery products Pack and label items for sale Decorate bakery items for sale and as requested by the customer...
...QUALIFIED Healthcare Professionals accepted) Physician Assistant - Physician Assistant OR Nurse... ...week in Portland, ME. We are a physical medicine office, and we utilize natural regenerative... ...medicine to treat arthritis, sports related injuries, and chronic pain. Our...