TrentonRecruiter Since 2001
the smart solution for Trenton jobs

Databricks Engineer

Company: Diverse Lynx
Location: Princeton
Posted on: January 26, 2023

Job Description:




SN
Required Information
Details


1
Role
Databricks Engineer


2
Required Technical Skill Set
Databricks on AWS


3
No of Requirements
1


4
Desired Experience Range
8-10 years


5
Location of Requirement
US








Desired Competencies (Technical/Behavioral Competency)


Must-Have


  • Designing and implementing highly performant data ingestion pipelines from multiple sources using Databricks on AWS
  • Developing scalable and re-usable frameworks for ingesting large data sets and moving them from Bronze to silver and from Silver to Gold layer in databricks.
  • Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
  • Working with event based / streaming technologies to ingest and process data
  • Proficient in writing Spark code in below languages: Scala, Python, or SQL
  • Pro-code skills
  • Experience with cloud-based architectures in AWS, Azure
  • Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB
  • Experience with databases and data warehousing
  • Read and write data in AWS Databricks
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints
  • Experience working with large scale data processing services (Hadoop)




    Good-to-Have


    • Background in machine learning or working with Client tools and services











      Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.


Keywords: Diverse Lynx, Trenton , Databricks Engineer, Engineering , Princeton, New Jersey

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest New Jersey jobs by following @recnetNJ on Twitter!

Trenton RSS job feeds