TrentonRecruiter Since 2001
the smart solution for Trenton jobs

Senior Data Engineer

Company: FactSet Research Systems Inc.
Location: Piscataway
Posted on: November 22, 2021

Job Description:

FactSet is seeking a Senior Data Engineer with experience enabling machine learning systems. This role will develop and maintain large-scale ETL and feature engineering tasks to transform and organize financial data and unstructured text/JSON content into an environment that facilitates large scale batch analytics, data science, and machine learning. The role is located within the Content Engineering AI Team, reporting to VP, Director of AI, and will support the delivery of algorithms to improve data quality and product enhancements. Experience with AWS ETL infrastructure (Athena, Glue, S3) and big data tooling (PySpark, Hive, etc.) is required. Required Skills and Experience

  • Technologies
  • AWS (Athena, Glue, S3, EC2, ECS, ECR, DocumentDB, etc.)
  • Docker
  • Shell scripting
  • Languages: Python (Pandas, Numpy, Pytest)
  • 3+ years Big data processing experience with Pyspark, Hive, and/or Hadoop
  • 3+ years experience processing unstructured data (e.g. news articles, financial filings, web data)
  • System design for data intensive processes (setting up cloud infrastructure, monitoring, data loss recovery)
  • Delivering code with automated testing (unit testing/integration tests/end-to-end tests)
  • Automated deployment experience (terraform, infrastructure as code)
  • Experience with stream and batch processing
  • Working with Agile development practices
  • Bachelor's degree or higher in Computer Science or related technical field Desired skills and experience
    • Working with machine learning engineers (creating tools and processes for providing data, integrating ML models in a production environment)
    • Experience drafting project timelines and milestones and reporting progress to stakeholders
    • Experience developing data lake to support ML and analytics
    • Networking
    • Experience with API development, data visualization, or analytics dashboards
    • Technologies:
    • Dask
    • MongoDB
    • RabbitMQ
    • Process Management: PM2/Supervisor
    • Airflow
    • Jenkins FactSet is an Equal Opportunity Employer - M/F/Veteran/Disability/Sexual Orientation/Gender Identity

Keywords: FactSet Research Systems Inc., Trenton , Senior Data Engineer, Engineering , Piscataway, New Jersey

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest New Jersey jobs by following @recnetNJ on Twitter!

Trenton RSS job feeds