US
0 suggestions are available, use up and down arrow to navigate them
What job do you want?

Lead Data Engineer job in Chicago at FactSet Research Systems Inc.

Create Job Alert.

Get similar jobs sent to your email

List of Jobs

Apply to this job.
Think you're the perfect candidate?
Lead Data Engineer at FactSet Research Systems Inc.

Lead Data Engineer

FactSet Research Systems Inc. Chicago, IL Full-Time
The TVL data pipeline is the backbone of the award winning ESG data delivery platform that Truvalue Labs (now FDS) has won numerous awards for. As leaders in this space it is critical that we continue to innovate and architect a data pipeline that meets the ongoing challenges of this space. This role is for a Senior Data Engineer who will be joining a seasoned team of engineers. Working directly with the data processing pipeline team as we architect the next generation pipeline and integrate into the FDS cloud ecosystem. Our pipeline processes >1M documents per day and routes each data point through a complex system of AI components as we mine essential and salient information, to create a robust data set for our financial systems customers.

We love the complexity of our space as it challenges us to balance recall and precision while also designing for speed and scalability. We are passionate about what we do and the quality that we deliver. No dull moments and lots of great results. We are looking for a colleague who will be hands on as well as a leader, as we grow this team to take on new and exciting challenges in the Content Engineering space. If you have the credentials prescribed below and are looking for a fun, hardworking team to join, and are looking to become part of a next generation system, come talk to us.

Responsibilities:

* Think and communicate critically about architecture, design, and best practices

* Collaborate with other engineers and Product Developers in an agile scrum environment

* Estimate task sizes and regularly communicate progress in daily standups and biweekly Scrum meetings

* Perform code reviews and coach engineers with respect to best practices

* Coordinate with other teams across offices and departments

* Working with Agile development practices

Required Skills:

* Bachelor's degree or higher in Computer Science or related technical field

* Experience leading a team of developers (leading establishment of good development/testing/documentation practices for a team)

* Strong technical, analytical, troubleshooting, and communication skills

* Experience building and deploying production level services

* Experience using Confluence and Jira tools

* 3+ years Big data processing experience with Pyspark and/or Hadoop/ Airflow

* 3+ years experience in System design for data intensive processes (setting up cloud infrastructure, monitoring, data loss recovery)

* Delivering code with automated testing (unit testing/integration tests/end-to-end tests)

* Automated deployment experience (terraform, infrastructure as code)

* Experience with stream and batch processing

* Experience working with machine learning engineers (creating tools and processes for providing data, integrating ML models in a production environment)

* Technologies/Languages
* AWS [EC2, ECS, ECR, S3 DocumentDB, SQS, Route53, AMI, Cloudwatch

* Docker

* JupyterHub

* Shell scripting

* NoSQL (SQL nice to have)

* Python (pandas/numpy/pytest)

* Javascript


* Great verbal and communication skills

* Loves technology and people

FactSet is an Equal Opportunity Employer - M/F/Veteran/Disability/Sexual Orientation/Gender Identity

Recommended Skills

  • Agile Methodology
  • Airflow
  • Amazon Elastic Compute Cloud
  • Amazon S3
  • Amazon Simple Queue Service (Sqs)
  • Analytical
Apply to this job.
Think you're the perfect candidate?

Help us improve CareerBuilder by providing feedback about this job:

Job ID: 2320859804

CareerBuilder TIP

For your privacy and protection, when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction. Learn more.

By applying to a job using CareerBuilder you are agreeing to comply with and be subject to the CareerBuilder Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.