Icon hamburger
US
What job do you want?
Apply to this job.
Think you're the perfect candidate?
Apply Now
Thumsup

You’re being taken to an external site to apply.

Enter your email below to receive job recommendations for similar positions.
I331136gn3zddhz6blm

Data Engineer

Fahrenheit IT MIDDLE CITY WEST Full-Time
$90,000.00/ year
Apply Now

You will support the engineering team’s data endeavors, diving in to fix issues, optimize processes, and automate what you do more than once.  You’ll use the best tools for the job, whether modern and revolutionary or time tested and proven, to deliver elegant, scalable solutions that meet business and technical needs.
 

Responsibilities:

Work with internal stakeholders to load data into the data warehouse

Troubleshoot and resolve issues relating to data integrity

Help establish procedures and best practices for transforming and storing data

Lead requirements gathering around data pipeline automation improvements

Work with some of the most exciting open-source tools like Spark, Hadoop, Docker, Airflow, Zeppelin

Leverage distributed computing and serverless architecture such as AWS EMR & AWS Lambda, to develop pipelines for transforming data

Solve complex problems related to the real-time discovery of large data

Required skills and experience

5+ years of work experience

3+ years of experience with Python

3+ years of experience with PySpark and Spark-SQL (writing, testing, debugging spark routines)

1+ years of experience with AWS EMR, AWS S3 service. Comfortable using AWS CLI and boto3

Comfortable working in remote environments

Comfortable using *nix command line (shell scripting, AWK, SED)

Experience with MySQL and Postgres
 

Desired experience

Experience with Apache Airflow

Experience with Apache Zeppelin

Experience with healthcare data

 

Recommended skills

Aws Command Line Interface (Cli)
Aws Lambda
Boto3
Docker
Data Pipeline
Amazon Web Services
Apply to this job.
Think you're the perfect candidate?
Apply Now

Help us improve CareerBuilder by providing feedback about this job: Report this job

Report this Job

Once a job has been reported, we will investigate it further. If you require a response, submit your question or concern to our Trust and Site Security Team

Job ID: BHJOB22580_166564

CAREERBUILDER TIP

For your privacy and protection, when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction. Learn more.

By applying to a job using CareerBuilder you are agreeing to comply with and be subject to the CareerBuilder Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.