GCP Data Lead Engineer

Resource Logistics, Inc.

  • 100 % Remote, TN
  • 6 days ago
  • Remote

    Highlights

    We are seeking an experienced GCP Data Engineer with strong expertise in MS SQL Server, Python, Google BigQuery, and Google Cloud Dataflow to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate will be responsible for building data pipelines, optimizing data processing workflows, and supporting enterprise analytics and reporting requirements.

    Numbers & Facts

    Location100 % Remote, TN (
    Remote
    )
    IndustryMedical Devices and Supplies
    Company Size500 to 999 employees

    Description

     
     
      
    Title : GCP Data Lead Engineer
    Location : Nashville , TN (Remote is ok)
    Long term Contract W2
    Mandatory SkillsAI Data Engineering
    JDJob Description – GCP Data Engineer (MS SQL, Python, BigQuery, Dataflow)
    Job Title  GCP Data Engineer

    Job Summary
    We are seeking an experienced GCP Data Engineer with strong expertise in MS SQL Server, Python, Google BigQuery, and Google Cloud Dataflow to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate will be responsible for building data pipelines, optimizing data processing workflows, and supporting enterprise analytics and reporting requirements.
    Key Responsibilities

    Design, develop, and maintain scalable ETL/ELT pipelines using GCP Dataflow and Python.
    Develop and optimize BigQuery datasets, tables, views, partitioning, and clustering strategies.
    Create and maintain complex SQL queries, stored procedures, functions, and database objects in MS SQL Server.
    Migrate and integrate data from on-premises databases and various source systems into GCP.
    Implement data quality, validation, reconciliation, and monitoring frameworks.
    Work with Cloud Storage (GCS), BigQuery, Dataflow, and Composer/Airflow for end-to-end data processing.
    Analyze performance bottlenecks and optimize large-scale data workloads.
    Build reusable Python components for data ingestion, transformation, and automation.
    Collaborate with business stakeholders, Clienthitects, and data analysts to understand requirements.
    Ensure data security, governance, and compliance standards are followed.

    Required Skills

    Strong experience in MS SQL Server (SQL, Stored Procedures, Views, Functions, Performance Tuning).
    Proficiency in Python for data engineering and automation.
    Hands-on experience with Google BigQuery.
    Experience developing data pipelines using Google Cloud Dataflow (Apache Beam).
    Knowledge of GCP services such as Cloud Storage, Pub/Sub, Cloud Composer, IAM, and Monitoring.
    Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling concepts.
    Experience with source control tools such as Git.
    Knowledge of Agile/Scrum methodologies.
     
     

    Similar Jobs