Q1 Technologies, Inc logo

Data Engineer - Databricks, Scala

Q1 Technologies, Inc

  • Quincy, MA
  • 12 days ago

    Highlights

    Must have atleast 8+ years of extensive Data engineering experience in Databricks, ETL/ELT using data pipelines, SQL/Procesurr experience. Must have 8 years of hands on development proficiency in implementing Databricks solutions using scala and spark with data frames and notebooks/sql.
    Q1 Technologies, Inc

    Numbers & Facts

    LocationQuincy, MA
    IndustryComputer/IT Services
    Company Size500 to 999 employees
    Year Founded1990
    Websitehttp://q1tech.com/

    Description

    Role: Data Engineer - Databricks, Scala
    Skills: Digital: Scala, Digital: Databricks Experience Required: 8-10 Years



    Databricks, Scala- Data Engineer

    Must have atleast 8+ years of extensive Data engineering experience in Databricks, ETL/ELT using data pipelines, SQL/Procesurr experience

    Must have 8 years of hands on development proficiency in implementing Databricks solutions using scala and spark with data frames and notebooks/sql

    Must have 8+ years of hands on development and performance tuning/ enhancement experience in scala/pyspark and sql

    Must have strong experience with Databricks, including developing and optimizing spark jobs, data transformations, and data processing workflows

    Must have experience and a good understanding on the below topics



    Databricks delta lake storage

    Unity catalog

    Autoloader

    Lakehouse architecture

    Medallion architecture

    Databricks serverless options

    Dataset and data frame

    Databricks clusters configuration and sizing

    Databricks job orchestration

    Spark structured streaming

    About Company

    Q1 consists of experienced and recognized experts providing the capability to respond to market demand in order to provide professional services for our clients including Enterprise software implementations, application integration and technical / functional support.

    Q1 has steadily grown into a Quality IT services and solutions organization with the average experience of our team being over 10 years. We have continuously met or exceeded client expectations by delivering professional services and project implementations on time and under budget to help clients truly recognize return on investment.

    Company Image

    Similar Jobs

    See more jobs