Highlights
Architecture & Development: Design end-to-end data pipelines, ETL/ELT processes, and lakehouse storage patterns using Apache Spark, Delta Lake, and Python or SQL. - AI & Machine Learning Integration: Implement MLOps workflows, manage model lifecycles, or deploy generative AI and vector search solutions using tools like MLflow and Unity Catalog.
Numbers & Facts
| Location | Aurora, IL |
| Industry | Computer/IT Services |
| Company Size | 500 to 999 employees |
| Year Founded | 1990 |
| Website | http://q1tech.com/ |
Description
Databricks Specialist
Fulltim
NYC, NY(Onsite)
Job Description
Must Have Technical/Functional Skills
Experience: 5 to 10+ years in data engineering, software development, or solution architecture, with hands-on Databricks production experience.
Technical Stack: Strong proficiency in Python, SQL, or Scala; deep knowledge of Apache Spark runtime internals and Delta Lake.
Cloud Ecosystems: Working knowledge of major cloud platforms like Microsoft Azure, AWS, or GCP.
Certifications: Preferred credentials include Databricks Certified Data Engineer or Solutions Architect credentials. []
Roles & Responsibilities
- Architecture & Development: Design end-to-end data pipelines, ETL/ELT processes, and lakehouse storage patterns using Apache Spark, Delta Lake, and Python or SQL.
- Performance Tuning: Optimize cluster sizing, query execution, shuffles, partitions, and storage layouts for large-scale data workflows. [1]
- AI & Machine Learning Integration: Implement MLOps workflows, manage model lifecycles, or deploy generative AI and vector search solutions using tools like MLflow and Unity Catalog. [1]
- Collaboration & Consulting: Partner with enterprise stakeholders, data scientists, and software engineers to translate business requirements into technical solutions. [1]
- Administration & Governance: Oversee security configurations, access controls, workspace administration, and CI/CD deployment pipelines
About Company
Q1 consists of experienced and recognized experts providing the capability to respond to market demand in order to provide professional services for our clients including Enterprise software implementations, application integration and technical / functional support.
Q1 has steadily grown into a Quality IT services and solutions organization with the average experience of our team being over 10 years. We have continuously met or exceeded client expectations by delivering professional services and project implementations on time and under budget to help clients truly recognize return on investment.
