Data Engineer - Databricks
Open Systems Technologies
New York, NY
Pay: $100-130/hr
US Citizens or GC Holders Only
No c2c - W2 Only
Qualifications:
A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field 7+ years of experience in designing and building large-scale solutions in an enterprise setting 3+ years designing and building solutions in the cloud Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures Deep SQL expertise, data modeling, and experience with data governance in relational databases Experience with the practical application of data warehousing concepts, methodologies, and frameworks using traditional (Vertica, Teradata, etc.) and current (SparkSQL, Hadoop, Kafka) distributed technologies Refined skills using one or more scripting languages (e.g., Python, bash, etc.) Embrace data platform thinking, design and develop data pipelines keeping security, scale, uptime and reliability in mind Expertise in relational and dimensional data modeling UNIX admin and general server administration experience Experience with leveraging CI/CD pipelines Presto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience using Spark, Kafka, Hadoop, or similar distributed data technologies is a plus Experience with Agile methodologies and able to work in an Agile manner is preferred Experience using ETL/ELT tools and technologies such as Talend, Informatica is a plus Expertise in Cloud Data Warehouses in Redshift, BigQuery or analogous architectures is a plus
About the Company
Open Systems Technologies
At OST, we’re a bit like what you may call a machine, but with a more human touch. Day in and day out for the last 28 years we’ve been more than just a staffing company. Throughout this time we’ve built relationships, we’ve grown together internally and externally, and have created a system that allows us to personally cater to the needs of our clients and candidates. As we celebrate this occasion, it important to note that for us, 28 years is more than just a number or an anniversary. It is 28 years of relationships, 28 years of trust, and 28 years of total reliability. We’ve been a mentor for some, a team builder for others, but most importantly we’ve been there. We know there is no substitute for experience, so let us help you navigate through the ever changing web of talent.
Operating in a crowded marketplace, we have succeeded by staying ahead of the curve. No two projects are the same, and neither are our solutions. We’ve got the connections. We know the people. We have the opportunities. How soon can you start?