Data Engineer

Veterans Sourcing Group

Scottsdale, AZ

Apply

JOB DETAILS

SKILLS

Agile Programming Methodologies, Amazon Web Services (AWS), Analysis Skills, Application Programming Interface (API), Atlassian JIRA, Banking Services, Bash Scripting, Best Practices, C Programming Language, C++ Programming Language, Cisco Unity, Cloud Computing, Communication Skills, Computer Science, Data Analysis, Data Lake, Data Management, Data Modeling, Data Profiling, Data Quality, Data Recovery, Data Storage, Data Warehousing, Database Design, Database Extract Transform and Load (ETL), Database Optimization, Database Technology, DevOps, Docker, GCP (Good Clinical Practices), GitHub, Identify Issues, Industry/Trade Analysis, Information Technology & Information Systems, Interpersonal Skills, JSON, Java, JavaScript, Jenkins, Microsoft Excel, Microsoft Office, Microsoft PowerPoint, Microsoft SQL Server, Microsoft Windows Azure, Microsoft Word, Multitasking, Performance Tuning/Optimization, Power BI, Power Engineering, Problem Solving Skills, Programming Languages, Python Programming/Scripting Language, REST (Representational State Transfer), Reporting Dashboards, SQL Databases, SQL Server Integration Services (SSIS), Scala Programming Language, Technical Writing, Unix Operating Systems, Unix Shell Programming, Validation Testing, Windows PowerShell

LOCATION

Scottsdale, AZ

POSTED

30+ days ago

Sr Data Engineer
Location: Phoenix, AZ (Hybrid)
12 months+
Experience: 10+ Years

Key Responsibilities:

• Solid experience with Database design practices and data warehousing concepts.
• Design, develop, and maintain data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse.
• Hands on experience delivering data reporting requirements on On-Prem SQL Servers using SSIS and/or other integration processes.
• Expertise with coding and implementing data pipelines in cloud-based data infrastructure in batch and streaming ETL using Azure Data Factory, Spark, Python, Scala on Databricks.
• Experience working with Azure data lake storage and Azure SQL Databases.
• Experience working with Databricks Delta Lake and Medallion Architecture and Unity Catalog.
• Optimize data ingestion and transformation processes to ensure efficient and scalable data flows, Monitor and optimize database performance, including query tuning and index optimization.
• Develop and maintain data models, schemas, and data dictionaries for efficient data storage and retrieval.
• Perform data analysis, data profiling, and data cleansing to ensure data quality and accuracy,data validation, quality checks, and troubleshooting to identify and resolve data-related issues.
• Develop Power BI dashboards, reports, and visualizations to effectively communicate data insights. Implement data transformations, data modeling, and data integration processes in Power BI.
• Create and maintain technical documentation related to database structures, schemas, and Reporting solutions.
• Experience with MS office tools like excel, word, power point.
• Experience working with build and deploy tools Azure DevOps, GitHub, Jenkins.
• Experience working on an Agile Development team and delivering features incrementally using Jira and Confluence.
• Stay up to date with industry trends and best practices in data engineering, Power BI and proactively recommend and implement improvements to our data infrastructure.
• Ability to multi-task, be adaptable, and nimble within a team environment.
• Strong communication, interpersonal, analytical and problem-solving skills.

Preferred:
• Experience with API/REST, JSON
• Experience in Banking and Financial Domains.
• Industry certification – Azure/GCP/AWS
• Familiarity with a variety of programming languages, like Java, JavaScript, C/C++.
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable.
• Experience with Power Automate and Power Apps.
• Experience with Collibra Data Lineage and Data Quality Modules.

Education: Bachelor's degree in computer science or information system along with work experience in a related field.

Data Engineer

Veterans Sourcing Group

Scottsdale, AZ

About the Company

Veterans Sourcing Group

Similar Job Searches