Enterprise Data Solution Architect

Job Title: Enterprise Data Solution Architect
Location: New York, NY
Duration: 6 months (Extendable)
Pay Range: $55-58/Hour on W2/C2C (All Inclusive)
Request ID: 114989-1

We are seeking an experienced Enterprise Data Solution Architect to lead large-scale data modernization initiatives within the Life & Annuity insurance domain. The ideal candidate will provide architecture leadership across Databricks Lakehouse, AWS Cloud, Java/Python application integration, Kafka event streaming, enterprise data platforms, analytics, and governance frameworks.

This role will drive end-to-end architecture strategy, solution design, data governance, cloud integration, and modernization programs while collaborating with business, product, engineering, and data teams.

Key Responsibilities

Enterprise Architecture

• Define and drive enterprise data and integration architecture strategies.
• Design scalable, secure, and cloud-native architectures supporting insurance modernization initiatives.
• Align application, data, analytics, and cloud platforms with enterprise technology roadmaps.
• Establish architecture standards, patterns, and governance frameworks.

Databricks Lakehouse Leadership

• Lead Databricks platform implementation and governance initiatives.
• Design and administer Databricks workspaces and Lakehouse architecture.
• Implement Delta Lake, Unity Catalog, MLflow, and enterprise governance controls.
• Define data lifecycle, metadata, lineage, and cataloging standards.
• Optimize workspace performance, cost management, and operational efficiency.

Data Architecture

• Design enterprise data models supporting Life & Annuity business processes.
• Define logical and physical data architecture standards.
• Establish data security, retention, quality, and compliance frameworks.
• Drive metadata management, master data management, and data governance initiatives.

Data Engineering & Integration

• Design and oversee scalable data pipelines using:
  • Databricks
  • PySpark
  • Spark SQL
  • Delta Lake
  • Auto Loader
  • Structured Streaming
  • AWS S3
• Implement batch and real-time ingestion architectures.
• Develop performance tuning and optimization strategies.
• Establish CI/CD practices for data engineering deployments.

Application & Integration Architecture

• Define full-stack architecture patterns using:
  • Java
  • Spring Boot
  • React
  • Python
• Architect microservices and event-driven solutions.
• Design integration patterns utilizing:
  • Kafka
  • Event Streaming
  • REST APIs
  • KONG API Gateway
• Ensure scalability, resiliency, and security across application ecosystems.

Analytics & Business Intelligence

• Partner with business stakeholders to define KPIs and reporting requirements.
• Enable data-driven decision making using:
  • Power BI
  • SQL Analytics
  • Self-Service Reporting
• Support root-cause analysis and advanced business insights.

Required Technical Skills

Data & Analytics

• Databricks Lakehouse Platform
• Delta Lake
• Unity Catalog
• MLflow
• PySpark
• Spark SQL
• Structured Streaming
• Auto Loader
• Power BI
• Advanced SQL

Cloud Technologies

• AWS
• S3
• RDS
• Lambda
• Glue
• Redshift
• IAM
• Cloud-Native Architecture

Application Technologies

• Java
• Spring Boot
• Python
• React
• REST API Development
• Microservices

Integration Technologies

• Kafka
• Event Streaming
• KONG API Gateway
• API Management

DevOps & Automation

• CI/CD Pipelines
• Git
• Jenkins
• GitLab
• Azure DevOps
• Infrastructure as Code

Data Governance & Security

• Unity Catalog Governance
• Metadata Management
• Data Lineage
• Data Security
• Regulatory Compliance
• Access Management

Preferred Domain Experience

• Life Insurance
• Annuity Products
• Policy Administration
• Claims Processing
• Underwriting
• Agent & Broker Platforms
• Insurance Data Models
• Digital Transformation Programs

Ideal Candidate Profile

• 10+ years of Data, Cloud, and Solution Architecture experience.
• Strong hands-on expertise with Databricks Lakehouse.
• Proven experience leading enterprise-scale modernization programs.
• Deep understanding of AWS cloud architecture.
• Experience implementing data governance and security frameworks.
• Strong stakeholder management and leadership capabilities.
• Experience mentoring architects, engineers, and analysts.