TekWissen LLC logo

Senior Confluent Kafka & Flink Streaming Architect

TekWissen LLC

  • Columbus, OH
  • 2 days ago
  • $57.14–$58.57

Highlights

Confluent Cloud, Apache Kafka, Apache Flink, ksqlDB, Kafka Streams, Kafka Connect, Schema Registry, AWS (EKS, MSK, S3, IAM, VPC), GCP (GKE, Pub/Sub, PSC), Terraform, Kubernetes, Docker, Jenkins, Harness, Java / Spring Boot, Python, PySpark, Prometheus, Grafana, Splunk. Our client is an American multinational information technology services and consulting company and is a leading provider of information technology, consulting, and business process outsourcing services, dedicated helping the world's leading companies build stronger businesses.

Numbers & Facts

LocationColumbus, OH
IndustryComputer/IT Services
Salary$57.14–$58.57
Company Size100 to 499 employees
Year Founded2009
Websitehttp://www.tekwissen.com/

Description

Overview:
TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client is an American multinational information technology services and consulting company and is a leading provider of information technology, consulting, and business process outsourcing services, dedicated helping the world's leading companies build stronger businesses.
Job Title: Senior Confluent Kafka & Flink Streaming Architect
Location: Columbus, OH
Duration: 6 Months
Job Type: Temporary Assignment
Work Type: Onsite

Job Description:

a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }

About the Role

We are looking for a Senior Streaming Architect / Engineer to design, build, and run our enterprise real-time data platform on Confluent Cloud and Apache Flink. You will lead the move from legacy batch and ETL workloads to a cloud-native, event-driven architecture on AWS and GCP. You will set technical direction, mentor engineers, and work with business and executive stakeholders.

Key Responsibilities:

  • Architect multi-region, highly available Confluent Cloud environments with DR strategies (Cluster Linking, cross-region replication) supporting 200K+ events/sec.
  • Design and build real-time pipelines in Apache Flink (DataStream, Table, and SQL APIs): event-time processing, watermarks, late-event handling, windowed aggregations (tumbling, hopping, session), and stream joins.
  • Implement stateful, fault-tolerant processing with checkpointing, savepoints, and exactly-once semantics; tune parallelism, state backends, and operator chaining.
  • Build and manage Kafka Connect source/sink connectors (CDC, RDBMS, S3, analytics platforms) with SMTs and DLQ/retry patterns.
  • Own schema governance through Schema Registry (Avro/JSON/Protobuf) and compatibility rules.
  • Develop event-driven microservices and Kafka Streams / ksqlDB applications using Java and Spring Boot.
  • Lead migrations of on-prem middleware and Confluent Platform workloads to Confluent Cloud and AWS (EKS) with zero-downtime cutover.
  • Automate infrastructure with Terraform (Confluent, AWS, GCP providers) and GitOps CI/CD (Harness, Jenkins).
  • Implement secure connectivity (Private Service Connect, VPC, PrivateLink), RBAC, ACLs, SSL/SASL, and audit logging.
  • Set up observability (Prometheus, Grafana, CloudWatch, Splunk); lead incident response, RCA, and performance tuning.
  • Optimize partitioning, retention, and capacity to reduce infrastructure cost.
  • Lead and mentor Kafka/Flink engineers, run training sessions, and communicate architecture trade-offs to leadership.

Required Qualifications

  • 12+ years in software, integration, or data engineering, with 5+ years hands-on with Apache Kafka / Confluent in production.
  • Strong hands-on experience with Apache Flink (DataStream API and Flink SQL), including state management and checkpoint tuning.
  • Deep Kafka knowledge: partitioning, replication/ISR, retention, compaction, Kafka Connect, Kafka Streams, ksqlDB.
  • Experience running Confluent Cloud in an enterprise setting on AWS and/or GCP.
  • Advanced Java (11+) and Spring Boot; proficiency in Python and SQL.
  • Experience with Terraform, Docker, and Kubernetes (EKS / GKE / OpenShift).
  • Experience with CI/CD tools (Jenkins, Harness) and monitoring stacks (Prometheus, Grafana, Splunk).
  • Proven cloud migration experience, from assessment and planning through cutover.
  • Strong communication skills and experience with stakeholders in regulated industries.

Preferred Qualifications

  • Confluent Certified Developer / Administrator for Apache Kafka; Confluent Certified Data Streaming Engineer (Flink).
  • AWS Solutions Architect certification.
  • Experience with Amazon MSK, Managed Service for Apache Flink, Kinesis, EMR, Glue, and MWAA.
  • PySpark experience for batch and streaming ETL.
  • Familiarity with Snowflake, BigQuery, PostgreSQL, Oracle, and DB2 as sources or sinks.
  • Experience with CDC patterns and legacy integration platforms (IBM MQ, IIB, mainframe).
  • Domain background in healthcare, insurance, banking/finance, or retail.

Tools & Technologies:

  • Confluent Cloud, Apache Kafka, Apache Flink, ksqlDB, Kafka Streams, Kafka Connect, Schema Registry, AWS (EKS, MSK, S3, IAM, VPC), GCP (GKE, Pub/Sub, PSC), Terraform, Kubernetes, Docker, Jenkins, Harness, Java / Spring Boot, Python, PySpark, Prometheus, Grafana, Splunk.
  • Must-have: Confluent Kafka production experience and hands-on Apache Flink (not just Kafka Streams).
  • Ask about: Flink checkpointing/savepoints, watermarks and late events, exactly-once guarantees, Cluster Linking DR design.
  • Strong signal: Confluent Cloud migration from on-prem, Terraform-based provisioning, and Confluent certifications.
  • Profile titles to search: Kafka Architect, Confluent Architect, Streaming Data Engineer, Flink Engineer, Event Streaming Solution Architect.

Experience:

  • 12+ years overall (8+ years for Senior Engineer level); 5+ years in event streaming

TekWissen Group is an equal opportunity employer supporting workforce diversity.

About Company

WE THE TEKWISSEN PEOPLE

TekWissen offers you a broader portfolio of services, industry-leading solutions, and the meaningful innovations that give you greater flexibility and speed to respond to market dynamics, reduced costs and risk to improve enterprise performance, and increased productivity to enable growth.

To keep pace with global market demands, TekWissen keeps its finger on the pulse of change. Our organized approach to guiding a project from its inception to closure. Managing projects is becoming more and more important as we enter the digital era. To cope with the pace that this transition demands, a method is required to manage projects so they can yield quality work, while incorporating efficient use of time and resources.

Project involves identifying which quality standards are relevant to the project and determining how to satisfy them.

It is important to perform quality planning during the Planning Process and should be done alongside the other project planning processes because changes in the quality will likely require changes in the other planning processes, or the desired product quality may require a detailed risk analysis of an identified problem. It is important to remember that quality should be planned, designed, then built in, not added on after the fact.

Capabilities and accomplishments in one TekWissen business enhance the opportunity for success in the others. Put simply, TekWissen's unique combination of attributes promotes success.



Similar Jobs