Engineer

Kafka+MemSQLMust Have Technical/Functional Skills Primary Skill: Kafka, Producers / Consumers, Kafka Topics / Partitions, Schema Registry, Event-Driven Architecture, MemSQL / SingleStore, Real-Time Data Pipelines, Distributed SQL, Oracle SQL, PL/SQL, Streaming Data, SQL Optimization Experience: Minimum 10 yearsRoles & Responsibilities• Design and implement event driven architectures on Kafkamodel topics, partitions, and retention for high throughput, low latency data streams.• Build resilient Kafka producers and consumers with proper serialization (Avro/JSON/Protobuf), batching, idempotence, and back pressure handling.• Manage Kafka ecosystem componentsbrokers, ACLs, consumer groups, DLQs, Schema Registry, Connect, and MirrorMaker as required.• Develop streaming data pipelines using Kafka Connect/Streams or custom apps to ingest, transform, and route data to MemSQL and Oracle targets.• Design and optimize MemSQL (SingleStore) schemasrowstore/columnstore choices, sharding, partitioning, pipelines, and indexes for real time analytics.• Build MemSQL ingestion flows from Kafka (e.g., Pipelines) and tune for throughput, exactly-once or at least-once semantics, and failure recovery.• Write high performance SQL for MemSQL and Oraclewindow functions, analytics, joins, CTEs; tune queries using execution plans and indexing strategies.• Develop Oracle PL/SQL packages, procedures, and functions for data transformation, validations, batch jobs, and business logic encapsulation.• Ensure data quality and governanceschema evolution, contract testing, lineage tracking, and reconciliation between Kafka, MemSQL, and Oracle.• Engineer reliability & error handlingretries with backoff, DLQ routing, replay strategies, idempotency keys, and compensating actions.• Implement end to end securityTLS/mTLS for Kafka, SASL (SCRAM/Kerberos) if used; RBAC, secrets management, and data masking/encryption for databases.• Monitor and optimize performancelag, throughput, and consumer health in Kafka; resource utilization, shard balance, and query latency in MemSQL/Oracle.• Automate CI/CDinfrastructure as code for Kafka topics/ACLs and DB objects; automated tests for streams, SQL, and PL/SQL; versioned migrations.• Support production operationson call triage, RCA for data delays or integrity issues, hotfixes, and continuous improvement of runbooks.• Collaborate in Agile teamsrefine requirements, size work, document data contracts and ERDs, and coordinate releases across platform and app teams.Salary Range- $110,000-$125,000 a year

Created: 2026-04-02