Middleware Architect

  • Florida
  • New York Technology Partners
Job Description: Mandatory Certification Any one Kafka Confluent Certified Administrator for Apache Kafka Kafka Confluent Certified Developer for Apache Kafka Talend Talend Data Integration v6 Certified Developer Apache Spark Cloudera CCA Spark and Hadoop Developer CCA175 Apache Spark Databricks Certified Developer Apache Spark 2X Apache Spark Hortonworks HDP Certified Apache Spark Developer Python Institute Certified Associate in Python Programming Python Institute Certified Professional in Python Programming Role Sr Kafka Administrator Technical Manager Primary Skill Kafka Apache Confluent Kafka Scripting programming in Unix or Python Secondary Skill Cloud knowledge like AWS Azure CICD Exp 10 yrs Tasks and Responsibilities: Min 10 years of experience working as Kafka administrator. Exp in developing Kafka infrastructure mainly about availability performance security and automation. Perform Level administrator support for Kafka infrastructure. Ensure support availability during agreed business hours. Ensure support availability during the rotational service guard period. Responsible for maintaining the availability performance and security of Kafka infrastructure. Develop and maintain the automation for Kafka infrastructure. Extensive experience in setting up clusters Confluent Apache Kafka Working knowledge of Apache Spark and Talend would be a plus. Working knowledge of setting up clusters on bare metal and Cloud VMs. Subject Matter Expert as an Application or Solutions architect in Apache Kafka and Apache Spark Should be able to resolve Performance bottlenecks. Should have basic working knowledge of Capacity Management Extensive experience system analysis and in programming of software applications Consistently demonstrates clear and concise written and verbal communication. Ability to learn new skills with a short learning curve. Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customers. Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail. Strong work ethics with good time management with ability to work with diverse teams and lead meetings. Expert in Installing and maintaining the Confluent Platform components including Apache Kafka Confluent Control Center Confluent Schema Registry Confluent Replicator and Confluent Security Plugins Strong admin experience and versions used for Confluence Kafka details on the projects and environment they supported along with the tools used Size of the environments how many nodes clusters how many messages processed. Experience administering the following Event Driven Architecture Components Apache Kafka Kafka Brokers Zookeeper Confluent Control Center Confluent Schema Registry Connect cluster etc. Understanding of Data access Data Retention and archiving. Experience working with browse events across federated brokers. Experience performing Confluent Platform installation upgrades and maintenance. Experience working with Confluent Security Plugins. The Confluent Kafka Administrator will be responsible for Design architecture implementation and ongoing support of Kafka clusters on an Event Streaming Architecture Pilot project. Manage large scale multi nodes Kafka cluster environments. Handle all Kafka environment builds including design capacity planning cluster setup performance tuning and ongoing monitoring. Kafka security authentication authorization and encryption. Perform high level day today operational maintenance support and upgrades for the Kafka Cluster Good to have knowledge on messaging system like AMQ Kafka etc. Having experience on OpenShift cluster administration is added advantage. Knowledge on Java based applications and Docker and Kubernetes OpenShift. Knowledge in other messaging systems such as IBM MQ or Rabbit MQ tools Jira Confluence and Bitbucket GIT Ansible Jenkins automation development scripting languages shell and python.