Big Data Java Developer

  • New York
  • Saxon Global
Key Responsibilities: Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications for big data solutions. Design, develop, and implement efficient and scalable big data applications using Java, Python, and other relevant technologies. Utilize Apache Spark, HIVE, and related tools to build, optimize, and maintain data pipelines and workflows. Hands-on experience with Apache Spark DataFrames, Datasets, MapReduce, Hive Query Language, HDFS, and PySpark. Participate in agile development practices, including sprint planning, stand-ups, and retrospectives. Write clean, maintainable, and well-documented code while adhering to best coding practices. Perform thorough testing of developed solutions, including unit testing, integration testing, and performance testing. Troubleshoot and debug issues in the big data applications, ensuring smooth operation in production environments. Stay updated with the latest advancements in big data technologies and contribute ideas for improving the existing architecture. Qualifications and Skills:

Bachelor's degree in Computer Science, Software Engineering, or a related field. 5+ years of hands-on experience in software development, with a strong emphasis on building big data applications. Proven track record of working on agile development teams and delivering high-quality software in fast-paced environments. Proficiency in Java, Python, and preferably Scala programming languages. Extensive experience with Apache Spark, including DataFrames, Datasets, and PySpark. Solid understanding of HIVE Query Language, MapReduce, and HDFS. Strong problem-solving skills and the ability to optimize and tune big data workflows for performance. Excellent communication skills, both written and verbal, with the ability to convey complex technical concepts to non-technical stakeholders. Financial industry knowledge is a plus. Certifications in relevant technologies is an advantage.