Summary: We are looking for Big Data Engineer with experience in architecting and building our Hadoop, NoSQL, InMemory Platforms(s) and data collectors. You will be part of the team that built one of the world's AI platform which ingests and processes 100's of Terabytes of data and enabled multiple revenue generating data products. This is a unique opportunity to be part of building disruptive technology where Big Data will be used as platform to build solutions for Analytics, Data Services and Solutions.
Roles and Responsibilities:
Create, articulate and document architecture of new platform services.
Design and implement POCs and solutions across emerging technologies and frameworks.
Design and develop platform services for ingestion, data persistence of 10s of TB.
Write micro services to expose analytics as services.
Performance tuning of different Big Data applications running on platform.
Interact with Data science team and product management team to understand requirements.
Skills & Qualifications:
5 or more years of experience in software development.
2 or more years of experience in Big Data technologies including Impala, HBase.
Two or more years of experience in writing Big Data applications using Spark.
Experience in Java and Talend.
Familiarity with Agile development methodology.
Experience with Scala is a plus.
Experience with NoSQL databases, e.g., Cassandra is a plus.
Expertise in Apache Spark & Hadoop.
Experience in S3 data lake development.
Expertise in machine learning algorithms.
Education / Experience:
Bachelor's degree in a computer related field or equivalent professional experience is required.
SoftClouds LLC is an Equal Opportunity Employer. As such, SoftClouds LLC is committed to a policy of equal employment opportunity for employees and applicants for employment.