Big Data Engineer (Sri Lanka)
Employer: IncubateLabs
Industry: Engineering
Location: Sri Lanka
We are looking for a Big Data Engineer who will join our engineering organization to work on collecting, storing, processing, and analyzing huge data sets. Your responsibilities include, but not limited to choosing optimal solutions, then implementing, maintaining and monitoring them. You will also be responsible for integrating them with the company’s infrastructure or other 3rd party client infrastructure.
Responsibilities:
• Selecting and integrating Big Data tools and frameworks required to meet the requirements
• Implementing ETL process
• Monitoring performance and advising any necessary infrastructure changes
• Defining and enforcing data retention policies
Requirements:
• Good understanding and at least 1 year of hands on experience of Big Data and Big Data related technologies
• Hands on experience implementing and managing Hadoop cluster and related services
• Ability to solve any operational issues with the Big Data infrastructure
• Proficiency with Hadoop v2, MapReduce, HDFS
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Apache Spark is a MUST
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks
• Experience with messaging systems, such as Kafka or RabbitMQ is a plus
• BS/MS in Com uter Science/Engineering or equivalent exprience
Latest jobs in Sri Lanka ..
- DevOps Engineer Tech Lead - DevOps Engineer Tech Lead This is an exciting opportunity for a DevOps Engineer Tech Lead to grow and develop their… Apply here.
- Content Writer - COMPETENCIES AND QUALIFICATIONS - Bachelor’s degree preferred - Experience in content creation from inception to publication - Develop content that… Apply here.
- Web Content Writer - Job Description - Analyze and create SEO content - Create content for the social networking accounts such as Facebook, Instagram,… Apply here.
- Admin & Finance Manager - The Admin & Finance Manager (hereafter Manager) is responsible for the administration and finance functions of the Collective for Historical… Apply here.
- JAVA- Tech Lead - Our client is one of the leading companies located in Colombo. Requirements: - Bachelor's degree in IT/Computer science/Engineering. - 5+Years… Apply here.
- Account Executive - We are associate of a well established printing company with 50 years reputation and having five separate Business Units specializing… Apply here.
Send your CVs to [javascript protected email address]