Join minds a free decentralized social media. Make free money

New Job Data Engineer Big Data - Hyderabad In Telangana

Data Engineer Big Data - Hyderabad
Data Engineer Big Data - Hyderabad

Data Engineer Big Data - Hyderabad

Company : 2COMS Consulting Private Limited
Salary : ₹50,000 - ₹2,00,000 a year
Location : Telangana

Full Description

Urgent Hiring Experienced Big data Developer in a leading brand Company




Client Details :

Our client is a is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 500 companies.

Location: Hyderabad

Responsibilities :
  • As a Data Engineer, you will build a variety of big data analytics solutions, including big data lakes. More specifically, you will:
  • Design and build scalable data ingestion pipelines to handle real time streams, CDC events, and batch data
  • Execute high-performance data processing for structured and unstructured data, and data harmonization
  • Schedule, orchestrate, and validate pipelines
  • Design exception handling and log monitoring for debugging
  • Make tech stack and tools related decisions
  • Collaborate with business consultants, data scientists, and application developers to develop analytics solutions

Requirements
Hands-on experience with:
  • Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack etc
  • Spark, Scala, Python and core/advance Java
  • NOSQL databases e.g. Hbase, Cassandra, MongoDB
  • Relevant AWS or Azure components required to build big data solutions
  • Good to know: Databricks, Snowflake
  • Ability to develop and manage scalable Hadoop cluster environments
  • Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
  • 5-10 years of tech experience with at least 3 years in big data engineering

2.00-7.00 Years

Post a Comment