Data Engineer

Core Java: advanced level competency, should have worked on projects with core Java development.

Linux shell : advanced level competency, work experience with Linux shell scripting, knowledge and experience to use important shell commands

Rdbms, SQL: advanced level competency, Should have expertise in SQL query language syntax, should be well versed with aggregations, joins of SQL query language.

Data structures and problem solving: should have ability to use appropriate data structure.

AWS cloud : Good to have experience with aws serverless toolset along with aws infra

Data Engineering ecosystem : Good to have experience and knowledge of data engineering, ETL, data warehouse (any toolset)

Hadoop, HDFS, YARN : Should have introduction to internal working of these toolsets

HIVE, MapReduce, Spark: Good to have experience developing transformations using hive queries, MapReduce job implementation and Spark Job Implementation. Spark implementation in Scala will be plus point.

Airflow, Oozie, Sqoop, Zookeeper, Kafka: Good to have knowledge about purpose and working of these technology toolsets. Working experience will be a plus point here.