Big Data Lead Engineer_DGLiger
Coders Brain Technology
Full-time
Remote
Must to have skills: Pyspark, SQL, Cloud computing(AWS/Azure or any other cloud)
JOB DESCRIPTION
§ Work with extremely talented peers in a client environment to build new and enhance/maintain existing PySpark, Python codes that generates analytics insights leveraging the big data environment in AWS
§ Proficiency in SQL Writing, SQL Concepts, Data Modelling Techniques & Data Engineering Concepts
§ Experience in working with batch processing / real-time systems using various technologies like Airflow, Databricks, HDFS, Redshift, Hadoop, Elastic MapReduce on AWS
§ Familiar with tools like Git, Code Commit, Jenkins, Code Pipeline
§ Work in a Cross functional team along with other Data Engineers, QA Engineers and DevOps Engineers.
§ Work with Functional Analysts to understand the core functionalities of the solution and build Data Models, Design Documents
§ Develop, test and implement data solutions based on finalized design documents.
§ Ensure adherence with Security and Compliance policies
§ Stay up-to-date with evolving cloud technologies and development best-practices including open-source software.
§ Work in an Agile Environment