Job description:
Role Pyspark BigData Developer Senior
Experience 8 Years
Location Offshore India
Technical Skills Primary
Minimum 5 years of experience in ETL Data Engineering using Pyspark design development
Lead the design and development of enterprisescale data processing pipelines using PySpark and Big Data technologies ensuring high performance and scalability
Define and enforce data engineering standards best practices and governance frameworks across projects
Strong experience and understanding on Data warehousing concepts
Working knowledge on GitLab for code management
Understanding of best practices on Data ingestion Quality and transformation
Provide technical leadership and mentorship to junior and intermediate developers driving innovation and quality in Big Data solutions
Experience with Cloudera engine along with SQL HQL and Big Data tools
Soft Skills
Strong ability to work with client stakeholders
Ability to have the requirement discussion with the customer stakeholders
Excellent communication analytical and problemsolving skills
leadership and organizational abilities to effectively interact with stakeholders colleagues and other members of the team
Demonstrated ability to be organized and selfdirected
Strong interpersonal skills with the ability to work cross functionally
Experience in Mentoring junior developers with technical support
Responsibilities
Lead requirement gathering and solution design discussions with business stakeholders ensuring alignment with strategic objectives
Drive project planning estimation and resource allocation managing timelines and deliverables for complex data initiatives
Establish and enforce governance documentation standards and compliance practices for Big Data projects
Act as a primary liaison between business and technical teams ensuring clear communication and prioritization of tasks
Mentor and coach junior and intermediate developers fostering knowledge sharing and continuous improvement within the team
Oversee complex data integration migration and optimization initiatives across cloud and onpremises environments
Participate in Agile ceremonies and ensure timely delivery of tasks
Skills:
Mandatory Skills : Apache Spark, Big Data Hadoop Ecosystem, Python, SparkSQL