Greetings !!!
Role: Databrick Engineer
Location: Louisville, KY
Duration: full time
Rate: $45/hr on c2c
Job Description:
Job Title: Databricks Consultant / Senior Databricks Consultant
Job Summary:
We are seeking an experienced Databricks Consultant to design, develop, implement, and optimize modern data solutions using the Databricks Lakehouse platform. The consultant will work with business and technical stakeholders to build scalable data pipelines, data platforms, analytics solutions, and cloud-based data architectures.
Key Responsibilities:
- Design and implement Databricks Lakehouse solutions for enterprise data workloads.
- Develop scalable ETL/ELT pipelines using Databricks, Apache Spark, Python, and SQL.
- Build and optimize Databricks notebooks, workflows/jobs, clusters, and Delta Lake solutions.
- Implement data ingestion from multiple sources including databases, APIs, files, and cloud storage.
- Design and manage Delta Lake tables, including partitioning, schema evolution, optimization, and time travel.
- Work with Unity Catalog for data governance, access control, lineage, and security.
- Develop batch and near-real-time data processing solutions using Apache Spark/PySpark.
- Perform performance tuning of Spark jobs, clusters, SQL queries, and data pipelines.
- Integrate Databricks with cloud platforms such as Azure, AWS, or GCP.
- Work with cloud storage technologies such as ADLS, S3, or GCS.
- Implement data quality, validation, monitoring, and error-handling frameworks.
- Develop data models supporting analytics, BI, reporting, and downstream applications.
- Support migration of legacy data platforms and ETL processes to Databricks.
- Implement CI/CD and DevOps practices for Databricks using Git, Azure DevOps, GitHub Actions, or similar tools.
- Collaborate with architects, data engineers, analysts, and business stakeholders.
- Troubleshoot production issues and provide root-cause analysis.
- Create technical documentation, architecture diagrams, and operational procedures.
Required Skills:
- Strong hands-on experience with Databricks.
- Strong knowledge of Apache Spark and PySpark.
- Advanced Python and SQL skills.
- Experience with Delta Lake and Lakehouse architecture.
- Experience with Databricks Workflows/Jobs, notebooks, and clusters.
- Knowledge of Unity Catalog and Databricks security/governance.
- Experience with cloud platforms: Azure / AWS / GCP.
- Strong understanding of data warehousing and data modeling concepts.
- Experience developing enterprise-scale data pipelines.
- Strong troubleshooting and performance-tuning skills.
Suneetha K
Team Lead
Email: [email protected]
6096590999 Ext 322
Website: www.saranshinc.com
Email Is the best way to reach me