Pyspark Databricks Engineer Job at CrackaJack Digital Solutions LLC, Houston, TX

TUIvUXdwRzdCUUNaWnFVMlhZd3NkRnpRUUE9PQ==
  • CrackaJack Digital Solutions LLC
  • Houston, TX

Job Description

Job Title: PySpark and Databricks Developer
Location: Houston, TX (Hybrid)

Key Responsibilities:
  • Design, develop, and optimize data pipelines and transformations using PySpark and Databricks .
  • Collaborate with data architects and analysts to define and implement scalable data models and frameworks.
  • Build and maintain complex data ingestion and processing workflows for large, distributed datasets.
  • Develop reusable and efficient code following best practices in coding, testing, and deployment.
  • Optimize Spark jobs for performance, scalability, and reliability in production environments.
  • Work closely with cross-functional teams to ensure data quality, consistency, and integrity.
  • Contribute to continuous improvement of the data engineering ecosystem and CI/CD processes.
Required Skills and Qualifications:
  • 5+ years of experience in software development with a focus on Python and PySpark .
  • Hands-on expertise in Databricks platform — including cluster management, notebooks, and job orchestration.
  • Strong programming fundamentals (data structures, algorithms, debugging, version control).
  • Experience with Delta Lake , Spark SQL , and data lake architectures .
  • Solid understanding of distributed computing, data partitioning, and Spark performance tuning.
  • Familiarity with cloud platforms such as Azure, AWS, or GCP.
  • Excellent communication and problem-solving skills — able to explain complex technical concepts clearly.

Job Tags

Contract work,

Similar Jobs

Xcelo Group

Data Scientist -- Azure and ML!- W2 (H1B/OPT) Accepted Job at Xcelo Group

 ...experience as a Data Scientist, with a focus on machine learning and cloud computing. ~ Expertise in Azure Machine Learning, Azure Databricks, and other Azure data services. ~ Proficiency in programming languages such as Python, R, or Scala. ~ Strong knowledge of... 

CrackaJack Digital Solutions LLC

Pyspark Databricks Engineer Job at CrackaJack Digital Solutions LLC

 ...Job Title:PySpark and Databricks Developer Location:Houston, TX (Hybrid) Key Responsibilities: Design, develop, and optimize data pipelines and transformations using PySpark and Databricks . Collaborate with data architects and analysts to define and implement... 

Awesome Motive

WordPress Full-Stack Developer Job at Awesome Motive

 ...As a WordPress Developer at WPForms, you'll work on a diverse team that builds & supports a wide-range of websites. Were looking for someone...  ...politics, no b.s., and no jerks. Location This is a remote position - our team is spread around the globe! Our home... 

The TJX Companies, Inc.

70120 - Merchandise Associate Job at The TJX Companies, Inc.

 ...prioritizes your development. Whether youre working in our four global Home Offices, Distribution Centers or Retail StoresTJ Maxx, Marshalls, Homegoods, Homesense, Sierra, Winners, and TK Maxx, youll find abundant opportunities to learn, thrive, and make an impact. Come... 

LAULAU

Executive Assistant Job at LAULAU

 ...experienced executive assistant with 4+ years of experience working for US firms. You will be working with the same client and...  ...exceptional communication skills. Recent experience working night shifts from home, and no history of jumping jobs. Strong knowledge (9/10...