Convert PySpark Job to Databricks

Only for registered members Canada

3 weeks ago

Default job background
$100 - $0 (USD) budget

Job summary

We are seeking an experienced data engineer to assist in converting an existing PySpark job to a Databricks environment.

Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Only for registered members Remote job $9 - $20 (USD) per hour

    We are looking for an experienced Python / PySpark Developer with strong Azure Databricks expertise to support ongoing data engineering and ETL development. · Develop and maintain PySpark ETL pipelines in Databricks · ...

  • Only for registered members Remote job $40 (USD) per hour

    We are seeking an experienced developer to troubleshoot and fix issues within our existing Pyspark Databricks pipeline. · ...

  • Only for registered members Remote job

    We seek an experienced Databricks expert with strong PySpark and SQL skills to modify our existing notebook. · Ingesting fixed-width files into our Databricks environment. · ...

  • Only for registered members Remote job $10 - $11 (USD) per hour

    Experienced Data Engineer with strong expertise in building scalable production-grade data pipelines for the healthcare industry. · Proven ability to design and maintain end-to-end ETL/ELT workflows using Apache Airflow PySpark SQL and Python supporting clinical claims and value- ...

  • Only for registered members Remote job $50 - $0 (USD) budget

    We need a python pyspark coder on databricks usage azure to create an existing similar function within this project. ...

  • Only for registered members Remote job

    Job summary · Join our data engineering team to build scalable data solutions using Databricks. · ResponsibilitiesDesign, develop and optimize ETL pipelines using Databricks platform. · ...

  • Only for registered members Mississauga

    We are seeking a skilled Databricks Engineer to join our data engineering team and support the design, development, and optimization of scalable data pipelines and analytics solutions. · Strong hands-on experience as a Data Engineer / Databricks Engineer · Proficiency in Python a ...

  • Only for registered members Remote job $40 - $60 (USD) per hour

    Design, build and optimize enterprise-scale Lakehouse solutions on Databricks. · ...

  • Only for registered members Toronto

    We are looking for a Data Engineer with strong experience in Databricks to build optimize and maintain scalable data pipelines and platforms. · Develop and optimize data pipelines using Databricks & Apache Spark · Build ETL/ELT workflows using PySpark / Spark SQL · Integrate data ...

  • Only for registered members Toronto

    Azure Cloud Platform Engineer with experience in Azure cloud platform admin and developer roles. · ...

  • Data Engineer

    1 month ago

    Only for registered members Mississauga

    Data Engineer is a senior role that involves working with SQL, Python, PySpark and Data Modelling using Databricks. · Senior Data Engineer · ...

  • Only for registered members Richmond Hill

    We are seeking an AI/ML Architect with hands-on experience in Databricks to join our team. · Develop, train, and optimize machine learning and statistical models using Databricks, Python, PySpark, and MLflow. · Perform exploratory data analysis (EDA) to identify trends, patterns, ...

  • Data QA Analyst

    2 weeks ago

    Only for registered members Remote job $20 - $30 (USD) per hour

    You validate data, reports and applications that support business decisions. · SQL validation of schemas, data reconciliation and issue troubleshooting. · Testing across Azure Data Factory Synapse using T SQL and Databricks using PySpark. · Checks for data integrity issues like n ...

  • Only for registered members Remote job $10 - $15 (USD) per hour

    We are seeking an experienced PySpark developer to provide long-term support for our data processing needs.The ideal candidate will have a strong background in big data frameworks, particularly PySpark. · ...

  • Only for registered members Mississauga

    +Job summary · This full-time role involves developing data pipelines using Python and PySpark.The ideal candidate will have experience with Extract Transform Load (ETL) processes. · +Proficiency in Database Development and Database Design · Strong experience with Extract Transfo ...

  • Only for registered members Toronto

    We are seeking a Senior Software Developer (ETL) for a 1-year contract opportunity in Toronto. · Designing and developing scalable architectures. · ...

  • Only for registered members Toronto, Ontario

    We are looking for a Data Engineer with strong experience in Databricks to build, · optimize,and maintain scalable data pipelines and platforms. · ...

  • Only for registered members Toronto

    +Job Description: · The Senior Data Engineer will design, build and optimize enterprise-grade data ingestion pipelines and analytics frameworks using Azure Data Factory, Azure Databricks, Delta Lake and associated Azure services. · +This role involves developing scalable data sol ...

  • Sr ETL Developer

    2 weeks ago

    Only for registered members Toronto

    Sr ETL Developer for designing and developing scalable Medallion Data Lakehouse architectures with expertise in data ingestion, transformation, and curation using Delta Lake and Databricks. · ...

  • Only for registered members Toronto

    We are looking for an Sr Azure Data Engineer (Azure Databricks) · Below is the JD for review. · Exp years · Implementation of end-to-end solution for migrating on-premises system to Azure Cloud,Azure Data Lake StorageAzure Data FactoryAzure SynapsePyspark, Scala ...