Consultant / Sr Consultant - Data Engineer (Databricks)

About Fresh Gravity:

Who we are:

Founded in 2015, Fresh Gravity helps businesses make data-driven decisions. We are driven by data and its potential as an asset to drive business growth and efficiency. Our consultants are passionate innovators who solve clients’ business problems by applying best-in-class data and analytics solutions. We provide a range of consulting and systems integration services and solutions to our clients in the areas of Data Management, Analytics and Machine Learning, and Artificial Intelligence.

In the last 10 years, we have put together an exceptional team and have delivered 200+ projects for over 80 clients ranging from startups to several fortune 500 companies. We are on a mission to solve some of the most complex business problems for our clients using some of the most exciting new technologies, providing the best of learning opportunities for our team.

We are focused and intentional about building a strong corporate culture in which individuals feel valued, supported, and cared for. We foster an environment where creativity thrives, paving the way for groundbreaking solutions and personal growth. Our open, collaborative, and empowering work culture is the main reason for our growth and success. To know more about our culture and employee benefits, visit out website  . We promise rich opportunities for you to succeed, to shine, to exceed even your own expectations.

We are data driven. We are passionate. We are innovators. We are Fresh Gravity.

Requirements

• Databricks Platform Proficiency: Deep understanding of the Databricks Lakehouse Platform, including its Medallion architecture, workspace, and capabilities.

• Apache Spark: Expertise in using Apache Spark for data processing, including Spark SQL, DataFrames, and RDDs.

• Data Engineering with Delta Lake: Knowledge of Delta Lake for managing data lakes, including features like ACID transactions, schema enforcement, and time travel.

• ETL Processes: Experience with Extract, Transform, Load (ETL) processes using Databricks and other tools to integrate and transform data from various sources.

• Performance tuning and optimization in SPARK

• Knowledge to integrate with JDBC, SFTP, REST API and Cloud storage account based source systems

• Knowledge of workload patterns , designing metadata driven framework for workloads

• Programming and Scripting: Proficiency in programming languages such as Python and SQL for data manipulation and pipeline development.

• Data Governance and Security: Understanding of data governance best practices and security measures to ensure data integrity and compliance. • Usage of UNITY Catalog , external and internal tables

• Data Analysis: Ability to analyze large datasets to extract meaningful insights and support datadriven decision-making.

• Problem-Solving: Strong analytical skills to troubleshoot and resolve data-related issues efficiently.

• Data Quality and Unit Testing: Ensuring data accuracy and integrity through rigorous testing and validation processes.

• Continuous Learning: Staying updated with the latest trends and advancements in data engineering and Databricks technologies.

Skills & Experience we value

• 2 – 8 years of experienced professionals.

• Python Scripting

Benefits

In addition to a competitive package, we promise rich opportunities for you to succeed, to shine, to exceed even your own expectations. In keeping with Fresh Gravity’s challenger ethos, we have developed the 5Dimensions (5D) benefits program. This program recognizes the multiple dimensions within each of us and seek to provide opportunities for deep development across these dimensions. Enrich Myself; Enhance My Client; Build my Company, Nurture My Family; and Better Humanity.