Wissen Technology - Data Engineer - Python/PySpark
WISSEN TECHNOLOGY PRIVATE LIMITED
We are seeking a skilled and motivated Data Engineer to design, build, and optimize our next-generation data pipelines. In this role, you will play a critical part in shaping our data architecture, leveraging Databricks, Python, and PySpark to transform raw data into actionable insights. You will collaborate closely with data scientists, analysts, and business stakeholders to ensure our data ecosystem is scalable, reliable, and highly efficient.Key Responsibilities :- Design, develop, and maintain robust ETL/ELT pipelines to ingest and transform large-scale datasets from diverse sources.- Build, monitor, and optimize complex data workflows using orchestration tools like Azure Data Factory (ADF) or Apache Airflow.- Leverage Databricks to write highly optimized, scalable PySpark and SQL queries, ensuring maximum performance and cost efficiency.- Implement best practices for data warehousing, data engineering concepts, and schema design.- Work with cross-functional teams to understand data requirements and deliver high-quality data products.Technical Skills & Qualifications :- Strong experience in Python, PySpark, and SQL.- Proven experience working with Databricks.- Solid track record of managing workflows using Azure Data Factory (ADF) or Apache Airflow.- Deep understanding of ETL/ELT pipeline building, data engineering concepts, and workflow optimization.- Familiarity with Delta Lake, Delta Tables, Parquet file formats, and DBT is highly preferred. (ref:hirist.tech)
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Wissen Technology - Data Engineer - Python/PySpark in Bangalore vacancy
- Job Title : Python Engineer - PySparkLocation : Hyderabad / BengaluruExperience : 5-7 YearsNotice... ...experienced Python Engineer with strong PySpark expertise to join our engineering team. The... ...hands-on experience in building scalable data processing solutions using Python and Apache...DataPythonPermanent employmentFull timeImmediate start
- We are looking for a GCP Data Engineer with 6-8 years of experience to design, build, and scale... ...pipeline and transformation logic using Python.- Author, schedule, and manage complex... ...integrations.- Practical familiarity with core GCP technologies, including Cloud Storage, Pub/Sub,...DataPython
- ...we are pioneering the context engine for human and agentic execution... ...processes. Backed by Dell Technologies Capital and other leading investors... ...a talented and experienced Python Developer with 6+ years of proven... ...and ensure efficient data storage and retrieval with SQL...DataPython
- ...prioritization : - Partner with business and engineering leaders to build and rank a portfolio of... ...integration with enterprise systems and data.4. Responsible AI and governance : -... ...grounding, features, and analytics.- Expert Python (incl. async); prompt engineering as versioned...DataPythonHybrid work
- About the job :We are looking for an experienced Python Developer to design, develop, and maintain high-quality software solutions. The ideal... ...using Python- Build and manage GraphQL APIs for efficient data access and integration- Develop, optimise, and maintain databases...DataPythonFor contractors
- Role : Python Backend DeveloperExperience : 5+ yearsLocation : Chennai/ BangaloreRequired Skills : - Strong experience in Python application... ...and consuming REST APIs.- Good knowledge of JSON, XML, and data manipulation techniques.- Experience with Pandas, Pytest, exception...DataPython
- Job Summary : We are hiring a Python PySpark Data Engineer to develop scalable data processing applications and high-performance data pipelines. The ideal candidate should have strong programming expertise in Python and PySpark along with experience in distributed data processing...DataPython
- ...modelMust-Have Skills:- 8+ years in full-stack engineering, with at least 3 years on GCP- Strong backend development skills: Python (FastAPI / Flask) and/or Java / Kotlin- Hands-... ...building developer platforms or self-service data platforms- Familiarity with serving / deploying...DataPython
- ...to 30 days..!!Key Responsibilities & Skillsets : Common Skillsets : - 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs.- Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy...DataPythonImmediate start
- ...: We are seeking an experienced Senior Data Engineer to join our dynamic team and drive our data... ...extensive experience with Azure cloud technologies and a proven track record of designing,... ...workflows using Azure Databricks with Spark and PySpark.- Implement and manage Lake flow...DataPython
- Job Description :We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and data platforms... ...initiatives. The ideal candidate will have strong expertise in Python, PySpark, Scala, Apache Spark, Hadoop, SQL, Azure Cloud, and...DataPython
- ...Data Engineer — PySpark + AWS Glue ETL & Data Pipelines | 2 Openings Location: Remote (UK) Employment Type: Contract /... ...Functions • Develop serverless functions using AWS Lambda (Python) • Work with data lake architectures on AWS to support analytical...DataPythonPermanent employmentContract workRemote job
- Hiring Data Engineer for Bangalore Location.Experience : 9 -13 YearsJob Location : BangaloreF2F... ...performance data processing applications using PySpark to handle distributed computing tasks... ...processing workflows using PySpark and Python to manage distributed data sets.- Strong...DataPythonHybrid work
- Role Overview : As a Senior Data Engineer, you will be at the forefront of designing and implementing... ...data processing applications using PySpark and Azure Databricks to handle large-scale... ...Databricks, and SQL.- Advanced proficiency in Python and PySpark for building complex data...DataPythonHybrid work
- ...Overview As a Implementation Engineer , you will work at the... ...build, integrate, and deploy Python-based backend solutions that power... ...enterprise systems, optimizing data pipelines, and enabling scalable... ...-making through advanced AI technology, and we are dedicated to delivering...DataPythonFull timeHybrid workWorldwideFlexible hours
- ...recognized as a significant disruptive technology. Our team is growing, and we need forward... ...details visit: Job Overview: As a Staff Data Engineer – ML at Netradyne, an award-winning... .... Proficiency with at least one Python web framework (e.g. FastAPI, Django, Flask...DataPythonHybrid work
- Job Title - Data Engineer Position type - Full Time Work Location - Bangalore, WhitefieldWorking style - Hybrid Cab Facility - Yes Shift... ...environment - Proficiency in data processing languages such as Python, Pyspark, SQL - ETL experience including data cleansing and...DataPythonFull timeHybrid workShift work
- ...development opportunities.Job Description : Data Engineer :The Data Engineer will be a part of BNIs Global Information Technology Team and will primarily have responsibilities... ...as PostgreSQL, MongoDB, Redis- Experience in Python/PySpark is a must- Experience with tools like...DataPythonWork at office
- ...Description We’re seeking someone to join our Enterprise Technology team as a Data Engineer, in Workforce Technology & Services for the modernization... ...industry best practices. Writing efficient SQL and Python scripts for large dataset analysis and building end to end...DataPythonFull time
- ...changing the way companies leverage data to drive user experience,... ...their data. With a technology platform processing more than... ...Role Summary The AI Solutions Engineer will prototype, test, and deliver... ...engineering). Proficiency in Python and working with APIs (REST/...DataPython
- Description :AI Engineer (LLM & Advanced AI)Experience Range : 3 9 YearsLocation : Bangalore... ....- Apply advanced analytics and data science techniques to validate AI models.- Build scalable data pipelines using Python, PySpark, and SQL.- Work with large enterprise datasets...DataPythonFull time
- Role : Data Engineer - Azure (Associate Architect / Senior)Experience Level : 4 to 7 YearsWork... ...of data solutions using Azure cloud data technologies.- Write production quality code to... ...:- A strong hands-on knowledge of Spark/Pyspark.- Expertise in writing SQL queries and performance...DataPythonHybrid work
- ...This position reports to the Engineering Manager. Responsibilities:... ...requirements and tie them to technology solutions Open to work from... ...defining technical requirements, data extraction, data transformation... ..., Java (Preferred) or Python is a must. ~ Hand-On knowledge...DataPythonFull time
- ...recognized as a significant disruptive technology.Our team is growing, and we... ...analytics driven.As a Staff Data Scientist will own the... ...clear, actionable insights for engineering, product, and leadership stakeholders... ...Strong programming skills in Python, with solid fundamentals in...DataPython
- ...Job Title: GenAI Developer/ Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded... ...: Programming: Advanced Python (async programming, OOP, REST APIs... ...access and utilize external data sources, tools, and real-time information...DataPythonLocal area
- ...(Non-Negotiable) :- Strong expertise in Python and API development using FastAPI, Flask,... ...frameworks such as LangChain, LangGraph, Prompt Engineering, Vector Databases, and Embeddings.... ...core solution components, including :1. Data pipelines2. Model training and optimization...DataPythonFull time
- ...communications, performance marketing, and technology, GALE creates marketing... ...is back-end development (Python/Django and related frameworks)... ...and bring a strong engineering mindset: clean architecture, test... ...clean architecture. Database & data layer: Work with relational databases...DataPythonFull time
- ...you'll achieve :We are seeking a senior Data Scientist to lead the design and implementation... ...Requirements :- Programming : Advanced Python (NumPy, Pandas, ML/DL frameworks) and... ...the industry, we're looking for you.Dell Technologies is a unique family of businesses that helps...DataPython
- ...putting the innovative power of technology to work and transforming... ...to fast-track your career. Engineer audio systems and integrated technology... ...feature engineering and data preprocessing. Develop and... ...~ Programming knowledge in Python (mandatory); exposure to GoLang...DataPythonInternshipWork at officeImmediate start
- Position : Data Engineer, EDM IVExperience : 7+ YearsLocation : Bangalore (Hybrid)Shift : General ShiftPrimary Skills : Python, Git, Snowflake, DBT, SQL(advanced)Key Responsibilities : - Develop... ...tools- Experience with streaming technologies (Kafka, Kinesis)- Familiarity with...DataPythonHybrid workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Wissen Technology - Data Engineer - Python/PySpark. Be the first to apply!
