Get new jobs by email
- ...knowledge and experience Databricks Pyspark python SQL AWS- Need to work on latest features like... ...RDBMS- Strong and experienced on Spark Databricks concepts- should worked in SQL... ...query performance tune the query understand data and propose design changes and optimizations...SQLImmediate start
- ...At the heart of our Data Team, Data Engineers create the pipelines and tables that power business-critical... ...with cutting-edge tools like DBT, Spark, and Airflow, you’ll transform high-volume... ...Requirements Have strong experience in Python and SQL. Have experience building...SQLFull time
- Primary Skills: PySpark, Database, SQL, Python, Secondary Skill: Starburst ETL Hands on experience of building data pipelines. Proficiency in two or more data integration platforms such as Ab Initio Apache Spark Talend and Information Big Data Experience of big data platforms...SQL
Virtusa
Chennai1 day ago Rs 5 - 10 lakhs p.a.
...We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust... ...integrity and system resilience within Spark jobs. Optimize PySpark jobs for... ...PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and...SQLPHOTON
Chennai6 days ago- Job Title: Data Engineer Department: CARDIF Corporate – Data & AI About Business Line/Function BNP Paribas Cardif is the insurance... ..., daily meeting) Technical & Behavioral Competencies SQL (Master) Python development (Master) Starburst, Trino, Airflow (Master)...SQLFor contractorsWorldwide
Bnp Paribas Bank
Chennai1 day ago Rs 20 - 35 lakhs p.a.
...6+ years in software development / IT Data Analyst role Location: Bangalore /... ...preferred) Strong understanding of software engineering principles Excellent analytical and... ...Mandatory Skills (Specific Role): Spark & Scala HQL / SQL Scheduling tools (Oozie / Control-M...SQLMatrix Hr Technologies Private Limited
Chennai7 days ago- Description :We are seeking an experienced AWS Data Engineer with 3+ years of experience in building... ...using tools such as AWS Glue or Apache Spark.- Collaborate with data scientists,... ...workflows.- Automate data processes using Python, SQL, and scripting tools.Required Skills...SQL
- ...time problems Qualitative analysis and data mining to extract data, discover hidden... ...Interface with product and other engineering teams on a regular cadence Qualifications... ...with experience in Bigdata, Python, Pyspark, SQL, Hive, Airflow ~ Strong fundamentals...SQLFull timeFlexible hours
NielsenIQ
Chennai1 day ago - Job Overview : We are seeking a mid-level Azure Data Fabric Engineer to help us architect and implement modern data solutions using... ...Analytics, and OneLake.- Languages : Advanced proficiency in Python (PySpark) and Complex SQL.- Frameworks : Hands-on experience with Delta Lake...SQL
- Data Engineer Spark | Databricks | AWSKey Skills :- Programming & Querying : SQL, Python, PySpark- Big Data & Processing : Apache Spark (Batch & Streaming)- Cloud Platform : AWS (S3, EMR, Glue, Redshift preferred)- Data Platforms : Databricks, Delta Lake, Delta Live Tables (...SQL
- ...people with the care, pharmacy benefits, data and resources they need to feel their... ...learning Mentorship: Guide junior engineers and promote best practices in data... ...Programming: Solid in Azure Databricks, Python/Scala, ADF, Airflow, SQL experience with Snowflake is a plus...SQLContract workShift work
Optum
Chennaia month ago - ...applications. ~5+ years of building, debugging and fine tuning Apache Spark based applications. ~ Strong fundamentals of Data Engineering best practices and guidelines. ~ Solid hands on working knowledge on SQL. ~ Experience in managing and implementing successful projects...SQLFull time
Citi
Chennai1 day ago - ...Python Data Engineer: - Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical... ...data pipelines. High proficiency in Python, Scala and Spark for applied large-scale data processing. Expertise with big...SQL
Dexian India
Chennai1 day ago - ...involves building and maintaining large-scale data processing and ETL pipelines using... ...platform • Write efficient PySpark and Spark SQL transformations • Process large volumes... ...issues • Work closely with data engineers and business teams Primary Skill (Mandatory...SQLFull time
- Description :Lead Data Engineer (Azure)Role Summary : Lead the technical design and delivery of scalable data solutions on the Microsoft... ...: Build and optimize robust data pipelines using Python, PySpark, and SQL.- Operations : Implement CI/CD pipelines (DevOps), ensure data...SQL
- ...pipelines for structured and unstructured data. ~ Develop and optimize SQL queries for data extraction,... ...~ Write efficient and reusable Python scripts for data manipulation, integration... ...Master's degree in Computer Science, Engineering, or related field. ~ Ability...SQL
Staples India
Chennai2 days ago - ...Description : We are seeking a highly experienced Principal Data Engineer / Senior Data Architect to lead the design, architecture, and... ...data platforms- Deep expertise in distributed systems- Strong SQL and Python/Scala skills- Experience handling TB-PB scale datasets- Strong...SQLLong term contract
- ...Desired : Bachelor of Computer Engineering Are you curious, motivated,... ...6- 10 years’ experience in Data warehouse/ETL/ELT/CLOUD projects... ...into Snowflake. Develop Python script to processes/Load/transform... ...job flows. Proficiency in SQL and scripting languages for...SQLFull time
- ...Cloud Services sector, this role sits within a fast-moving cloud data engineering practice that delivers end-to-end analytics, ETL/ELT and real-... ...for batch and streaming use cases.- Develop and productionize Python-based data services and orchestration workflows using Apache...SQL
- ...applications for the role of Principal Consultant- Sr. Snowflake Data Engineer ( Python+Cloud )! In this role, the Sr. Snowflake Data Engineer is... ...solutions to customer, work with offshore team etc. ~ Writing SQL queries against Snowflake, developing scripts to do Extract,...SQL
Genpact
Chennai16 days ago Rs 18 - 25 lakhs p.a.
...emerging area.You will be working as a part of Data Management team which is accountable for... ...as the organization`s data warehouse.The Python Programming Language team focuses on building... ...,Commitment to quality PySpark, Python, SQL (Structured Query Language) Roles and Responsibilities...SQLMount Talent Consulting
Chennai6 days ago- ...Job Title: Senior Data Engineer Location: Chennai WFO Experience: 8–10+ Years Type: Full... .... Key Skills: Big Data: Spark, Hive, HDFS, NiFi, Kafka, HBase, Phoenix... ...Oracle, PostgreSQL, MySQL Languages: Python, Scala, SQL Cloud & DevOps: AWS, Docker...SQLFull time
DMAIC Academy & Consultancy
Chennai1 day ago - ...Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize... .... ~ Strong programming skills in Python or Java (experience with PySpark or... ...data pipeline frameworks (e.g., Airflow, Spark, Kafka). ~ Proficiency in working...SQL
Crayon Data
Chennai29 days ago - ...Position : Data Scientist & AI Engineer Location : Chennai NP- Immediate Experience : 1 to 3 Years... ...and unsupervised). Proficiency in Python, R, or Scala . Experience with NumPy... ...matplotlib, seaborn , etc. Strong SQL skills and experience with relational...SQLImmediate start
L&T Technology Services
Chennai1 day ago Rs 4 - 8 lakhs p.a.
...Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-... ...hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. Hands-on experience...SQLPHOTON
Chennai6 days agoRs 2 - 5 lakhs p.a.
...Description : Develop and maintain data pipelines, ELT processes, and... ...using Apache Airflow, Python and PySpark to ensure the efficient... ...and best practices in data engineering. Document data workflows,... ...Proficiency in using Apache Airflow and Spark for data transformation, data...SQLPermanent employmentFull timePHOTON
Chennai6 days ago- We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join... ...?Compute/Processing: Glue, EMR (Spark), Lambda, Athena.... ...?Programming: Strong proficiency in Python for data manipulation, scripting, and automation...SQL
- Data Scientist & AI Engineer Start Date Starts... ...and unsupervised). Proficiency in Python, R, or Scala . Experience with... ...matplotlib, seaborn , etc. Strong SQL skills and experience with relational...SQLImmediate start
Rs 7 - 12 lakhs p.a.
...Job Title: PySpark Data Reconciliation Engineer #7+ years of relevant experience in technology and development. # Technical skillset required : (1) Language: Java or Python (2) Experience with BigData/Hadoop/Spark/Kafka (3) Experience with APIs and microservices...PHOTON
Chennai6 days ago- ...TASKS: Build and maintain data pipelines to transform, process... ...University degree in computer science, Engineering, or a related technical field... ...knowledge/skills: in SQL and relational databases preferably... ...in languages such as R, Python, Scala, Databricks (including...SQLFull timeRemote job
