Search Results: 4,542 vacancies
...Data-Engineering Tech-Stack
~8-12+ years experience with cloud technologies AWS
~ Python, Py-Spark as middle tier coding technology, Your proficiency in Python , SQL , and Pyspark should be impressive.
~ Expertise in developing and managing data pipelines, ML models...
...years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB...
...Job Role: Software Developer (Python Pyspark AWS Devops )
Experience: 5 Years Mandatory Skills: Python Pyspark AWS Devops
Location: Pune Work mode: Hybrid
Budget: 16 LPA Education: Graduate
Technology Skills:
Strong knowledge of Python/Pyspark and Bash...
...Saleforce, SAP, Codata is a plus.- Candidates with AWS Certification will be preferred.Tools : Aurora Postgres DB, SQL, Spark, Kafka, Python, Redshift, Snowflake, Airflow, Glue (ETL, Catalog, Crawler), Lambda, SQS, SNS, Data Lake, Cloud watch, Cloud Trail, DBT, AWS SDK, Boto...
Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience... ...Delta Lake Architecture- Should have hands-on experience in SQL, Python and Spark (PySpark)- Candidate must have experience in AWS/ Azure...
Lead Data Engineer Locations : Hyderabad, Bengaluru, Pune. Skills :- Programming : Python , Pyspark/Scala, Flask.- API Microservices , ECS Fargate.- Bigdata AWS : EMR, Glue, Athena, Redshift, Lambda.- Analytics : AWS Quicksight.- Database : Postgres RDS,Mongo (SQL/NoSQL).- Orchestration...
...to 30 lpaNotice period : Max. 30 daysMust Have :- Databricks and PySpark- PySQL- SQL- Cloud Platforms- ELT ToolsRoles :- Design, develop,... ...in SQL and experienced with other programming languages such as Python.- Familiarity with ETL tools and data integration techniques.- Experience...
...Apache Kafka pipelines for real-time data streaming and event-driven architectures.
Development and deep technical skill in Python , PySpark , Scala, NIFI and SQL/Procedure.
Working knowledge and understanding on Unix/Linux operating system like awk, ssh, crontab...
Job Description : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark....
...Join Our Team: Senior Data Analyst - PySpark Domain: BFSI
Role Overview:
Define & gather source data for insights & use cases.
Map & join multiple data sets from various sources.
Identify data inconsistencies & propose migration solutions.
Aid in data migration...
...towards design, architecture, development, and operationalization of Data Engg & AI/ML models across Big Data Ecosystem (PySpark, Hadoop, Snowflake, Python) - Experience in architecture, design, and implementation of data intensive applications for practical use-cases-...
...Consultant ,PySpark/HadoopDeveloper - ITO080454
Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes... .../ Data Lake solutions;
• Well versed and Hand-on in Python, Spark,pyspark, Hdfs, hive, Hadoop. Spark SQL optimization.
•...
...AM-Pyspark Developer - ANA009537
With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with... ...quality and accessibility standards.
• Uses programming in Python & Pyspark to build robust data pipelines and dynamic systems.
•...
...Data Engineer - NifiExperience : 5 Years - 8 Years Notice period : Immediate - 30 daysSkills : Experience in Nifi and Data Engineering (Pyspark, SQL, ETL). Secondary : Big Data/Hadoop, Hive, Spark4+ Years in Data Engineer/1-2 yrs exp in Nifi We are seeking a highly skilled...
...Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- Proven experience working with Databricks, Spark, and PySpark in real-time data processing environments.- Strong understanding of streaming data architectures, messaging systems (e.g., Kafka),...
...We are looking for a skilled Python Developer who is proficient in building robust microservices-based applications and has experience working with PySpark for big data processing tasks. The ideal candidate will have a strong foundation in Python development, a deep understanding...
...years
Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse
Secondary Skills: U-SQL, Spark, Scala, Python
Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram
Mode of work: Hybrid at Infogain office locations mentioned above
Notice...
...We are looking for a AVP - Python Location - Bangalore / Chennai
BE/B.Tech(CSE, Electronics preferred) and 7+ Years of relevant experience... ...scalable applications in Python, Flask, Dask, Celery, and PySpark
•Understanding and/or basic working experience in front end technologies...
...processing, and extracting value from datasets.
At least 2 years of experience in building applications with Python (Vectors, Pandas, Flask/FastAPI), PySpark, SQL and/or Delta Lake and big data technologies.
Passion for creating data management solutions from scratch...
Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing...
