Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
Fragma Data Systems's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

codersbrain
at codersbrain
1 recruiter
Tanuj Uppal
Posted by Tanuj Uppal
Remote only
6 - 10 yrs
₹5L - ₹12L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Databases
+6 more
Job Description
  • Experience in API development using Java will be a plus.
  • Excellent knowledge and experience in writing testable, scalable, flexible, robust and efficient web applications using JavaEE 6/7 technologies, specifically, Spring core, Spring Boot Spring Data, spring batch and JPA
  • Experience in successfully deploying Java-based applications in production and understanding load-balancing, authentication, and fault tolerance through Tom Cat.
  • Experience in database modeling (MySQL/NoSQL databases such as Mongo DB)
  • Knowledge of integrating with Ant, Maven, GIT and Shell scripting.
  • Strong backend experience to develop Data Layer using at least one of the ORM frameworks like Hibernate, JPA etc.
  • Strong RDBMS Skills and SQL skills. Experience in MySQL, Teradata and warehousing databases.
  • Experience in Analytics frameworks and visualization products.

  • Excellent knowledge and experience of Maven, Continuous Integration, and Continuous Delivery with Jenkins.
    • Experience with JavaScript frameworks, especially Angular is a definite plus.
Tools/Technology needs:

Java 8, J2EE , Spring Boot, Microservices, Apache Spark, DevOps, Advanced SQL, preferably with

expertise in Data engineering/Data analytics,

ELK(Elastic Search, Logstash , Kibana) stack, Teradata, any No SQL database, Hands on experience in

maintaining products on Cloud Technologies like PCF, Azure, Docker, Kubernetes, etc, NodeJS,

Angular 2x, GitLab with CI/CD, Hands on experience in Unix server, Shell scripting, Large data

processing, Performance tuning, Experience in working in various Test Automation frameworks like

Selenium, Test NG, Python, Cucumber, Karma, Karate/ Jasmine, etc

Experience in using Eclipse, Spring tool suite, Project building tools - Maven, Gradle, etc, JIRA for ALM.


Read more
Cast Software
at Cast Software
3 recruiters
Shamine Dsouza
Posted by Shamine Dsouza
Bengaluru (Bangalore)
2 - 4 yrs
₹8L - ₹10L / yr
skill iconPython
skill iconDjango
skill iconFlask
SQL
DevOps

Solution Oriented Mindset

  • Assist project in all technical aspects of tooling and DevOps
  • Proactively lead tools new versions release cycle and documentation
  • Proactively identify risks related to application /deliverables and propose a mitigation plan
  • Provide custom solutions as per customer requirements

 

Autonomy & Problem Solving Mindset

  • Work in complete autonomy to deliver project deliverables, for advanced technical deliverables, with required level of quality
  • Must have troubleshooting skills

 

Agile Mindset

  • Contribute to improvement of internal process, tooling, and quality process
  • Design, build and collect technical materials as part of project executions in a spirit of reusability for future engagements and maintain knowledge on best practices, tools, and reusable components for CAST analysis
Looking for Python developers with 2+ years of experience.
Read more
Mitibase
Vaidehi Ghangurde
Posted by Vaidehi Ghangurde
Pune
2 - 4 yrs
₹6L - ₹8L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconReact.js
skill iconAngular (2+)
skill iconJavascript
+6 more

·      The Objective:

You will play a crucial role in designing, implementing, and maintaining our data infrastructure, run tests and update the systems


·      Job function and requirements

 

o  Expert in Python, Pandas and Numpy with knowledge of Python web Framework such as Django and Flask.

o  Able to integrate multiple data sources and databases into one system.

o  Basic understanding of frontend technologies like HTML, CSS, JavaScript.

o  Able to build data pipelines.

o  Strong unit test and debugging skills.

o  Understanding of fundamental design principles behind a scalable application

o  Good understanding of RDBMS databases among Mysql or Postgresql.

o  Able to analyze and transform raw data.

 

·      About us

Mitibase helps companies find warm prospects every month that are most relevant, and then helps their team to act on those with automation. We do so by automatically tracking key accounts and contacts for job changes and relationships triggers and surfaces them as warm leads in your sales pipeline.

Read more
Licious - Gourmet Delivery Startup - Bangalore
Licious - Gourmet Delivery Startup - Bangalore
Agency job
via zyoin by Rishabh Wadhwa
Bengaluru (Bangalore)
2 - 4 yrs
₹10L - ₹25L / yr
Data Structures
Algorithms
skill iconScala
skill iconC++
skill iconC#
+5 more

Required Skills/Qualifications: 

         B.Tech/MCA in Comput

Required Skills/Qualifications: 

Any Backend Technology is acceptable

         B.Tech/MCA in Computer Science or equivalent with 1-3 years’ experience with server-side web application development.

         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

         Understanding of Version Management Tools like GitHub.

 

er Science or equivalent with 1-3 years’ experience with server-side web application development.

         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

         Understanding of Version Management Tools like GitHub.

 

Read more
Innovatily
at Innovatily
5 recruiters
Jayasri S
Posted by Jayasri S
Bengaluru (Bangalore)
4 - 10 yrs
₹10L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconAmazon Web Services (AWS)
Windows Azure
DevOps
  • Deep hands-on experience in designing & developing Python based applications
  • Hands-on experience building database-backed web applications using Python based frameworks
  • Excellent knowledge of Linux and experience developing Python applications that are deployed in Linux environments
  • Experience building client-side and server-side API-level integrations in Python
  • Experience in containerization and container orchestration systems like Docker, Kubernetes, etc.
  • Experience with NoSQL document stores like the Elastic Stack (Elasticsearch, Logstash, Kibana)
  • Development experience with modern JavaScript based front end frameworks, especially Vue.js
  • Experience in test automation and TDD
  • Experience testing interactive applications with unit testing frameworks for the various technology stacks
  • Experience in using and managing Git based version control systems - Azure DevOps, GitHub, Bitbucket etc.
  • Experience in using project management tools like Jira, Azure DevOps etc.
  • Expertise in Cloud based development and deployment using cloud providers like AWS or Azure
Read more
Transportation | Warehouse Optimization
Tom Moore
Posted by Tom Moore
Remote only
3 - 10 yrs
₹7L - ₹20L / yr
skill iconScala
skill iconC++
Functional programming
We are looking for a Backend scala developer responsible for building scala
applications and services. Your primary responsibilities will be to design and develop
these applications and services, and to coordinate with the rest of the team working
on different layers of the infrastructure. Therefore, a commitment to collaborative
problem solving, robust design, and quality product is essential
Read more
Samsung R&D Institute India-Bangalore (SRI-B)
Samsung R&D Institute India-Bangalore (SRI-B)
Agency job
via GLIDERai by Shakuntala naik
Bangalore
1 - 7 yrs
₹4L - ₹10L / yr
skill iconC++
skill iconJava
Data Structures
Algorithms
skill iconScala
+3 more
Greetings!
 
Samsung R&D Institute India-Bangalore (SRI-B) is hiring experienced software professionals. Details are as below: 
Samsung R&D Institute India-Bangalore (SRI-B) is the largest R&D Center outside of South Korea and a key innovation hub in the Samsung group. With the best of talent from India and overseas, our focus is on creating cutting edge technologies across multiple areas of Samsung’s business, that transform experiences of users both globally, as well as in local markets.

Current Opportunities:
Qualified Engineers will be hired against roles which includes Artificial Intelligence, Big Data, Machine Learning, Data Science, Analytics, Enterprise & IOT Solutions, Wearable computing, multimedia systems,3GPP, 4G/5G, Network,Modem,protocols,RTL, PHY, Android/Tizen Platforms, Healthcare/Medical solutions, Natural Language Processing, Computer vision, Image Processing, Computer Architect.

EDUCATION
- Minimum 60% in BE, B.Tech, ME, M.Tech, PhD or MCA
 
WORK EXPERIENCE
- Minimum 1 year
 
PROGRAMMING SKILLS
Any of the following:
C,C++ Java Python, Java Script, JSON, XML – Jquery, Spring, Struts,
Hibernate, iBatis, Node.js, Memcache/Redis, Cassandra/Hbase, MongoDB/CouchDB
Map Reduce, Hadoop, Spark, Hive, Mahout, Fast Data Processing – Storm – Rules Engine – Drools
 
GENERAL
Strong problem solving skills, analytical skills and trouble shooting
Good understanding of algorithms, data structures and performance optimization techniques
Hands on with Design, Coding, Debugging and Testing
Excellent communication & interpersonal skills; Team player.
 
PS: Please do share this opportunity with your colleagues and friends
Read more
Mintifi
at Mintifi
3 recruiters
Suchita Upadhyay
Posted by Suchita Upadhyay
Mumbai
5 - 10 yrs
₹8L - ₹20L / yr
skill iconJava
skill iconJavascript
MySQL
skill iconjQuery
DevOps
+2 more
Job Title: Technology Lead Responsibilities We are looking for a Technology Lead who can drive innovation and take ownership and deliver results. • Own one or more modules of the project under development • Conduct system wide requirement analysis. • Quality, on time delivery of agreed deliverables. • Mentor junior team members • Flexible in working under changing and different work settings. • Contribute to the company knowledge base and process improvements. • Participate in SDLC • Design and implement automated unit testing framework as required • Use best practices and coding standards. • Conduct peer reviews and lead reviews and provide feedback • Develop, maintain, troubleshoot, enhance and document components developed by self and others as per the requirements and detailed design Qualifications • Excellent programming experience of 5 to 10 years in Ruby and Ruby on Rails • Good understanding about Data Structures and Algorithms • Good understanding about relational and non-relational database concepts (MySQL, Hadoop, MongoDB) • Exposure to front-end technologies like HTML, CSS, Javascript as well as JS libraries/frameworks like JQuery, Angular, React etc. is a strong plus • Exposure to DevOps on AWS is a strong plus Compensation Best in the industry Job Location: Mumbai
Read more
Wibmo
at Wibmo
2 recruiters
Shirin AM
Posted by Shirin AM
Bengaluru (Bangalore)
10 - 15 yrs
₹15L - ₹18L / yr
MS SQLServer
Design patterns
Oracle Application Express (APEX)
DevOps
Responsibilities : - Implement CI/CD methodology across our product lines. - Evaluates technological choices (network/hardware related and technology/code related) by querying providers and providing evaluations of each solution include ROI - evaluations in the present and future implications, limitations, and opportunities - Managing and directly administering a staff of DevOps Engineers and Software Engineers with overall responsibility for our DevOps platform Architecture, Builds and configuration/release management. - Responsible for the promoting the software builds across various systems (development, QA, staging and production). You will be first point of contact between Dev, support teams and Production Environments, and responsible for build life-cycle management, maintain the sanity of the production environments. You will also be responsible for the upgrading the deployment automation scripts, that are created and for new implementations. - Platform Architecture Design - Understanding the end to end Infrastructure for DevOps and configuring highly available application written in Java and Database architectures. - Configuration Management tool sets - Architect and implement CM tools and solutions such as Jenkins. Implement CI/CT methodology across our product lines. - Basic of Java coding experience Database : Knowledge of SQL and working experience on MS-SQL, MYSQL or Oracle. - Knowledge of DNS / Networking systems will be added advantage Education : BE / B.Sc Maths / B. Tech Experience : 10 - 12 years
Read more
Gupshup
at Gupshup
3 recruiters
Rohan Shetye
Posted by Rohan Shetye
Mumbai
1 - 5 yrs
₹8L - ₹18L / yr
DevOps
Chef
Shell Scripting
• Experienced resource in Java, J2EE and associated technologies. • Strong experience with multi-threaded core Java application development and deployment with tomcat. • Should have worked with highly scalable web applications • Good debugging capability. Should be able to search through logs on server and narrow down to root cause of functional issue from stack trace or performance issue from logs of latency of different components. • Product development experience in agile environment will be a big plus though not mandatory. • Highly Tech Savvy and hands-on. Good exposure into design patterns • Good understanding of OOPS concepts. • Experience of working with open source technology and tools like Redis, RabbitMQ, any No SQL or Repository Git. • Should have worked on RDBMS • Should have exposure to one of unit testing tools like Junit, Test NG, Selenium • Good working knowledge on build tools like Maven or similar & CI-Jenkins
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos