Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
Fragma Data Systems's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

a global provider of Business Process Management and Outsourcing solutions
a global provider of Business Process Management and Outsourcing solutions
Agency job
via Jobdost by Saida Pathan
Pune, Mumbai, Bengaluru (Bangalore)
4 - 8 yrs
₹14L - ₹16L / yr
DNN
skill icon.NET
DotNetNuke
ASP.NET
skill iconC#
+13 more

Job Summary

  • Candidate will be responsible for providing full life-cycle development (design, coding, and testing) and maintenance of web-based system on Azure
  • Candidate should have experience in GitHub, knowledge of DevOps is a plus
  • Experienced in designing and implementing web portals, experience with DNN is must
  • Ability to work with multiple languages including C#, ASP.Net, MVC, Javascript and related libraries, HTML, Complex SQL queries, CSS, BootStrap, JSON.
  • Experience in Agile project management methodology
  • Developing and Delivering Excellent Web based solutions/portals/sites based on customer’s requirement within the stipulated timeline
  • The candidate should be flexible to learn new technology and platform and should be creative, innovative for improvement ideas, detail oriented, diligent, and eager to learn and grow

Duties and Responsibilities

  • Understand business requirements to apply logic to integrate functionalities
  • Identify and understand any technical bugs on the server, site, log files or modules and work on resolving the bugs
  • Understand how FTP server is setup for the site
  • Understand system/site technical requirements and suggest enhancements if applicable
  • Designing, coding, unit Testing, and integration with Database
  • Handle site deployment
  • Designing, coding, debugging, technical problem solving, and writing Unit Test cases, etc.

Qualifications

Education / Certification

  • B.E. / B.Tech. /MSC in Computer Science or IT.
  • MCAD/MCSD/MSITP/MCPD

Technical Expertise

  • ASP/ASP.NET/VB.NET/MVC/C#/SQL Server 2012+
  • HTML, Javascript, Jquery, CSS, Bootstrap
  • GitHub/DevOps, Azure
  • Web API/ Web Services, Email Services

Skills and Abilities

  • Be able to work with diverse global teams and in an individual contributor role as needed
  • Excellent English written and verbal communication skills (for local team and global stakeholders/team members)
  • Strong task management skills including time management, and ability to manage multiple projects simultaneously
  • Flexibility required to attend late evening meetings with global team members
  • Attention to detail and delivering quality projects and knowledge assets

 

Read more
RaRa Now
at RaRa Now
3 recruiters
Puneeta Mishra
Posted by Puneeta Mishra
Remote only
5 - 8 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconNodeJS (Node.js)
+5 more

About Rara Delivery

Not just a delivery company…

RaRa Delivery is revolutionising instant delivery for e-commerce in Indonesia through data driven logistics.

RaRa Delivery is making instant and same-day deliveries scalable and cost-effective by leveraging a differentiated operating model and real-time optimisation technology. RaRa makes it possible for anyone, anywhere to get same day delivery in Indonesia. While others are focusing on ‘one-to-one’ deliveries, the company has developed proprietary, real-time batching tech to do ‘many-to-many’ deliveries within a few hours.. RaRa is already in partnership with some of the top eCommerce players in Indonesia like Blibli, Sayurbox, Kopi Kenangan and many more.

We are a distributed team with the company headquartered in Singapore 🇸🇬 , core operations in Indonesia 🇮🇩 and technology team based out of India 🇮🇳

Future of eCommerce Logistics.

  • Data driven logistics company that is bringing in same day delivery revolution in Indonesia 🇮🇩
  • Revolutionising delivery as an experience
  • Empowering D2C Sellers with logistics as the core technology


About the Role
  • 5 - 7 years Experience with the following technologies: Core Java/J2EE, Spring Boot, Creating API, Hibernate, JDBC, SQL/PLSQL, messaging architecture, REST/Web services, Linux
  • Expertise in application, data and infrastructure architecture disciplines
  • Advanced knowledge of architecture, design and business processes
  • 4+ years of Java, J2EE development experience
  • Strong technical development experience in effectively writing code, performing code reviews, and implementing best practices on configuration management and code refactoring
  • Experience in working with vendor applications
  • Experience in making optimized queries to MySQL database
  • Proven problem solving and analytical skills
  • A delivery-focused approach to work and the ability to work without direction
  • Experience in Agile development techniques, including Scrum
  • Experience implementing and/or using Git
  • Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
  • Bachelor degree in Computer Science or related discipline preferred
Read more
full service & Product engineering USA based company
full service & Product engineering USA based company
Agency job
via Miles Ahead Consultants by Hitesh Passi
Bengaluru (Bangalore), Hyderabad
5 - 7 yrs
₹10L - ₹20L / yr
skill iconGo Programming (Golang)
DevOps
skill iconVue.js
skill iconDocker
skill iconKubernetes
+2 more
Hands-on experience of minimum 5 years into Golang. Proficient exp of minimum 2-3 years into DevOps* - end to end project implementation. Strong expertise on DevOps concepts like Continuous Integration (CI), Continuous delivery (CD) and Infrastructure as Code, Cloud deployments. Good experience of minimum 1 year into ""Terraform"". Good experience of min 6months - 1 year into frontend technology like Vue.js Good experienced or working knowledge in Docker, Kubernetes, Helm etc. Good Communication skills with Orgainsational behaviour.

Skills

Hands-on experience of minimum 5 years into Golang. Proficient exp of minimum 2-3 years into DevOps* - end to end project implementation. Strong expertise on DevOps concepts like Continuous Integration (CI), Continuous delivery (CD) and Infrastructure as Code, Cloud deployments. Good experience of minimum 1 year into "Terraform". Good experience of min 6months - 1 year into frontend technology like Vue.js Good experienced or working knowledge in Docker, Kubernetes, Helm etc.
Read more
Leading Logistics-tech Platform
Leading Logistics-tech Platform
Agency job
via Unnati by Rakhi Gayen
Bengaluru (Bangalore)
1 - 3 yrs
₹14L - ₹18L / yr
skill iconJava
Software Development
Logistics
skill iconRuby
Clojure
+4 more
Work with a new-age, reliable logistics platform aiming to disrupt on-time delivery with ultimate efficiency! Read more.
 
Our client is a leading intra-city delivery solutions provider, that focuses on sorting out the largely unorganised logistics space in the country. It is also an aggregator of inter-city mini trucks and large transport vehicles for the Retail, Ecommerce and FMCG sectors. Their app is a platform used by their clients and truck owners, providing GPS enable vehicles, 24X7 support, economical pricing and multi-capacity loaders. Truckers can use their location and choose their transport jobs, while the companies get to pick the drivers as per their ratings.
 
With a fleet of over 44000 trucks and clients like Britannia, Bisleri, Amazon, Flipkart, Metro CashnCarry, Gati, Delhivery and more, the 5-year old platform has raised over $20Mn across multiple funding rounds. Founded and led by IIT-KG alumni, the company has operations in major cities across the country and looking to make inroads in other sectors and verticals.
 
As a Software Development Engineer -1, you will solve complex and interesting problems, converting design into code fluently.
 
What you will do:
  • Working with Databases and Linux platform
  • Understanding algorithms, databases and their space and time complexities
  • Writing unit and integration tests with reasonable coverage of code and interfaces
  • Solving complex and interesting problems
  • Taking up a high level of ownership and commitment towards the business and product vision
 

What you need to have:

  • Minimum 1-year experience
  • Strong problem-solving skills
  • Good understanding of data structures & algorithms and their space & time complexities
  • Strong hands-on and practical working experience with at least one programming language: C/Java/C++/C#
  • Excellent coding skills – should be able to convert the design into code fluently
  • Strong technical aptitude and a good knowledge of CS fundamentals
  • Hands-on experience working with Databases and Linux platform is a plus
  • B-Tech in Computer Science or equivalent from a reputed college
  • Good experience in at least one general programming language (Java, Ruby, Clojure, Scala, C/C++, Python and SQL)
  • A solid foundation in computer science, with strong competencies in data structures, algorithms, and software design.
  • Have a penchant for solving complex and interesting problems, Worked in startup like environment with high levels of ownership and commitment
  • Excellent coding skills – should be able to convert design into code fluently
  • Good skills to write unit & integration tests with reasonable coverage of code & interfaces
  • TDD is a plus
Read more
Amazon India
at Amazon India
1 video
58 recruiters
Sanjay Sriram
Posted by Sanjay Sriram
Bengaluru (Bangalore)
3 - 9 yrs
₹30L - ₹60L / yr
skill iconJava
Data Structures
Algorithms
skill iconScala
skill iconC++
+7 more

Role- Software Development Engineer-2

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.


Top Skills

  • You write high quality, maintainable, and robust code, often in Java or C++ or C#
  • You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
  • You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.
  • Roles & Responsibilities
  • You solve problems at their root, stepping back to understand the broader context.
  • You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
  • You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
  • You recognize and use design patterns to solve business problems.
  • You understand how operating systems work, perform and scale.
  • You continually align your work with Amazon’s business objectives and seek to deliver business value.
  • You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
  • You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
  • You communicate clearly with your team and with other groups and listen effectively.


Skills & Experience

  • Bachelors or Masters in Computer Science or relevant technical field.
  • Experience in software development and full product life-cycle.
  • Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
  • Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
  • Proficiency in SQL and data modeling.


About Amazon.com

“Many of the problems we face have no textbook solution, and so we-happily-invent new ones.” – Jeff Bezos

Amazon.com – a place where builders can build. We hire the world's brightest minds and offer them an environment in which they can invent and innovate to improve the experience for our customers. A Fortune 100 company based in Seattle, Washington, Amazon is the global leader in e-commerce. Amazon offers everything from books and electronics to apparel and diamond jewelry. We operate sites in Australia, Brazil, Canada, China, France, Germany, India, Italy, Japan, Mexico, Netherlands, Spain, United Kingdom and United States, and maintain dozens of fulfillment centers around the world which encompass more than 26 million square feet.

Technological innovation drives the growth of Amazon, offering our customers more selection, convenient shopping, and low prices. Amazon Web Services provides developers and small to large businesses access to the horizontally scalable state of the art cloud infrastructure like S3, EC2, AMI, CloudFront and SimpleDB, that powers Amazon.com. Developers can build any type of business on Amazon Web Services and scale their application with growing business needs.

We want you to help share and shape our mission to be Earth's most customer-centric company. Amazon's evolution from Web site to e-commerce partner to development platform is driven by the spirit of invention that is part of our DNA. We do this every day by inventing elegant and simple solutions to complex technical and business problems. We're making history and the good news is that we've only just begun.

Read more
Tatsam
at Tatsam
1 recruiter
Yash Pal Mittal
Posted by Yash Pal Mittal
Remote, NCR (Delhi | Gurgaon | Noida)
2 - 4 yrs
₹10L - ₹15L / yr
skill iconJava
Spring
skill iconGit
DevOps
SOLID
+4 more

Responsibilities:

  • Your primary responsibility as a senior backend engineer will be to architect and develop a scalable and robust micro-services backend with strong Java, Spring(Boot), SQL, AWS/GCP.
  • Experience being part of a software development team in an Agile/Lean/Continuous Delivery environment
  • Be a key performer in a high-performance product engineering team

Qualifications:

  • 2 to 4 years of overall IT experience. Most of this experience in Java (Core Java, Spring boot, Java collections, Java Multithreading)
  • Should have experience designing database schemas - SQL and NoSQL.
  • Exposure to frameworks like Spring, Hibernate, Play would be a plus
  • Experience with microservices architecture would be beneficial.
  • Working knowledge of any public cloud (AWS, GCP or Azure)
  • Broad understanding and experience of real-time analytics, NoSQL data stores, data modeling and data management, analytical tools, languages, or libraries
  • Knowledge of container tech like Docker, Kubernetes would be a plus.
  • Bachelor's Degree in Computer Science or Engineering.
Read more
Unifytech
at Unifytech
20 recruiters
Sunil Bolisetty
Posted by Sunil Bolisetty
Mumbai
4 - 10 yrs
₹4L - ₹30L / yr
skill iconScala
skill iconJava
skill iconPython
  1. Should be very strong Scala development(Coding)
  2. With Any combination of Java/Python/Spark/Bigdata
  3. 3+ years experience in Core Java/Scala with good understanding of multithreading
  4. The candidate must be good with Computer Science fundamentals
  5. Exposure to python/perl and Unix / K-Shell scripting
  6. Code management tools such as Git/Perforce.
  7. Experience with large batch-oriented systems 
  8. DB2/Sybase or any RDBMS
  9. Prior experience with financial products, particularly OTC Derivatives
  10. Exposure to counterparty risk, margining, collateral or confirmation systems
Read more
Bengaluru (Bangalore)
5 - 8 yrs
₹10L - ₹15L / yr
Spark
Hadoop
skill iconMongoDB
skill iconJava
skill iconScala
+1 more
Interested in building high performance search systems to handle petabytes of retail data, while working in an agile, small company environment? At CodeHall Technologies, you will have the opportunity to work with the newest technology in Search and Browse.  We are working on systems that powers and personalizes site search, considering the user intent for every query, providing a wholly unique search experience that is engaging - designed to display the most relevant results through Findability.  Primary responsibilities:   Building high performance Search systems for personalization, optimization, and targeting Building systems with Hadoop, Solr, Cassandra, Flink, Spark, Mongo DB Deep understanding of HTTP and REST principles Good diagnostic and troubleshooting skills… Unit testing with JUnit, Performance testing and tuning Working with rapid and innovative development methodologies like: Kanban, Continuous Integration and Daily deployments Highly proficient Software engineering skills in Java Coordination with internal and external teams Mentoring junior engineers Participate in Product design discussions and decisions Minimum requirements: BS/MS in CS, Electrical Engineering or foreign equivalent plus relevant software development experience At least 5-8 years of software development experience Expert in Java, Scala or any other object oriented language Proficient in SQL concepts (HiveQL or Postgres a plus) Additional language skills for scripting and rapid application development Desired skills and experience: Working with large data sets in the PBs Familiarity with UNIX (systems skills a plus) Working experience in Solr, Cassandra, Mongo DB, and Hadoop Working in a distributed environment and has dealt with challenges around scaling and performance Proven ability to project and meet scheduled deadlines Self-driven, quick learner with attention to detail and quality
Read more
Artivatic
at Artivatic
1 video
3 recruiters
Akanksha naini
Posted by Akanksha naini
Bengaluru (Bangalore)
2 - 5 yrs
₹6L - ₹15L / yr
skill iconJava
skill iconPython
Performance tuning
Performance analysis
skill iconScala
+1 more
About Artivatic :- Artivatic is a technology startup that uses AI/ML/Deep learning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. The artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access, and health benefits with alternative data sources to increase their productivity, efficiency, automation power, and profitability, hence improving their way of doing business more intelligently & seamlessly. - Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. - We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore
Read more
UnitedHealth Group Inc. iS 5th largest company in the world , in the Fortune lis
UnitedHealth Group Inc. iS 5th largest company in the world , in the Fortune lis
Agency job
via Next Step Services by shakun shahi
Hyderabad
5 - 13 yrs
₹15L - ₹26L / yr
skill iconJava
Agile/Scrum
ITIL
DevOps
Big Data
+2 more
Full Stack Developer belongs to Self-Organizing and Cross Functional development team and is able to convert sprint backlog items to shippable product. He collectively owns end to end development responsibility for a given Agile Team / POD. He will design, code and test the user stories committed for a sprint. Works independently under limited supervision. Possess skills to effectively deal with issues,challenges within field of specialization to develop application solutions. Primary Responsibilities:  Lead an agile team within a Release Team/Value Stream or IT Support Team.  Accountable for team delivery.  Develop and automate business solutions by creating new and modifying existing software applications.  Develop innovation, strategies, processes, and best practices  Technically hands on and excellent in Design, Coding and Testing.  Collectively responsible for end to end product quality.  Creation of high/low level application design.  Participates and contributes in Sprint Ceremonies.  Promote and develop the culture of collaboration, accountability & quality.  Provides technical support to team. Helps team in resolving technical issues .  Closely working Business Teams, Onshore partners, deployment and infrastructure teams.  <Others – If any> Required Qualifications:  8 - 13 Years of experience - working on multiple layer of technology  Excellent verbal, written and interpersonal communication skills  Demonstrate capability to create high/low level designs.  Engineering Practices o Agile:  Working experience of 2+ year in “Agile team”.  Understanding of various agile methodologies such as Scrum, Kanban  Working experience of Test Driven Development. o ITIL/ITSM: Good understanding of IT Support / Production Support o Data / Information Security – Working knowledge on the below –  Common security vulnerabilities, their causes and implementations to fix the same.  Security scanning methodologies and tools (e.g. HP Fortify, Whitehat, Webinspect) o Good in Data Structure, Algorithms and Design Patterns. o Demonstrates excellent problem solving skills. o Good in design thinking and approach to solve business problem by applying suitable technologies (cost efficient, high performance, resilient and scalable).  Common Technical Skills o Database: 2+ year working experience of database (SQL or PL/SQL), Good knowledge of. Exposure to Big Data, NoSQL/Flat Database. o API /Web Services: 1+ year working experience in Web Services / API, REST Architecture etc. o DevOps:  Working experience in set up or maintenance of CI/CD pipeline (test, build , deployment and monitoring automation)  2+ years working experience of software configuration management and packaging.  Experience in using automated deployment and release management tools such as XL Deploy, XL Release, Jenkins.  2+ years working knowledge of build tools such as Maven/Gradle o Cloud: Working experience or good knowledge of cloud platforms (e.g OpenShift, Azure, AWS). Capable of demonstrating how to develop a sample cloud based application / micro- services architecture. o Open Source:  Demonstrate hands on knowledge of OpenSource adoption and use cases.  Real implementation experience of one or more open source technology (MySQL, JBoss Platform, Apache Camel)  Good to have - Contributing to one or more technical forums related to an open source technology.  Product / Project / Program Related Tech Stack : o Front End – <Desired Technologies and Tools> o Back End – <Desired Technologies and Tools> o Middleware – <Desired Technologies and Tools> o Testing - <Desired Technologies and Tools> o DevOps - <Desired Tools> o Others – <Desired Technologies and Tools> o Certifications - <Desired Certifications> o Development Methodology / Engineering Practices – Agile (SCRUM / KANBAN / SAFe) Preferred Qualifications:  Excellent verbal, written and interpersonal communication skills  Ability to work collaboratively in a global team with a positive team spirit  Knowledge of US Healthcare domain  Knowledge or certification – SAFe  Knowledge of certification – ITIL  Work experience in product engineering
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos