Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Multinational Company providing energy & Automation digital
Multinational Company providing energy & Automation digital
Agency job
via Jobdost by Sathish Kumar
Hyderabad
3 - 5 yrs
₹10L - ₹14L / yr
Microservices
skill iconJava
Ansible
skill iconSpring Boot
Spring MVC
+8 more

Roles and Responsibilities

Java + Microservices Developer Responsibilies Hands-on experience of minimum 3-5 Years in development of scalable and extensible systems using Java. Hands-on experience into Microservices. Experience into frameworks like Spring, Spring MVC, Spring Boot, Hibernate etc. Good knowledge or hands-on experience with a minimum 1 year in Java Script Good working exposure into any Bigdata Technologies like Hadoop, Spark, Scala etc. Experience into Jenkins, Maven, Git. Solid and fluent understanding of algorithm and data structures. Excellent software design, problem-solving and analytical skills. Candidates graduated from Good schools like IIT's, NIIT's, IIIT's (Preferred). Excellent Communication Skills Experience in Database technology such as SQL & No SQL. Good understanding of Elastic Search, Redis, Routines Sync & Async
Read more
prevaj consultants pvt ltd
Nilofer Jamal
Posted by Nilofer Jamal
Remote, Chennai
8 - 12 yrs
₹30L - ₹50L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
SaaS
Restructuring
skill iconScala
+1 more
  • Candidate Should have 5+ Years Of Experience in Core Java
  • You will need strong development skills to work on and improve our Scala-based services, and be able to work together with senior teammates to create appropriate architectural design and ensure all aspects are appropriate to meet the business need.
  • Excellent Functional Design and Functional Programming skills (more than 2 years of business experience in Scala and Java projects, respectively)
  • Core skills in key supporting technologies and/or frameworks such as Play (AKKA) / Lagom
  • Proven experience working in teams in the successful delivery of complex, performant and high quality products
  • Excellent spoken and written communication skills
  • Experience of SaaS (Software as a Service) environments
  • Exposure to RESTful web APIs and a service oriented architecture
  • Experience in Linux environments, Shell scripting etc
  • Working with XML and JSON including parsing, asserting / matching and extracting
  • Experience with Continuous Integration environments and build tools, including Terraform, Jenkins, Maven, Gradle and Ant
  • Experience with messaging systems such as Apache Kafka, Amazon Kinesis, Amazon SQS and Rabbit MQ
  • Experience working on Live platform SDKs such as Twilio, AWS Elemental
Read more
Dolat Capital Market Private Ltd.
Fatema Dholkawala
Posted by Fatema Dholkawala
Mumbai
0 - 3 yrs
₹4L - ₹15L / yr
skill iconC++
Object Oriented Programming (OOPs)
skill iconC
skill iconJava
Data Structures
+5 more
  • Augmenting, improving, redesigning, and/or re-implementing Dolat's low-latency/high-throughput production trading environment, which collects data from and disseminates orders to exchanges around the world
  • Optimizing this platform by using network and systems programming, as well as other advanced techniques
  • Developing systems that provide easy access to historical market data and trading simulations
  • Building risk-management and performance-tracking tools
  • Shaping the future of Dolat through regular interviewing and infrequent campus recruiting trips
  • Implementing domain-optimized data structures
  • Learn and internalize the theories behind current trading system
  • Participate in the design, architecture and implementation of automated trading systems
  • Take ownership of system from design through implementation
Read more
Number Theory
at Number Theory
3 recruiters
Nidhi Mishra
Posted by Nidhi Mishra
Gurugram
2 - 4 yrs
₹10L - ₹15L / yr
Hadoop
Spark
HDFS
skill iconScala
skill iconJava
+2 more
Position Overview: Data Engineer (2+ yrs)
Our company is seeking to hire a skilled software developer to help with the development of our AI/ML platform.
Your duties will primarily revolve around building Platform by writing code in Scala, as well as modifying platform
to fix errors, work on distributed computing, adapt it to new cloud services, improve its performance, or upgrade
interfaces. To be successful in this role, you will need extensive knowledge of programming languages and the
software development life-cycle.

Responsibilities:
 Analyze, design develop, troubleshoot and debug Platform
 Writes code and guides other team membersfor best practices and performs testing and debugging of
applications.
 Specify, design and implementminor changes to existing software architecture. Build highly complex
enhancements and resolve complex bugs. Build and execute unit tests and unit plans.
 Duties and tasks are varied and complex, needing independent judgment. Fully competent in own area of
expertise

Experience:
The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in
algorithm, Distributed System, Data-structure, database and architectures of distributed System is mandatory.

Required Skills:
1. In-depth knowledge of Hadoop, Spark architecture and its componentssuch as HDFS, YARN and executor, cores and memory param
2. Knowledge of Scala/Java.
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of
enterprise application design patterns.
4. Good knowledge of Unix/Linux.
5. Experience working on large-scale software projects
6. Keep an eye out for technological trends, open-source projects that can be used.
7. Knows common programming languages Frameworks
Read more
Nest Pro Inc
at Nest Pro Inc
1 recruiter
Suraj Gaydhane
Posted by Suraj Gaydhane
Mumbai, Navi Mumbai
1 - 3 yrs
₹4L - ₹8L / yr
skill iconGo Programming (Golang)
skill iconAmazon Web Services (AWS)
skill iconKubernetes
skill iconDocker
RESTful APIs
+4 more

Nest is a gamified investment platform for the next-generation and young millennials of the world, to invest, play and earn returns more than a regular savings bank account. The world of gaming is merging with finance to offer a more immersive user experience and help users learn how to manage their money. We’re creating a new breed of asset managers and fin-fluencers with Nest.

We are seeking a dedicated Golang developer to join our growing company.

You will collaborate with other technical staff to deliver and maintain a fully-functional mobile application. We hope you can put your passion for software engineering to work for creating highly immersive user applications.

Your duties will include maintaining code repositories via GitHub and internal server storage modules.

 

Responsibilities

Below are some of the responsibilities a Golang developer is expected to undertake in their position:

  • Implement AWS containers to support Go implementation and successful repository maintenance
  • Utilize Kubernetes to ensure successful application development, deployment, and scaling
  • Implement Docker for smaller-scale applications that require simpler deployments
  • Employ Linux Terminal command structures to allow easy back-end operations for less-expert technical staff
  • Structure our user interface with React and ensure REST API access is available for enterprise-grade finance customers on-demand
  • Collaborate with other technical staff to ensure consistent and smooth DevOps workflows
  • Choose and implement other JavaScript libraries that will optimize performance without sacrificing security and base functionality
  • Manage multiple projects within reasonable design specifications and budget restrictions
  • QA design for errors
  • Implement feedback and changes whenever possible
  • Create visualizations that convey accurate messaging for the project.

Job Qualifications and Skill Sets

Bachelor’s degree in computer science, IT, or a related field, such as programming. Other critical skills required are:

  • Provable proficiency in Go programming
  • Excellent written and verbal communication skills
  • Minimum of two years’ experience working in programming or information technology
  • Attention to detail and Knowledge in Java is recommended
  • Portfolio of work with examples that showcase technical skill
  • Strong analytical skills
  • Time management and organizational skills
  • Knowledge of Go templating, common frameworks, and tools
  • Experience working with a team

What you’ll receive

  • A compensation competitive to premier firms
  • Incredible learning and exposure to every aspect of a funded financial startup as an early member, working directly with the founders.
  • Recognition and experience of working on a platform with an exponential user growth curve.
  • A fun and receptive work culture which promises to never get mundane!
  • If you love party, it is on us!

 

Read more
Jivox Software India Pvt Ltd
Remote only
3 - 6 yrs
₹15L - ₹23L / yr
Object Oriented Programming (OOPs)
skill iconAmazon Web Services (AWS)
skill iconJava
J2EE
skill iconSpring Boot
+4 more

Your Opportunity

  • Own and drive business features into tech requirements
  • Design & develop large scale real time server side systems
  • Quickly create quality prototypes
  • Staying updated on emerging technologies
  • Ensuring that all deliverables adhere to our world class standards
  • Promote coding best practices
  • Mentor and develop junior developers in the team

 

Required Experience:

  • 4+ years of relevant experience as described below
  • Excellent grasp of Core Java, Multi Threading and OO design patterns
  • Experience with Scala, functional, reactive programming and Akka/Play is a plus
  • Excellent understanding of data structures and algorithms
  • Solid grasp of large scale distributed real time systems
  • Prior experience on building a scalable and resilient micro service
  • Solid understanding of relational databases, NoSQL databases and Caching systems
  • Good understanding of Big Data technologies such as Spark, Hadoop is a plus
  • Experience on one of AWS, Azure or GCP

 

Who you are :

  • You have excellent and effective communication and collaborative skills
  • You love problem solving
  • You stay up to date with the latest technologies and then apply them in real life
  • You love paying attention to detail
  • You thrive in meeting tight deadlines and prioritising workloads
  • Ability to collaborate across multiple functions

 

Education:

Bachelor’s degree in Engineering or equivalent experience within the field

Read more
appzui
at appzui
3 recruiters
Vijay P
Posted by Vijay P
Remote only
3 - 6 yrs
₹8L - ₹14L / yr
skill iconNodeJS (Node.js)
skill iconJava
skill icon.NET
skill iconJavascript
SQL
+4 more

About Us

We help our customers to Go Digital at 3x Less Cost and 3x Less Time!

appZUI nGage, our App-as-Service platform, accelerates the digital idea to profit journey. Serving more than 250K consumers in US, UK, Switzerland, Australia, India and other geographies with several exciting digital transformations.

Know more:https://bit.ly/az-godigital">http://bit.ly/az-godigital

 

Role & Responsibilities

We are looking for a Senior developer/Architect to be part of our growing team. In this role you will be handling

  • Design and architecture of various core platform components
  • Develop and deliver various products for our customers
  • Mentor and develop various team members

 

Skills & Capabilities

  • System design for function, scale, security and maintenance
  • Data engineering concepts and practice
  • Test driven development
  • Server-side skills: Nodejs/.Net/Java, Devops, SQL, microservices
  • DevOps & SRE skills: Jenkins, Prometheus, Grafana
  • System modelling and visualization skills
  • Written & oral communication skills
  • Front-end skills: (nice to have) Ionic, Angular/React, Javascript, HTML, CSS

 

What you can expect from us

  • Product engineering culture: hypothesis-develop-test-evolve
  • Failures are part of learning and growing
  • Organization structure and processes to maximize creativity and openness
  • Success is about 5 WINS: Customer, Employee, Supplier, Society and Investor
Read more
Unifize Inc.
at Unifize Inc.
1 recruiter
Avinash Sultanpur
Posted by Avinash Sultanpur
Remote only
0 - 2 yrs
₹8L - ₹12L / yr
skill iconGo Programming (Golang)
skill iconPython
skill iconJava
skill iconRuby
skill iconNodeJS (Node.js)
+5 more
Skills:
  • In-depth knowledge of at least one programming language such as Clojure, Go, Python, Java, Javascript (Node), Ruby, Erlang/Elixir
  • Thorough understanding of PostgreSQL. Experience working with views, common table expressions (CTE), window functions, joins, different kinds of indexes, etc.
  • Practical knowledge of Linux server management
  • Understanding of functional programming concepts
  • Knowledge of Chef, Puppet, Salt, etc. is a plus
  • Experience in distributed systems is a plus

Responsibilities:

  • Plan future implementations by working closely with the product team
  • Deliver an amazing user experience by working with the front-end developers
  • Write test suites and deploy code into production
  • Setup monitoring and alerts for in-production services
  • Automate deployments

Continue if:
  • You want to build a world-class Saas B2B communication product, using the latest tools, from scratch
  • You love to code 8+ hours a day and solve hard problems by building software you are proud of
  • You enjoy working with directly with amazing entrepreneurs
  • You are driven by the desire to learn
  • You like the pressure to perform because it makes you a better person
  • You are passionate about getting stuff done
  • You are passionate about making a tangible difference in the world
  • Passionate about writing elegant, functional efficient code

 

Recruitment stages:
  1. Resume Screen
  2. Phone screen
  3. Technical interview and take-home assignment
  4. Interview with founders
  5. Offer

Why Unifize:
  • The co-founders have been running companies in at least five countries over the past fifteen years, including deep experience in technology, operations and sales in engineering/manufacturing businesses.
  • We are part of Techstars first India batch, and part of Target and Airbus Accelerators
  • Attended universities that are consistently ranked in the Top 10 in the world.
  • We have a track record of raising capital and strong existing relationships with the finance community in both India, the US and the UK. We have funding for at least the next 24 months.
  • We have strong domain expertise in the industry they are trying to disrupt. However, we still followed the discipline of spending six months doing rigorous customer development spanning six countries before defining their product or writing a single line of code. We have already identified and are working with ten customers.
  • We have very high expectations from the candidates that we do select, especially in terms of first-principles thinking, communication and accountability. We will not select average candidates, and we want to encourage our employees to see Unifize as a learning ground for possibly starting their own technology businesses in the future.
  • We strongly believe in evidence-based decisions, transparency, corporate governance, meritocracy, and an open forum for discussion.
  • We explicitly want to build a team from different backgrounds and with a wide range of interests and experiences. We are committed to building a gender-balanced organization.

About Unifize:
  • Unifize helps teams that manage repeatable processes reduce wasted time by up to 95% by organizing their emails and other conversations around objectives.
  • We build a cloud-based chat application that helps these companies measure and reduce time and errors in their communication processes, so their teams can focus on selling better products to happier customers.
Read more
Healofy
at Healofy
3 recruiters
Shubham Maheshwari
Posted by Shubham Maheshwari
Bengaluru (Bangalore)
5 - 10 yrs
₹15L - ₹50L / yr
Cassandra
skill iconJava
skill iconScala
Aerospike
Spark
+6 more
RESPONSIBILITIES:   1. Full ownership of Tech right from driving product decisions to architect to deployment. 2. Develop cutting edge user experience and build cutting edge technology solutions like instant messaging in poor networks, live-discussions, live-videos optimal matching. 3. Using Billions of Data Points to Build User Personalization Engine.  4. Building Data Network Effects Engine to increase Engagement & Virality.  5. Scaling the Systems to Billions of Daily Hits. 6. Deep diving into performance, power management, memory optimization & network connectivity optimization for the next Billion Indians.  7. Orchestrating complicated workflows, asynchronous actions, and higher order components.  8. Work directly with Product and Design teams. REQUIREMENTS:   1. Should have Hacked some (computer or non-computer) system to your advantage. 2. Built and managed systems with a scale of 10Mn+ Daily Hits 3. Strong architectural experience.  4. Strong experience in memory management, performance tuning and resource optimizations.  5. PREFERENCE- If you are a woman or an ex-entrepreneur or having a CS bachelors degree from IIT/BITS/NIT. P.S. If you don't fulfill one of the requirements, you need to be exceptional in the others to be considered.
Read more
Logistimo
at Logistimo
1 recruiter
Gaurav Shetty
Posted by Gaurav Shetty
Bengaluru (Bangalore)
2 - 5 yrs
₹15L - ₹25L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconJava
skill iconScala
skill iconPython
+1 more
• 2-4 years of strong experience in Java, Scala, Java script, Node JS or Python programming language to write performant, scalable and unit tested code • Good object-oriented design skills, and knowledge of design patterns • Working knowledge of Angular JS • Proven commitment to quality and an ability to create maintainable and extensible code • Experience in working with Agile software methodologies • Good experience working with relational databases such as MariaDB/MySQL • Proficient working in a Linux or UNIX environment • Ability to maintain a balance between working independently and in collaboration with internal stakeholders • Experience with Nginx, Tomcat, Redis, Cassandra,Zookeeper, ActiveMQ and Hadoop is a plus • Bachelors or Masters in Computer Science engineering or related discipline
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos