Cutshort logo
Wissen Technology logo
Data Engineer-Python AWS Spark Scala (Python is must)
Data Engineer-Python AWS Spark Scala (Python is must)
Wissen Technology's logo

Data Engineer-Python AWS Spark Scala (Python is must)

Tony Tom's profile picture
Posted by Tony Tom
5 - 9 yrs
Best in industry
Pune
Skills
skill iconPython
skill iconDjango
skill iconFlask

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.


Required Skills:

  • Python: Advanced proficiency with extensive experience in building data pipelines.
  • AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
  • Spark: Proficient in using Apache Spark for large-scale data processing.
  • Scala: Working knowledge of Scala for Spark programming.
  • Strong understanding of data warehousing concepts and ETL processes.
  • Experience with SQL and relational databases.
  • Familiarity with data governance and security best practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Wissen Technology

Founded :
2000
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable

About

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains.

With offices in US, India, UK, Australia, Mexico, and Canada, we offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.


Leveraging our multi-site operations in the USA and India and availability of world-class infrastructure, we offer a combination of on-site, off-site and offshore service models. Our technical competencies, proactive management approach, proven methodologies, committed support and the ability to quickly react to urgent needs make us a valued partner for any kind of Digital Enablement Services, Managed Services, or Business Services.


We believe that the technology and thought leadership that we command in the industry is the direct result of the kind of people we have been able to attract, to form this organization (you are one of them!).


Our workforce consists of 1000+ highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like MIT, Wharton, IITs, IIMs, and BITS and with rich work experience in some of the biggest companies in the world.


Wissen Technology has been certified as a Great Place to Work®. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.

Read more

Connect with the team

Profile picture
Lokesh Manikappa
Profile picture
Vijayalakshmi Selvaraj
Profile picture
Adishi Sood
Profile picture
Shiva Kumar J Goud

Company social profiles

bloglinkedinfacebook

Similar jobs

Sudoviz
at Sudoviz
1 recruiter
Vineet Kumar
Posted by Vineet Kumar
Remote only
2 - 3 yrs
₹5L - ₹8L / yr
skill iconPython
skill iconDjango
skill iconFlask
Neo4J
NOSQL Databases
+2 more

Who we are:

 

Software is the connective tissue for much of the information economy. At Sudoviz, we are making it super easy for companies to build and operate secure software. Sudoviz is an Application Security Posture Management platform for the enterprise AppSecurity and software development teams. We're a covid-era, fully remote startup transforming the way enterprise software teams do security.

 

About you:

 

• We're looking for someone scrappy, hungry, and eager to take on the challenge as a Backend Engineer on our Platform Engineering Team.

• An ideal candidate has strong programming experience and has experience in architecting and building highly scalable systems.

• You are energetic and enthusiastic about learning and teaching.

• You understand and uphold the values and company culture as well as possess a positive mindset and a can-do attitude.

• You should be willing to contribute across all elements of the technical stack while working on our Platform

 

Minimum qualifications:

 

• 2+ years of professional backend software development experience

• Experience designing and implementing highly scalable and performant RESTful micro-services using GraphQL

• Proficiency in Python web and data science libraries (flask, Django, pandas, numpy)

• Fluency in database technologies (e.g. RDBMS, NoSQL, and Graph Databases - Neo4j)

• Experience with Version control like Git

• Experience using AWS, Kubernetes, and Docker containers

• Agile/Scrum/Lean development methodology experience

 

Must have

 

• Bachelor's degree in Computer Science

• Good project management skills and documentation skills

• Proficiency in Written and Verbal communication

• Positive solution-oriented mindset

• Ability to achieve consensus with peers and clearly share status updates

• Self-motivated and Self-managing individual

• Clearly and concisely communicate about complex technical, architectural problems

 

Nice to have

 

1. Passion for Open source contribution

2. Experience in peak performance organizations/product companies

3. Experience working with a remote team with a global culturally diverse team

 
 
Candidates preview
Read more
B2B E-com platform
B2B E-com platform
Agency job
via Qrata by Rayal Rajan
Delhi
1 - 5 yrs
₹10L - ₹30L / yr
skill iconDjango
skill iconFlask
Gin
Revel
skill iconPython
+1 more

About Us

We began in 2015 with an entrepreneurial vision to bring a digital change in the manufacturing landscape of India. With a team of 1500(1k cluster guys) we are working towards the digital transformation of business in the manufacturing industry across domains like Footwear, Apparel, Textile, Accessories etc. We are backed by investors such as Info Edge (Naukri.com ), Matrix Partners, Sequoia, Water Bridge Ventures and select Industry leaders.

Today, we have enabled 4000+ Manufacturers to digitize their distribution channel.

 

Roles & Responsibilities

Writing and testing code, debugging programs and integrating applications with third-party web services. To be successful in this role, you should have experience using server-side logic and work well in a team.

Ultimately, you'll build highly responsive web applications that align with our business needs. Write effective, scalable code Develop back-end components to improve responsiveness and overall performance Integrate user-facing elements into applications.

Test and debug programs

Improve functionality of existing systems Implement security and data protection solutions Assess and prioritize feature requests

Coordinate with internal teams to understand user requirements and provide technical solutions Expertise in at least one popular Python framework (like Django, Flask, etc)

Team spirit

Good problem-solving skills

 

Requirements

 

1 to 5 years of experience as a Python Developer

Hands on experience of Flask, Django or Gin or Revel or Sanic

Knowledge of design/architectural patterns will be considered as a plus

Experience working in an agile development environment with a strong focus on rapid software development

Experience in AWS or similar cloud technologies

Excellent troubleshooting and debugging skills

Proven ability to complete assigned task according to the outlined scope and timeline

Experience with messaging frameworks such as SQS/Kafka/RabbitMq

Experience with Elastic Search

Willingness to learn new and different technologies

Read more
Product based startup
Product based startup
Agency job
via Qrata by Revathi Satish
Remote only
4 - 7 yrs
₹28L - ₹40L / yr
skill iconPython
skill iconDjango
skill iconReact.js
Lead Engineer

Company is a remote-first team, looking to scale our Open Source Feature
Flagging, Remote Config and A/B Testing product. With both SaaS and on-premises customers, we are investing into our globally distributed, low latency API and making it simple for customers to deploy on their own infrastructure via Kubernetes and OpenShift.
We are looking for a Lead Server-Side Engineer, who also enjoys working on dev-ops, infrastructure and orchestration, and can help build out our existing API and infrastructure.
We are a really small team right now, and this is our first technical hire outside of the founders, so it’s a great opportunity to be part of something that is looking to scale quickly!
We are looking for someone who loves working with:
  • Python. Django Rest Framework experience would be great, but not essential! We prioritise
  • quality over quantity.
  • Postgres with InfluxDB, Oracle, MySQL and Redis experience a plus.
  • Docker, Kubernetes, Helm, OpenShift and associated tooling.
  • AWS, especially ECS, Lambda, RDS and DynamoDB. Performance and uptime are super
  • important to us.
  • The challenge of scaling a global, distributed API to 10,000+ requests per second.
  • We have SDKs in a bunch of languages, so the more polyglot you are the better.
  • If you like writing JS and React that would be awesome too.
We are an Open Source company first and foremost, so working with our community on Github to build features, fix bugs and cultivate pull requests is also on the job spec. You can check out our code on our Github pages.
We are a 100% remote team, currently based on the West Coast US and in Europe
Read more
Dukaan
at Dukaan
4 recruiters
Subhash Choudhary
Posted by Subhash Choudhary
Bengaluru (Bangalore)
2 - 7 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
skill iconElastic Search

DUKAAN - Create Your Online Store in 30 Seconds


Dukaan is an app that allows offline businesses to sell their products and services online. On our app, the users can make beautiful product catalogues (catalogs) right from a smartphone and share with their customers easily on different social media apps such as Whatsapp Business, Whatsapp, Facebook, Instagram etc. Praised by users all over India, this app has saved declining businesses by helping them transfer their shop online. The journey has just begun and we are on a mission to make India truly Digital.


Dukaan is currently powering over 5M ecommerce stores built by indian small businesses and growing at a crazy rate.  


We are looking for a Backend Engineer to join our team who will be part of our new innovations team.


Requirements:

  1. Strong knowledge of Django, Django Rest Framework and their design principles.
  2. Strong knowledge of Django ORM, should be able to leverage it to write complex and optimized queries (E.x Q queries, Case, When, Select related, prefetch related, Subqueries, Annotations, Aggregations, Filtering, etc.) .
  3. Should be able to override DRF serializers, filters and viewsets completely according to needs.
  4. Should have good experience in Class Based Views to write the backend API’s.
  5. Sound knowledge of database design patterns and modelling them to Django models.
  6. Sound knowledge of how to write test cases for the APIs.
  7. Should be able to write optimized pythonic code adhering to python PEP standards.
  8. Strong knowledge of python packaging and how to architect a code base that should be easily scalable and not get cluttered.
  9. Strong knowledge of REST API design patterns.
  10. Ability to write RAW sql queries and further database level coding will be a plus.
  11. Good Understanding of python’s asyncio, threading and multiprocessing library, their benefits and limitations along with their appropriate use cases.
  12. Hands on knowledge of celery and its corresponding message broker such as RabbitMQ, Redis, etc.
  13. Experience with building a CDC(Change Data Capture) pipeline will be a plus.
  14. Experience with Apache Kafka, Kafka connect and Debezium will be a plus.
  15. Experience with open source will be a plus.
  16. Good knowledge of Algorithms and data structures.

Responsibilities:

  1. Understand the ins and out of existing codebase and have a good grasp over it.
  2. Write clean, stable and scalable code.
  3. Write unit test cases for the APIs.
  4. Do whitebox and blackbox testing for your own code and as well as others if required.
  5. Understand and implement fast prototype solutions for the business needs.
Read more
MoodBridge Wellness Private Limited
Pune
3 - 6 yrs
₹8.4L - ₹9.6L / yr
skill iconDjango
WebSocket
Celery
skill iconPython
RESTful APIs
+2 more
Job Description: -

1) Looking for a Senior Python Developer who will be responsible to understand, decode and maintain a pre-coded web application (Platform).

2) Primary focus will be on resolving real-time bugs on the live platform, testing, maintaining it fully functional, and making it live.

3) Work with the team to define, design, and deliver new features.

4) Integration of user-facing elements developed by front-end developers with server-side logic.

5) Implementation of security and data protection.

6) Develop tools and applications by producing clean, efficient, reusable and testable code.

7) Should be able to participate in the requirements gathering and come up with efficient solutions.

8) Ensure platform is up-to-date with the latest technologies.

9) Should be a problem solver to contribute toward the success of the start-up.

10) Develop/Improve the core infrastructure and optimize the platform for high scalability.

11) Should be familiar with startup culture and be comfortable working with early-stage start-up.


Skills and Requirements: -

1) Expert in Python with complete knowledge of Python’s web framework ‘Django’ and related frameworks.

2) Good understanding of AWS and Azure platforms and able to make the platform optimize on the hosting, maintaining workload balancing on server.

3) Stronghold on Nginx, Redis and Celery.

4) A good experience in WebSocket to maintain In-Platform Chats.

5) Basic understanding of front-end technologies like Bootstrap, JavaScript,
JQuery, HTML5, CSS and AJAX while experience in Angular, Node JS, and React will be an added advantage.

6) Good hands-on experience in Creating REST APIs and API Integration with best coding practices.

7) Good knowledge of Relational and Non-Relational Databases.

8) Understanding of online payment gateways and integration knowledge.

9) Good understanding on Web Servers.

10) Experience working in an Agile development environment.

11) Data structure analysis and algorithm design, Solving complex performance problems and challenges.

12) Proficient understanding of code versioning tools like GIT and SVN.

13) Able to work with complex SQL queries and stored procedures.

14) Strong unit testing, integration testing and debugging skills.
Read more
Edumyra
at Edumyra
4 recruiters
Saumya Mishra
Posted by Saumya Mishra
Mumbai
2 - 5 yrs
₹4L - ₹6L / yr
skill iconPython
skill iconDjango
Relational Database (RDBMS)
skill iconDocker
skill iconGit
+4 more

We're looking for exprienced Python developers with over 2+ years of production experience and strong expertise in building web applications and APIs using Python, Django and DRF. We are looking for cadidates who are go-getters and are leaning towards leadership positions. Candidates must have a proven history of building, scaling, optimising and securing Python based backends and APIs using a microservice architecture.

 

Bonus Skills : Experience with ReactJs, Node.js, FastAPI

 

We would prefer candidates who can join immediately or are currently serving their notice period. Jumpers please excuse, your application will be ignored

 

Key Skills Required

  1. Proficiency in Python 3.x based web and backend development
  2. Solid understanding of Python concepts
  3. Strong experience in building web applications using Django
  4. Experience building REST APIs using DRF or Flask
  5. Experience with some form of Machine Learning (ML)
  6. Experience in using libraries such as Numpy and Pandas
  7. Hands on experience with RDBMS such as Postgres or MySQL including querying
  8. Comfort with Git repositories, branching and deployment using Git
  9. Working experience with Docker
  10. Basic working knowledge of ReactJs
  11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku

 

Responsibilities

  1. Understanding requirement and congributing to engineering solutions at a conceptual stage to provide the best possible solution to the task/challenge
  2. Building high quality code using coding standards based on the SRS/Documentation
  3. Building component based, maintainable, scalable and reusable backend libraries/modules.
  4. Building & documenting scalable APIs on the Open Spec standard
  5. Unit testing development modules and APIs
  6. Conducting code reviews to ensure that the highest quality standard are maintained
  7. Securing backend applications and APIs using industry best practices
  8. Troubleshooting issues and fixing bugs raised by the QA team efficiently.
  9. Optimizing code
  10. Building and deploying the applications
  • Employment type

    Full-time
Read more
AI Educator
Sanjay Sanghvi
Posted by Sanjay Sanghvi
Hyderabad
3 - 5 yrs
₹8L - ₹12L / yr
skill iconPython
skill iconDjango

 

  • 3 + years expertise in Python 3.7, Django 2 (or Django 3).

  • Familiarity with some ORM (Object Relational Mapper) libraries.

  • Able to integrate multiple data sources and databases into one system.

  • Integration of user-facing elements developed by front-end developers with server-side logic in Django (RESTful APIs).

  • Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3

  • Knowledge of user authentication and authorization between multiple systems, servers, and environments

  • Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform

  • Able to create database schemas that represent and support business processes

  • Strong unit test and debugging skills.

  • Proficient understanding of code versioning tools such as Git.

The desirablesoptionals

  • Django Channels, Web Sockets, Asyncio.

  • Experience working with AWS or similar Cloud services.

  • Experience in containerization technologies such as Docker.

  • Understanding of fundamental design principles behind a scalable application (caching, Redis)

Read more
CONTUS
at CONTUS
6 recruiters
Dhana V
Posted by Dhana V
Chennai
3 - 7 yrs
₹2L - ₹5L / yr
skill iconDjango
skill iconMongoDB
skill iconPython
Key Skills:- Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask, etc depending on your technology stack) Familiarity with some ORM (Object Relational Mapper) libraries Able to integrate multiple data sources and databases into one system Understanding of the threading limitations of Python, and multi-process architecture
Read more
BoTree Technologies
at BoTree Technologies
1 recruiter
Shardul Bhatt
Posted by Shardul Bhatt
Ahmedabad
4 - 6 yrs
₹6L - ₹9L / yr
skill iconPython
skill iconDjango
skill iconReact.js
  • At least 4 years of experience programming in Python.
  • Develop application code and modules for business and technical requirements.
  • Tune up design for maintainability, scalability and efficiency.
  • Resolve and troubleshoot problems and complex issues.
  • Perform unit tests and fix bugs.
  • Integrate best qualitative practices in design and development aspects of programs.
  • Ability to mentor subordinates.
  • Excellent communication skills.
Read more
Kait Technologies
at Kait Technologies
2 recruiters
Ahmad Altraiji
Posted by Ahmad Altraiji
Kuwait
1 - 5 yrs
₹12L - ₹12L / yr
Natural Language Processing (NLP)
Software Development
skill iconPython
Perl
Shell Scripting
+6 more
Skills
1. Ability to read the documentation and perform 3rd party API integrations
2. Experience with Postgres and Redis
3. Experience with AWS - EC2, RDS, DynamoDB, etc
4. Experience with Python

Dashboard
Skills
1. Experience with Django
a. Django Web
b. Django REST
c. Django Channels
d. Django Celery (Queues and Brokers)
2. Experience creating a dashboard with login, user profiles, roles and permissions, reports
3. Experience with Facebook and Twitter OAuth
4. Experience with handling database migrations


Chatbot
Skills
1. Basic understanding of NLP - intents and entities
2. Strong understanding of dialogue management and conversation flow
3. Integrations with Facebook and Twitter APIs.
4. Creating and managing Facebook and Twitter apps
5. Understanding of webhooks and REST APIs.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos