Cutshort logo
Wissen Technology logo
Data Engineer With Python
Data Engineer With Python
Wissen Technology's logo

Data Engineer With Python

Seema Srivastava's profile picture
Posted by Seema Srivastava
5 - 10 yrs
Best in industry
Mumbai
Skills
skill iconPython
SQL
Databases
Data engineering
skill iconAmazon Web Services (AWS)

Job Description: Data Engineer 

Position Overview:

Role Overview

We are seeking a skilled Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes.

 

Key Responsibilities

· Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.

· Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).

· Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.

· Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.

· Ensure data quality and consistency by implementing validation and governance practices.

· Work on data security best practices in compliance with organizational policies and regulations.

· Automate repetitive data engineering tasks using Python scripts and frameworks.

· Leverage CI/CD pipelines for deployment of data workflows on AWS.

 

Required Skills and Qualifications

· Professional Experience: 5+ years of experience in data engineering or a related field.

· Programming: Strong proficiency in Python, with experience in libraries like pandas, pySpark, or boto3.

· AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:

· AWS Glue for ETL/ELT.

· S3 for storage.

· Redshift or Athena for data warehousing and querying.

· Lambda for serverless compute.

· Kinesis or SNS/SQS for data streaming.

· IAM Roles for security.

· Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.

· Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.

· DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and CodePipeline.

· Version Control: Proficient with Git-based workflows.

· Problem Solving: Excellent analytical and debugging skills.

 

Optional Skills

· Knowledge of data modeling and data warehouse design principles.

· Experience with data visualization tools (e.g., Tableau, Power BI).

· Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).

· Exposure to other programming languages like Scala or Java.

 

Education

· Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

 

Why Join Us?

· Opportunity to work on cutting-edge AWS technologies.

· Collaborative and innovative work environment.

 

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Wissen Technology

Founded :
2000
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable

About

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains.

With offices in US, India, UK, Australia, Mexico, and Canada, we offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.


Leveraging our multi-site operations in the USA and India and availability of world-class infrastructure, we offer a combination of on-site, off-site and offshore service models. Our technical competencies, proactive management approach, proven methodologies, committed support and the ability to quickly react to urgent needs make us a valued partner for any kind of Digital Enablement Services, Managed Services, or Business Services.


We believe that the technology and thought leadership that we command in the industry is the direct result of the kind of people we have been able to attract, to form this organization (you are one of them!).


Our workforce consists of 1000+ highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like MIT, Wharton, IITs, IIMs, and BITS and with rich work experience in some of the biggest companies in the world.


Wissen Technology has been certified as a Great Place to Work®. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.

Read more

Connect with the team

Profile picture
Lokesh Manikappa
Profile picture
Vijayalakshmi Selvaraj
Profile picture
Adishi Sood
Profile picture
Shiva Kumar J Goud

Company social profiles

bloglinkedinfacebook

Similar jobs

Ramagya
Ramagya
Agency job
via Randstad India by Shreya Chaudhary
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
4 - 8 yrs
₹4L - ₹6L / yr
Recruitment/Talent Acquisition
Recruiting the right talent for the open positions at PAN India.
• Building the pipelines of Talent Pool - eg. Education institutes, allied industries, target companies and internal database.
• Working on TAT; closure of open positions within timelines.
• Maintaining the MIS for tracking the exact status of all open positions ensuring effective TAT Management and being focussed.
•Doing the screening of all the candidates thoroughly to ensure that the Best fit is identified for the role.
• Effective Coordination with the Functional Heads for the closure of the open positions.
• Ensuring that all the set criterias are met for the Role including the shortlisting parameters, relevant experience in handling the role as per job description.
• Keeping all the documentation in place for all the open positions namely - Manpower Requisition Form, Interview Aplication Form, Interview Assessment Form, Reference Check Form, Offer Letter Acceptance, Accepted Resignation from previous employer and confirmation of date of joining.
• Regular Warm up calls to the offered candidates to ensure the joining as agreed at the time of offer and avoid last minute offer drops.
• Issuing the appointment letter on the date of joining.
• Sharing and explaining the KRA to the new joiners. • Timely feedback of performance from the Reporting Manager of the new joiners in the initial months / probation period to ensure quality hiring.


FUNCTIONAL REQUIREMENTS

• Maintaining confidentiality
• Strong follow ups for the closure of open positions
• Right assessment skills to see through the candidate
• Ability to identify the strengths and limitations of the candidates
• Understanding of Company Business
• Understanding the job description and the soul of the job
Read more
Vikgol Technologies
Bengaluru (Bangalore)
2 - 5 yrs
₹11L - ₹16L / yr
Microsoft Windows Azure

About the Role

The PMO Manager You will oversee resource allocation, financial project controlling, and overall delivery management. Your goal is to ensure the right people are on the right projects at the right time, ensuring that budgets are respected and delivery timelines are met.

Key Responsibilities

  • Resource Orchestration: Manage workload, vacation planning, and project assignments for the entire team.
  • Project Controlling: Monitor project budgets and delivery milestones to ensure financial health.
  • Agile Integration: Attend daily Scrums to gain real-time transparency into team capacity and roadblocks.
  • Dynamic Re-allocation: Quickly shift resources between projects based on shifting priorities and daily insights.
  • Skill Management: Track team skillsets, identify "skill gaps," and plan for training or new staffing needs.
  • Strategic Oversight: Participate in Steering Committee (SteerCo) meetings to report on delivery status.

Requires Technical Skills

  • Project Management Tools: Strong proficiency in Azure DevOps, Jira, or similar task-tracking platforms.
  • Reporting & Analysis: Advanced skills in MS Excel (for budgeting/controlling) and MS Project.
  • Communication Suite: Mastery of MS Teams, PowerPoint, and Word for stakeholder reporting.
  • D365 Exposure: Familiarity with Dynamics CRM environments is highly preferred to understand the project landscape.

Qualification & Preferred

  • Education: Degree in IT, Business, Engineering, or equivalent professional training.
  • Experience: Proven track record in a PMO role is mandatory. Must have experience in project controlling and process optimization.
  • Good to Have: Professional project management
  • Process Knowledge: Deep understanding of the Project Life Cycle (PLC) and Software Development Life Cycle (SDLC).


Read more
Series A fintech company
Series A fintech company
Agency job
via Qrata by Blessy Fernandes
Hyderabad
5 - 8 yrs
₹15L - ₹27L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Requirements: Job Description

  • Excellent knowledge in Core Java (J2SE) and J2EE technologies.

  • Hands-on experience with RESTful services, API design are must.

  • Knowledge of microservices architecture is must.

  • Knowledge of design patterns is must.

  • Strong knowledge in Exception handling and logging mechanism is must.

  • Agile scrum participation experience. Work experience with several agile teams on an application built with microservices and event-based architectures to be deployed on hybrid (on-prem/cloud)

    environments.

  • Good knowledge of Spring framework (MVC, Cloud, Data and Security. Etc) and ORM framework like JPA/Hibernate.

  • Experience in managing the Source Code Base through Version Control tool like SVN, GitHub,Bitbucket, etc.

  • Experience in using and configuration of Continuous Integration tools Jenkins, Travis, GitLab, etc.

  • Experience in design and development of SaaS/PaaS based architecture and tenancy models.

  • Experience in SaaS/PaaS based application development used by a high volume of subscribers/customers.

 
 
Read more
SnapFind
Agency job
via VElate by Mansha Katyal
Remote, Rajkot
3 - 6 yrs
₹35L - ₹40L / yr
TensorFlow
PyTorch
Artificial Intelligence (AI)

Description


Job Summary

We are seeking a visionary Senior AI Engineer with a minimum of 3+ years of experience to lead the development of an advanced AI system leveraging CrewAI and LangChain tools to build intelligent, collaborative multi-agent systems for the logistics domain. The role includes designing AI agents capable of handling complex tasks, optimizing workflows, and conducting A/B and beta testing to ensure robust, scalable performance under diverse conditions. This is an opportunity to shape cutting-edge AI systems and revolutionize logistics operations.

Responsibilities:

1. Design & Architecture:

 Architect and implement a multi-agent AI system using CrewAI for task collaboration, communication, and real-time logistics optimization.

 Integrate LangChain tools for natural language understanding, contextual reasoning, and knowledge retrieval.

 Ensure the system is designed to allow comprehensive testing, iteration, and improvement.

 

2. AI Agent Development:

 Develop autonomous agents capable of dynamic decision-making, task delegation, and seamless inter-agent communication.

 Use LangChain to enhance agent capabilities, such as reasoning over unstructured data and interfacing with external knowledge bases.

 

3. A/B Testing & Experimentation:

 Design and execute A/B tests to compare AI agent strategies, workflows, and decision-making models under varying scenarios.

 Develop and implement metrics for evaluating system performance (e.g., latency, accuracy, scalability).

 Use experimentation frameworks to test hypotheses and gather insights on system improvements.

 

4. Beta Testing & Real-World Simulation:

 Set up controlled beta testing environments that mimic real-world logistics operations.

 Simulate edge cases, bottlenecks, and high-load scenarios to ensure system robustness and scalability.

 Gather feedback from beta users and iterate on the system to address discovered issues.

5. Progress Demonstration:

 Develop dashboards and visualizations to showcase key performance indicators (KPIs) and test results.

 Implement tools to log and track agent interactions, decision outcomes, and error rates in real-time.

 Regularly present progress to stakeholders, highlighting improvements and areas for refinement.

6. Optimization & Scalability:

 Optimize multi-agent interactions and resource allocation for real-world logistics challenges.

 Ensure the system scales seamlessly for complex operations involving high volumes of agents and data.

7. Integration:

 Seamlessly integrate the multi-agent system with logistics platforms, such as Transportation Management Systems (TMS) and Warehouse Management Systems (WMS).

 Use LangChain tools to connect agents to APIs, external knowledge graphs, and live data streams.

8. Collaboration & Leadership:

 Lead a team of engineers in developing advanced AI solutions, mentoring them on testing frameworks and innovative technologies like CrewAI and LangChain.

 Collaborate with cross-functional teams to align AI development with business needs.

9. Research & Innovation:

 Stay updated on the latest advancements in multi-agent systems, LangChain, CrewAI, and testing frameworks.

 Introduce cutting-edge techniques to continuously improve the AI system’s performance.

 

Required Qualifications:

 

Education: Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field (Ph.D. preferred).

Experience:

• 3+ years in AI development, with experience in multi-agent systems, logistics, or related fields.

• Proven experience in conducting A/B testing and beta testing for AI systems.

• Hands-on experience with CrewAI and LangChain tools.

• Should have hands-on experience working with end-to-end chatbot development, specifically with Agentic and RAG-based chatbots. It is essential that the candidate has been involved in the entire lifecycle of chatbot creation, from design to deployment.

• Should have practical experience with LLM application deployment.

Technical Skills:

• Proficiency in Python and machine learning frameworks (e.g., TensorFlow, PyTorch).

• Strong understanding of A/B testing platforms and methodologies for AI systems.

• Expertise in building beta testing pipelines and real-world simulation environments.

• Familiarity with distributed systems, reinforcement learning, and natural language processing (NLP).

• Proficiency in using LangChain tools for chaining tasks, knowledge retrieval, and reasoning.

• Proficiency with cloud platforms (AWS, Azure, GCP) and containerization tools (Docker, Kubernetes).

• Good to have experience in Cursor & MCP.

• Experience in setting up monitoring dashboards with tools like Grafana, Tableau, or similar.

Preferred Qualifications:

 Experience in logistics systems, such as route optimization, shipment tracking, and demand forecasting.

 Familiarity with graph theory, network optimization, and blockchain for agent security.

 Background in designing scalable systems tested under diverse operational conditions.

Soft Skills:

 Strong analytical and problem-solving abilities.

 Ability to communicate technical concepts effectively to stakeholders.

 Leadership skills for mentoring teams and guiding project execution.

Read more
ZeMoSo Technologies
at ZeMoSo Technologies
11 recruiters
HR Team
Posted by HR Team
Remote only
5 - 13 yrs
Best in industry
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

What You will do

● Create beautiful software experiences for our customers using design thinking, lean and agile methodology.

● Design and develop software products from scratch using the latest cutting edge technologies, platforms and languages such as JAVA, python, Javascript, GoLang and Scala.

● Work in a dynamic, collaborative, transparent, non-hierarchical culture.

● Help to grow the next generation of developers and have a positive impact on the industry.

Basic Qualifications

● Experience: 8+ years.

● Engineering Degree in Computer Science OR Equivalent.

● Hands-on development experience with a broad mix of languages such as JAVA, Python, Javascript etc.

● Server-side development experience mainly in JAVA, (Python and nodeJS can be considerable)

● UI development experience in ReactJS or AngularJS or PolymerJS or EmberJS or Jquery etc.

● Passion for software engineering and follow the best coding concepts. ● Good to great problem solving and communication skills.

● Must have experience in technical architecture and design , code reviews and mentoring junior developers.

● Should have experience in stakeholder management and work along with architects as and when necessary to lead the project.

Nice to have Qualifications

● Product engineering and customer-centric mindset.

● Great OOP skills, including design patterns.

● Experience with devops, continuous integration & deployment.

● Exposure to big data technologies, Machine Learning and NLP will be a plus.

Benefits

● Competitive salary.

● Work from anywhere.

● Reimbursements for remote work set up.

● Insurance (including a top up insurance for COVID).

● Free Access to Online learning libraries such as O'reilly or equivalent Location Remote - work from anywhere

Read more
System Integration company
System Integration company
Agency job
via The Hub by Sridevi Viswanathan
Bengaluru (Bangalore)
4 - 7 yrs
₹8L - ₹12L / yr
Inside Sales
IT sales
Communication Skills
Telesales
Presentation Skills
+3 more
Inside sales representative with good sales, communication, negotiation and documentation skills.
Ability to handle pressure and should convince customer to buy I.T. hardware portfolio like laptops, desktops, related accessories, software, datacentre products and others.
Having worked in a similar domain doing sales lead calls for similar products (HP, HPE, Dell, Lenovo, Microsoft, AWS) would be preferred. Candidates who have sold to Indian customers or consumers would help.
The role includes complete sales cycle from generating an opportunity to nurturing to negotiations to clusure to logging the order to followup on delivery to payment collection to managing the customer.
Should be good in reporting and documentation work and adept in tools like MS excel, word, powerpoint.
Should be able to handle team and take decisions. Should be able to motivate team to achieve their goals and help them wherever necessary.
Read more
Agilisium
Agilisium
Agency job
via Recruiting India by The_Meenakshi Bansal
Chennai
8 - 10 yrs
₹12L - ₹14L / yr
Business Analysis
Business Analyst
Requirement Analysis
Information gathering

Required Skills:

  1. Strong BA with presentation skills
  2. US Customer Engagement experience
  3. Self-driven – should be able to independently work towards the business objective.
  4. Should have past experience of program management
  5. Strong communication skills.
  6. Must be flexible to work in overlapping times with US PST timezone.
Read more
Saama Technologies
at Saama Technologies
6 recruiters
Sandeep Chaudhary
Posted by Sandeep Chaudhary
Pune
4 - 8 yrs
₹1L - ₹16L / yr
skill iconData Science
skill iconPython
skill iconMachine Learning (ML)
Natural Language Processing (NLP)
Big Data
+2 more
Description Must have Direct Hands- on, 4 years of experience, building complex Data Science solutions Must have fundamental knowledge of Inferential Statistics Should have worked on Predictive Modelling, using Python / R Experience should include the following, File I/ O, Data Harmonization, Data Exploration Machine Learning Techniques (Supervised, Unsupervised) Multi- Dimensional Array Processing Deep Learning NLP, Image Processing Prior experience in Healthcare Domain, is a plus Experience using Big Data, is a plus Should have Excellent Analytical, Problem Solving ability. Should be able to grasp new concepts quickly Should be well familiar with Agile Project Management Methodology Should have excellent written and verbal communication skills Should be a team player with open mind
Read more
Smartstorey LLP
at Smartstorey LLP
2 recruiters
Darshan Kannan
Posted by Darshan Kannan
Remote, Bengaluru (Bangalore)
1 - 3 yrs
₹2L - ₹4L / yr
Accounting
Account Management
Mobile Payments
Invoicing
credit controller
+2 more
Maintain records of all purchases and payments done to suppliers Manage cost center of each and every payment Ensure purchases are recorded and stored Follow up with vendors for timely invoice submission Verify ledger statements
Read more
OnBlick
at OnBlick
1 video
1 recruiter
Shravan Kore
Posted by Shravan Kore
Hyderabad
4 - 100 yrs
₹4L - ₹18L / yr
ASP.NET
MVC Framework
skill iconAngularJS (1.x)
Web Development
skill iconjQuery
+1 more
We are seeking for a solid Web Application and Services developer using Microsoft technology stack. Looking for candidates with 7+ Years of experience in the following skills set: Skills Required: • Web Applications using MVC Framework and Razor Engine • REST Web API using MVC Framework • Proficient enough in using Microsoft Enterprise Libraries • Proficient enough in using Entity Frameworks • Experience in Microsoft stack DevOPS development model (Azure Deployments) • Client side Java script frameworks like JQuery, Angular JS & other • Styling, themes development using bootstrap • SQL Server database design and development • Working with Unit testing frameworks • Working on Security & Performance improvements of Web Applications and Web APIs • Very good analytical, problem solving & programming skills
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos