Job Title: Data Engineer
Location: Pune, India
Experience: 5 to 9 years
Job Description:
We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.
Required Skills:
- Python: Advanced proficiency with extensive experience in building data pipelines.
- AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
- Spark: Proficient in using Apache Spark for large-scale data processing.
- Scala: Working knowledge of Scala for Spark programming.
- Strong understanding of data warehousing concepts and ETL processes.
- Experience with SQL and relational databases.
- Familiarity with data governance and security best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
About Wissen Technology
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains.
With offices in US, India, UK, Australia, Mexico, and Canada, we offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.
Leveraging our multi-site operations in the USA and India and availability of world-class infrastructure, we offer a combination of on-site, off-site and offshore service models. Our technical competencies, proactive management approach, proven methodologies, committed support and the ability to quickly react to urgent needs make us a valued partner for any kind of Digital Enablement Services, Managed Services, or Business Services.
We believe that the technology and thought leadership that we command in the industry is the direct result of the kind of people we have been able to attract, to form this organization (you are one of them!).
Our workforce consists of 1000+ highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like MIT, Wharton, IITs, IIMs, and BITS and with rich work experience in some of the biggest companies in the world.
Wissen Technology has been certified as a Great Place to Work®. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
Similar jobs
What kind of work will you get?
We are looking for a Python developer.
Examples of technical tasks:
Working on our backend SDK to implement APIs that will be consumed by the frontend widgets
Designing APIs for different auth recipes
Architecting auth flows
You will also be given non technical tasks like product brain storming, competitor analysis and writing documentation.
Note: Compensation is as per the applicant's geography
Requirements
Well versed in Python with 2+ years of professional experience
Familiar with and comfortable working with Web frameworks like FastAPI, Django and Flask
Familiar with HTTP networking in Python
Strong understanding of async and sync modes in Python
Bonus:
Contributed to open source, or have your own open source repo with a community and many github stars
Built an in-house authentication or authorization solution or worked with solutions such as Keycloak, Auth0, Ory, Okta etc
Job Overview:
We are seeking an experienced Senior Python Developer to join our dynamic team. The ideal candidate will have a strong background in Python development, with a focus on API development, integration, and experience in the deployment of machine learning pipelines. This is a crucial role in designing, implementing, and maintaining scalable and compliant Generative AI applications.
Must have:
- Expertise in programming languages - Python (primary), JavaScript, SQL, NodeJS
- Expertise in configuring and designing SQL and NoSQL databases (eg. Mongo)
- Expertise in API integration and APP serving frameworks (Flask, Django, FAST API)
- Experience in Schema definitions, parsing payload types (XSD/XML, JSON, Byte/Binary Encoded images,), etc.,
- Experience in User Authentication and Authorization frameworks and Active Directory Integration (SAML, OAuth, etc.,)
- Exposure to Large Language Models (LLMs) and Generative AI application development is a must.
- Experience working on Azure AI/ML stack is required.
- Familiarity with cloud platforms (e.g., AWS, Azure) and containerization (e.g., Docker).
- Solid understanding of software development best practices, including version control, code reviews, and testing.
- Lead code reviews, mentor junior developers, and provide technical guidance to the team.
- Strong communication and collaboration skills.
- Ability to work independently and lead technical initiatives.
- Familiarity with continuous integration and continuous deployment (CI/CD) pipelines.
Good to have:
- Previous experience with healthcare-related projects or HIPAA compliance is a plus.
- Experience with Django or Flask frameworks for web development.
- Knowledge of front-end technologies (HTML, CSS, JavaScript).
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, or related field.
- 6-8 years of proven experience as a Python Developer, with a strong focus on backend development.
experience in Python, Django, Flask, and related frameworks in Unix/Linux or Windows
environment.
Hands-on experience in a full-stack python application development.
Design and develop Python web applications adhering to microservices framework considering
performance and ability to scale on demand.
Good experience working with RDBMS (Relational Database Management System).
Experience with Microservices architecture, containers & Docker based applications. Experience in
developing web applications and REST APIs using Flask/Django Framework (JSON, XML, etc.)
Experience working on Apache HTTP/HTTPS or any other webapp servers.
Package code and create executables/binaries in python.
Experience in Pandas, SciPy, NumPy, Pandas libraries.
Strong unit testing and debugging skills good understanding of threading limitations of Python, and
multi-process architecture.
Experience in managing the Source Code Base through Version Control tool like SVN, Git, and
Bitbucket, etc.
Thorough Understanding of OOPS concepts.
Experience working in an Agile development environment.
Good understanding of database (PostgreSQL/MySQL/Oracle/SQL Server).
Good communication and organization skills, with a logical approach to problem solving, good time
management, and task prioritization skills.
Requirements: Skills and Qualifications
8-10 years of experience in Python, Django, Flask, and related frameworks in Unix/Linux or Windows
environment, preferably in banking domain.
Language: Python
Frameworks: Django, Flask.
Libraries: Sqlalchemy, NumPy, SciPy and Pandas…Etc.
OS: Windows, Linux/Unix
Version Controls: Git, and Bitbucket.
Databases: MySQL, Oracle, SQL Server, PostgreSQL.
Containers: Docker
Note - Urgently looking for people serving Notice Period Or Immediate Joiners
Responsibilities
· Develop Python-based APIs using FastAPI and Flask frameworks.
· Develop Python-based Automation scripts and Libraries.
· Develop Front End Components using VueJS and ReactJS.
· Writing and modifying Docker files for the Back-End and Front-End Components.
· Integrate CI/CD pipelines for Automation and Code quality checks.
· Writing complex ORM mappings using SQLAlchemy.
Required Skills:
· Strong experience in Python development in a full stack environment is a requirement, including NodeJS, VueJS/Vuex, Flask, etc.
· Experience with SQLAchemy or similar ORM frameworks.
· Experience working with Geolocation APIs (e.g., Google Maps, Mapbox).
· Experience using Elasticsearch and Airflow is a plus.
· Strong knowledge of SQL, comfortable working with MySQL and/or PostgreSQL databases.
· Understand concepts of Data Modeling.
· Experience with REST.
· Experience with Git, GitFlow, and code review process.
· Good understanding of basic UI and UX principles.
· Project excellent problem-solving and communication skills.
Python Full stack developer.
1. Product based Full stack developer - Python back end - Core Python
2. Worked with Database - MongoDB/ MySql
3. Should have worked with ORMs
4. Knowledge of REST APIs
5. Should have developed Python applications.
6. Cloud Technology - Worked with AWS/ Azure. Not yet decided on what we
are going to go with.
7. Deplyment tools knowledge
8. Good knowledge of Front end dev - CSS/ JS/ React
9. Version Control - Git
10. Frameworks - Flask/ Django. (Ideally Flask)
11. Script writing
Should have worked on a full system design and architecture along with
coding up the same.
Kognitos is a cutting-edge automation platform that combines the power of Generative AI and Natural
Language Processing (NLP) to provide a conversational and intuitive experience for business users. As a
fully serverless, SaaS automation platform, Kognitos enables users to build, manage, and execute
automations in natural language, with the ability to process and understand domain-specific language.
Kognitos provides a detailed auditable view of its runs, allowing users to gain insights into why an action
happened or what might have gone wrong in case of an exceptional situation. Additionally, Kognitos's
conversational exception handling, powered by Generative AI, allows for quick and easy resolution of
unexpected system errors or business exceptions.
Responsibilities:
- Develop and maintain the backend infrastructure for our applications using Python and AWS Serverless
technologies.
- Collaborate with cross-functional teams to design and implement scalable and robust systems, including
microservices and cloud-based architectures.
- Ensure the reliability, scalability, and performance of the backend systems through monitoring and
optimization.
- Create and maintain database schema and queries to support the application features.
- Write unit and integration tests for the backend code and ensure code quality through code reviews.
- Continuously improve the software development process by incorporating best practices and modern
software development methodologies, such as Agile, DevOps, and CI/CD.
- Investigate and troubleshoot production issues and provide timely solutions to minimize downtime and
ensure smooth operations.
- Participate in architectural discussions and contribute to the development of technical solutions and best
practices.
- Stay up to date with the latest technologies and trends in software development and recommend
improvements to the technology stack to increase efficiency and scalability.
- Work in a fast-paced, collaborative environment with a focus on delivering high-quality software that
meets customer needs.
Required Experience/Skills:
- B.S. or higher degree in Computer Science/Engineering or similar field or equivalent work experience
- 4-20 years of industry experience (or equivalent)
- Proficient in Python programming language
- Experience with modern software development practices and methodologies, including Agile, DevOps,
and Continuous Integration/Continuous Delivery (CI/CD).
- Experience with large-scale distributed systems, microservices, and cloud-based architectures.
- Strong understanding of software design patterns, algorithms, data structures, and database technologies.
- A natural problem solver, with the ability to identify problems and lead the development of a solution.
- Lead multiple client projects in the organization.
- Define & build technical architecture for projects.
- Introduce & ensure right coding standards within the team and ensure that it is maintained in all the projects.
- Ensure the quality delivery of projects.
- Ensure applications are confirmed to security guidelines wherever required.
- Assist pre-sales/sales team for converting raw requirements from potential clients to functional solutions.
- Train fellow team members to impose the best practices available.
- Work on improving and managing processes within the team.
- Implement innovative ideas throughout the team to improve the overall efficiency and quality of the team.
- Ensure proper communication & collaboration within the team
Requirements
7+ Years of experience in developing large scale applications.
Solid Domain Knowledge and experience with various Design Patterns & Data Modelling (Associations, OOPs Concepts etc.)
Should have exposure to multiple backend technologies, and databases - both relational and NOSQL databases
Should be aware of latest conventions for APIs
Preferred hands-on experience with GraphQL as well as REST API
Must be well-aware of the latest technological advancements for relevant platforms.
Advanced Concepts of Databases - Views, Stored Procedures, Database Optimization - are a good to have.
Should have Research Oriented Approach
Solid at Logical thinking and Problem solving
Solid understanding of Coding Standards, Code Review processes and delivery of quality products
Experience with various Tools used in Development, Tests & Deployments.
Sound knowledge of DevOps and CI/CD Pipeline Tools
Solid experience with Git Workflow on Enterprise projects and larger teams
Should be good at documentation at project level and code level ; Should have good experience with Agile Methodology and process
Should have a good understanding of server side deployment, scalability, maintainability and handling server security problems.
Should have good understanding on Software UX
Proficient with communication and good at making software architectural judgments
Expected outcomes
- Growing the team and retaining talent, thus, creating an inspiring environment for the team members.
- Creating more leadership within the team along with mentoring and guiding new joiners and experienced developers.
- Creating growth plans for the team and preparing training guides for other team members.
- Refining processes in the team on a regular basis to ensure quality delivery of projects- such as coding standards, project collaboration, code review processes etc.
- Improving overall efficiency and team productivity by introducing new methodologies and ideas in the team.
- Working on R&D and employing innovative technologies in the company.
- Streamlining processes which will result in saving time and cost optimization
- Ensuring code review healthiness and shipping superior quality code
Benefits
- Unlimited learning and growth opportunities
- A collaborative and cheerful work environment
- Exceptional reward and recognition policy
- Outstanding compensation
- Flexible work hours
- Opportunity to make an impact as your work will directly contribute to our business strategy.
At Nickelfox, you have a chance to craft a career path as unique as you are and become the best version of YOU. You will be part of a team with a ‘no limits’ mindset in an inclusive, people-focused culture. And we’re counting on your unique perspective to help Nickelfox grow even faster.
Are you passionate about tech? Dedicated to learning? Come, join us to build an extraordinary experience for yourself and a dignified working world for all.
What makes Nickelfox a great place for you?
In Nickelfox, you’ll join a team whose passion for technology and understanding of business has driven the company to serve clients across 25+ countries in just five years. We partner with our customers to fuel their growth story and enable them to make the right decisions with our customized technology services and insights. All in all, we are passionate to see our customers win the day. This is the reason why 80% of our business comes from repeat clients.
Our mission is to provide dignified employment and an environment that recognizes the uniqueness of every individual and values their expertise, and contribution. We have a culture that encourages everyone to bring their authentic selves to work. Our people enjoy a collaborative work environment with exceptional training and career development. If you like working with a curious, youthful, high-performing team, Nickelfox is the place for you.
- Building customer products that operate at a scale
- Working on a back-end system using Python and Java
- Working on MySQL, NoSQL, Solr, Thrift, Flask, RabbitMQ, Redis, etc.
- Working on analytics and data science
- Working on server management (Google Cloud)
- Explore different functions of building a tech product/company early in your career.
- Learn to Prioritize Work and learn the ability to decide some technical decisions vs others ata very early stage of your career
- Be instilled with the value of hard work, ownership, and self-sustainability.
- Be more actively involved in the decision-making and functioning of the company.
- Understand the great importance of personal ownership and the liberty needed to pursue that ownership
- Hungry for Growth & Learning
- Willing to go all out for an accelerated career in software engineering
- Ready to experiment things never done before – Conquer uncharted waters
- Think Out-of-the-Box – Innovative and effective solutions
- Top Gun command over technologies (Mentioned above)
- You'll learn how to target efficiency rather than perfection.
- This empowerment will help you become a better leader at a very early stage of your career.
- Join the Core team – Get real insights into building a Product and Business ground up
- Enjoy the freedom, that comes with a lot of ownership
- Challenging and fun work environment
- Flexible Work Culture – We are a target driven organization. We like hard-workers, but we adore smart-workers more!
- Unlimited Vacation policy - Work hard, and take a break when you need
We are looking for an experienced individual to join our engineering teams as a python developer.
You would be responsible for developing solutions as per business requirements. Working closely with a global team of developers and product managers and develop the solution according to the business requirements.
Required/ Must have:
• Be passionate about programming
• Understand requirements, validate assumptions, and design and develop solutions independently for users
• Ability to learn new python skills to deliver solutions
• Writing reusable, testable, and efficient code
• Identify and suggest various opportunities to improve efficiency and functionality.
• An ability to perform well in a fast-paced environment
• Review existing python solutions for quality and provide feedback
• Agile methodology experience with able to translate user stories and features into python code
• Knowledge of Pandas and experience of automating Microsoft excel and preferably other office apps
• Be flexible to learn and undertake other responsibilities as required by the team
Preferable/Good to have:
• Good knowledge in writing QA test cases and performing QA is preferable
• Coordinate with internal teams to understand user requirements and provide technical solutions
• Write and implement software solutions that integrate different systems.
• Work experience with libraries: Win32, Openpyxl, Pypdf, Pandas, Selenium
• Hands on experience with Git repository
• SQL experience is preferred
• Good Interpersonal Skills & Ability to work Independently