Job Title: Data Engineer
Location: Pune, India
Experience: 5 to 9 years
Job Description:
We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.
Required Skills:
- Python: Advanced proficiency with extensive experience in building data pipelines.
- AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
- Spark: Proficient in using Apache Spark for large-scale data processing.
- Scala: Working knowledge of Scala for Spark programming.
- Strong understanding of data warehousing concepts and ETL processes.
- Experience with SQL and relational databases.
- Familiarity with data governance and security best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
About Wissen Technology
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains.
With offices in US, India, UK, Australia, Mexico, and Canada, we offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.
Leveraging our multi-site operations in the USA and India and availability of world-class infrastructure, we offer a combination of on-site, off-site and offshore service models. Our technical competencies, proactive management approach, proven methodologies, committed support and the ability to quickly react to urgent needs make us a valued partner for any kind of Digital Enablement Services, Managed Services, or Business Services.
We believe that the technology and thought leadership that we command in the industry is the direct result of the kind of people we have been able to attract, to form this organization (you are one of them!).
Our workforce consists of 1000+ highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like MIT, Wharton, IITs, IIMs, and BITS and with rich work experience in some of the biggest companies in the world.
Wissen Technology has been certified as a Great Place to Work®. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
Similar jobs
We are looking for a passionate backend developer to join our technology team. As a Backend developer, you’ll work closely with our Product, Design and Business teams, to develop a state-of-the-art SaaS platform that empowers employers and vendors to provide great benefits to employees. If you have excellent programming skills and a passion for developing applications or improving existing ones, you are exactly who we seek.
Responsibilities:
- As a back-end software developer, you will develop components of our application on time and to specification created by the key member of a product or delivery team.
- You are expected to make balanced technical decisions (e.g., design trade-offs, prioritisation, etc.) as a member of the technology team.
- Maintain and improve the code quality and deployment pipelines.
- Participate in post-production activities with our customers (e.g., answer questions, explain functionality, extend APIs, etc.)
- Automate repetitive tasks at various functional levels to increase the efficiency of the team
Requirements:
- 0-1 years of experience - Strong abstract reasoning and problem-solving skills.
- Must be able to produce clean and efficient code and should have done a lot of programming/coding in Python language and Django framework.
- Good understanding of Postgres, Redis, K8s, Docker is a plus.
- Must have a good Competitive Programming profile
- Strong fundamentals in data structures and algorithms.
- Must have experience in writing complex algorithms and readable code.
- Strong written and verbal communication skills allowing the person to work with cross-functional teams effectively
Why should you join us?
Because, above all, we are building a place where ambitious performers feel at home. We believe that a great product is built by a high-quality team that finds purpose and joy in their work. We put heavy emphasis on having fun at work.
Perks
- Competitive Salary
- Best ESOP policy
- Gadgets of your choice
- Books of your choice
- Awesome Team
What kind of work will you get?
We are looking for a Python developer.
Examples of technical tasks:
Working on our backend SDK to implement APIs that will be consumed by the frontend widgets
Designing APIs for different auth recipes
Architecting auth flows
You will also be given non technical tasks like product brain storming, competitor analysis and writing documentation.
Note: Compensation is as per the applicant's geography
Requirements
Well versed in Python with 2+ years of professional experience
Familiar with and comfortable working with Web frameworks like FastAPI, Django and Flask
Familiar with HTTP networking in Python
Strong understanding of async and sync modes in Python
Bonus:
Contributed to open source, or have your own open source repo with a community and many github stars
Built an in-house authentication or authorization solution or worked with solutions such as Keycloak, Auth0, Ory, Okta etc
If you love to work in a fast-paced startup environment and desire to solve some very
challenging problems using technology, we want to hear from you.
We are looking for an enthusiastic and energetic individual to work as a Senior Software
Developer. You will be involved in working on multiple products for the scaling and growth
stage of the lifecycle.
We work closely with the real world,. If you are interested to grow and learn in your career
and at the same time work on products for the 1Bn user market, we encourage you to apply.
Responsibilities
● Managing and guiding a team of junior developers for timely delivery of product and
milestones
● Optimization of the application for maximum speed and scalability
● Implementation of security and data protection
● Design and implementation of data storage solutions
● Design & Build: Designing and developing high-volume, low-latency applications for
mission-critical systems, and delivering high-availability and performance.
● Collaborate - Collaborating within your product streams and team to bring best
practices and leverage a world-class tech stack.
● Measurable Outcome - You will need to set quantifiable objectives that encapsulate
the quality attributes of a system. The fitness of the application is measured against
set marks.
● DevOps - You will need to set up every essential (tracking/alerting) to make sure the
infrastructure/software you built is working as expected.
● Design and development of our REST APIs
● Help maintain code quality, architecture, and automation
Required Knowledge and Skills
● 3 - 5 years of experience working in backend development technologies and DevOps
● Highly curious and ready to dive into complex technical challenges.
● Proficiency in development and scripting in Python, Django/Flask framework.
● Database design and management, including being up on the latest practices -
bonus points for MySQL and MongoDB
● User authentication and authorization between multiple systems, servers, and
environments
● Integration of multiple data sources and databases into one system
● Management of hosting environment, including database administration and scaling
an application to support load changes
● Setup and administration of backups
● Understanding differences between multiple delivery platforms such as mobile vs
desktop, and optimizing output to match the specific platform
● Creating database schemas that represent and support business processes
● Implementing automated testing platforms and unit tests
● Understanding of “session management” in a distributed server environment
● Server management and deployment for the relevant environment
● Appreciation for clean and well-documented code
● Hands-on experience with architecture and structural design patterns
● Expertise in designing, developing, deploying, and integrating RESTful APIs
● Ability to understand business requirements and translate them into technical
requirements
● A knack for benchmarking and optimization
● Proficient understanding of code versioning tools, such as Git
Personality
● Requires excellent communication skills – written, verbal, and presentation.
● You should be a team player.
● You should be positive towards problem-solving, have a very structural thought
process to solve problems
● Interest to work in a high paced start-up environment with a large amount of learning.
● Good understanding of different frameworks, and be able to pick up new
technologies at ease.
● You should be agile enough to figure out a need for new technologies/frameworks
and learn new technology for better product performance
JD / Skills Sets
1. Good knowledge on Python
2. Good knowledge on My-Sql, mongodb
3. Design Pattern
4. OOPs
5. Automation
6. Web scraping
7. Redis queue
8. Basic idea of Finance Domain will be beneficial.
9. Git10. AWS (EC2, RDS, S3)
Ditto is a new offering from Finshots. We want to help millennials make better financial decisions. And we are starting with Insurance.
With Ditto, you don’t just compare insurance. You understand it. Narrow down choices. Avoid pitfalls and make better decisions.
Finshots is one of the leading financial newsletters with over 500K subscribers.
What do we do at Ditto?
● We explain health insurance and term(life) insurance in a language you can understand.
● We are an insurtech company primarily selling Health and Term Life Insurance policies.
Who’s backing us?
● We are funded by Zerodha- India’s largest stockbroker
Roles and Responsibilities :
● Architect and build end to end backend services.
● Integrate services from various stakeholders - Insurers, payment gateways.
● Build for high observability, high performance and remove bottlenecks within the application.
● Building reusable code and libraries for future use.
● Should be comfortable with writing tests, targeting 100% coverage.
● Should be comfortable managing database migrations, scripting, setup and Administration.
Experience and Skills
● For this role we expect you to have 2+ years of experience in Backend development.
● Proficiency in Python (2+ years)
● Proven experience in building scalable backend systems (security, middleware, caching, APIs)
● Hands-on experience with Low level & high-level software design
● Must have relevant experience with Django or Flask or similar web app frameworks.
● Knowledge of writing restful APIs.
● Developer experience with AWS or any major cloud provider is a plus.
● Strong sense of ownership and leadership quality
Perks
● Comprehensive Health Insurance
● Compensation as per industry standards
Our Interview Process:
We would like to help you minimize your time and efforts.
There are 4 rounds & we will be working towards completing all the rounds within a maximum of 2 weeks.
Please find the schedule here:
1. Introductory Call
2. Assignment Round
3. Live Coding Round
4. Final Managerial / Technical Round
Job Location:
JP Nagar Bangalore, India
Who We are
At e6data (https://e6x.io/">https://e6data.io) we’re building core algorithms that makes querying 25 - 200X more performant (i.e. faster and/or cheaper) than every other analytics platform in the world. This results in billions of dollars of value unlocked across faster analytics, savings on compute / infra, and new use cases becoming possible.
Our core team has 100+ years of combined experience and 10+ patents across diverse but complementary disciplines like real time databases, time series databases, SQL OLAP engines, distributed computing platforms, stream processing, and log analytics. Two of the founding team are second time founders with past exits.
We are passionate about solving the deepest and most important problems in computer science, and believe in making our technology available to customers regardless of their location, size, or budget. Our vision is for e6data to power every analytical workload in the world - regardless of deployment scenario (cloud, on-premise, edge), across every use case (end user queries, ETL / data pipelines), and every latency requirement (batch, streaming / real time).
What you'll do?
- Write awesome code
- The focus will be on performance of our data platform
- Identify tactical and long-term product improvements (could be code, script, etc.)
- Responsible for Planning and executing Metadata and Governance tool supports
- Build our internal Data Platform using exdata
- Adding scalable functionality to the system for new features like UDF's, sql functions etc
What are we looking for?
- Worked with Python for a minimum of 2 years
- Well versed with Django REST framework
- Knowledge of document based data stores like MongoDB
- Strong team player
- A passion for continuous learning and growth (both at a personal and team level)
- Experience (or enjoys) working in a startup will be an added advantage
- Work with stakeholders and fellow developers.
- Design and implement Python code using the Django framework.
- Identify and fix bottlenecks that may arise from inefficient code.
- Identify and fix software bugs.
- Create a wide variety of unit tests to verify the functionality of software.
- Manage the security of the platform.
- Write detailed documentation around the code.
- Knowledge of front end languages.
- Must have experience with Amazon Web Services (AWS)
- Experience with Python/Node.JS/Typescript
- At least 2+ years as back-end software developer
- A deep understanding of the benefits of the Microservice and serverless paradigms
- Prepared technical documentation, and understand why it’s important
- Understanding of database principals: SQL and NoSQL
- Collaboration and communication skills (you’ll be working with clients and internal teams)
- An understanding of programming fundamentals (OOP, data structures, algorithms)
- Familiarity and comfort with REST API, Postman
- The ability to work independently or within a team structure.
- A “lead by example” attitude, and motivation to deliver work you’re proud of
Your Responsibilities :
1) Building highly scalable and secured applications/microservices and responsive APIs
2) Assessing the security risks associated with the platform architecture and suggesting/implementing suitable changes for the same.
3) Architect and implement back-end services to support our mobile and web clients.
4) Creating and implementing database schemas that represent and support business processes.
5) Use best software development practices and processes including unit testing, code reviews, and site monitoring post deployment.
6) Continue to research and evaluate new technologies that may improve performance and elegance of our software implementation.
7) Explore and Integrate third-party APIs when required for the project.
8) Work closely with the rest of the team to bring our features into production.
Your skills :
- Hands-on experience in Django Framework.
- Strong Knowledge of Python.
- Strong Knowledge of MVC design pattern and object oriented programming concepts.
- Strong knowledge of RDBMS like Postgresql and Database schema design.
- Experience in developing robust and secure RESTful web API and microservices using Django/Python.
- Experience in Test Driven Development.
- Experience in handling No-SQL MongoDB or similar.
- Hands-on experience in GitHub.
- Experience in CI, CD tools like jenkins.
- Experience in managing cloud-based web applications on Amazon Web Services or Google Cloud.
- You love code and up for the challenge!
Roles and Responsibilities
- Develop data analysis and processing engines using Python
- Develop server-side applications
- Develop and deploy applications on AWS
- Individually manage multiple projects with end-to-end oversight
- Undertake POCs on new tech stacks and integrate them in applications on a functional level
- Design small and large applications on an enterprise level
- Understand business requirements and translate them into applications
- Plan projects with complete details such as efforts, timelines, and wireframes
- Work under tight timelines
- Assist in project management of micro-innovation projects
- Create tools, templates, SOPs / training manuals, process documents etc
- Work with cross-functional / domain teams
- Work in a fast-paced and agile development environment
Desired Candidate Profile
- 3+ years of relevant experience with Object Oriented Programming.
- Expertise in Web frameworks: Django, Flask.
- Should have working knowledge in Programming: Python Advanced.
- Hands on knowledge on Source Control: GIT.
- And RESTFul Services.
- Strong knowledge of MVC / MVT framework, Apache Web Server/IIS/nginx, Docker, etc
- Proficiency in writing Web APIs / Rest APIs
- Ability to develop client server architecture applications
- Excellent understanding of relational databases such MySQL, MS SQL, and NoSQL(Mongodb)
- Strong understanding of how to connect a database with a chosen back-end language, with adequate grip over architecture
- Understanding of security-related concepts / within a server-side application
- Adequate knowledge on SDLC