Data engineer

🚀 Hiring: Data Engineer | GCP + Spark + Python + .NET |

| 6–10 Yrs | Gurugram (Hybrid)

We’re looking for a skilled Data Engineer with strong hands-on experience in GCP, Spark-Scala, Python, and .NET.

📍 Location: Suncity, Sector 54, Gurugram (Hybrid – 3 days onsite)

💼 Experience: 6–10 Years

⏱️ Notice Period :- Immediate Joiner

Required Skills:

• 5+ years of experience in distributed computing (Spark) and software development.
• 3+ years of experience in Spark-Scala
• 5+ years of experience in Data Engineering.
• 5+ years of experience in Python.
• Fluency in working with databases (preferably Postgres).
• Have a sound understanding of object-oriented programming and development principles.
• Experience working in an Agile Scrum or Kanban development environment.
• Experience working with version control software (preferably Git).
• Experience with CI/CD pipelines.
• Experience with automated testing, including integration/delta, Load, and Performance

Job description

We are looking for an experienced Python developer to join our engineering team and help us create dynamic software applications for our clients. In this role, you will be responsible for writing and testing scalable code, developing back-end components, and integrating user-facing elements in collaboration with front-end developers.

Responsibilities:

• Coordinating with development teams to determine application requirements.

• Writing scalable code using Python programming language.

• Testing and debugging applications.

• Developing back-end components.

• Integrating user-facing elements using server-side logic.

• Assessing and prioritizing client feature requests.

• Integrating data storage solutions.

• Coordinating with front-end developers.

• Reprogramming existing databases to improve functionality.

• Developing digital tools to monitor online traffic.

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, or related field.

• 2-7 years of experience as a Python Developer.

• Expert knowledge of Python and Flask framework and Fast API.

• Solid experience in MongoDB, Elastic Search.

• Work experience in Restful API

• A deep understanding and multi-process architecture and the threading limitations of Python.

• Ability to integrate multiple data sources into a single system.

• Familiarity with testing tools.

• Ability to collaborate on projects and work independently when required.

• Excellent troubleshooting skills.

• Good project management skills.

SKILLS:

• PHYTHON
• MONGODB
• FLASK
• REST API DEVELOPMENT
• TWILIO

Job Type: Full-time

Pay: ₹10,000.00 - ₹30,000.00 per month

Benefits:

• Flexible schedule
• Paid time off

Schedule:

• Day shift

Supplemental Pay:

• Overtime pay

Ability to commute/relocate:

• Chennai, Tamil Nadu: Reliably commute or planning to relocate before starting work (Required)

Experience:

• Python: 1 year (Required)

Work Location: In person

Our client has a B2C startup in the Fintech space building the payment system for the

subscription economy. We have raised pre-seed funding from some of the leading

investors in the country. A small brief about their product - To build the payment

system for the subscription economy and make it easier to discover and manage

subscription payments in India and abroad. To give subscription merchants the

power to increase their offering by providing user subscription data, multiple login

authentication, distribution and one click subscription checkouts. To enable users to

participate in the subscription economy & increase adoption of new subscriptions.

The core team come from strong backgrounds having been alumni of IIT Madras,

IIM Calcutta as well as having worked with some of the top startups in the

ecosystem including Swiggy, Mckinsey, Barclays, etc..

What we're looking for

We are looking for an experienced Python developer to join our engineering team

and help us develop our mobile application. In this role, you will be responsible for

writing and testing scalable code, developing back-end components, and integrating

user-facing elements in collaboration with front-end developers.

To be successful as a Python developer, you should possess in-depth knowledge of

object-relational mapping, experience with server-side logic, and above-average

knowledge of Python programming.

As one of the earliest members in engineering, you will have the flexibility to design

the application and systems from ground up. As any early-stage start-up, we expect

you to be comfortable wearing various hats, and be proactive contributor in building

something truly remarkable.

Responsibilities

Coordinating with development teams to determine application requirements.Python Backend Developer

2

Writing scalable code using Python programming language.

Developing back-end components.

Implement business logic in the backend

Integrating user-facing elements using server-side logic.

Create restful APIs for a seamless integration with our mobile front end

Testing and debugging applications.

Assessing and prioritizing client feature requests.

Integrating data storage solutions.

Coordinating with front-end developers.

Reprogramming existing databases to improve functionality.

Developing digital tools to monitor online traffic.

Qualifications

4+ years of experience in Python, Django, Mongo, Express, MySQL, etc

Have built applications capable of serving high volume with low latency in

production

Following practices of agile development with continuous integration/deployment

A deep understanding and multi-process architecture and the threading

limitations of Python.

Experience in deploying applications in AWS cloud

Ability to collaborate on projects and work independently when required.

Knowledge in building applications for Fintech/payments domain is a bonus

Bachelor's or Master's degree in CS or equivalent from a reputed institution

Looking to hire a single backend engineer who will become a part of the core team, with the track to become a part of the leadership at our company.

Candidate should have worked in startups, possess strong programming skills in Python, displays a sense of ownership and is highly energetic and eager to learn state-of-the-art tech and ML.

A minimum of 2 years of relevant experience is preferred.

2022 or later year pass outs - please apply only if you have relevant full-time and at least 2 prior internships experience

Representative (not exhaustive) responsibilities:

• Assess the current design and infrastructure of the backend server, and continuously implement enhancements to make the systems more robust, reliable and responsive
• Design, implement, test, and deploy APIs with Python on Linux servers
• Enhance back-end functionality and integrate with the front end to deliver a fully functional product
• Implement and set up automated tests to periodically test backend infrastructure for reliability, security and performance
• Design new data pipelines to enable the production deployment of new models
• Mentor junior employees and interns in the company
• Additionally, interest and ability to contribute to the continuous enhancement of our state-of-the-art NLP model pipeline and Inferencing engine is a big plus
• Be ready to roll up your sleeves and participate in customer calls, understand our ICP well, do research around product features, etc.

Fast Track Your Application

Think about the ICP for ContractKen. Sign up for a trial plan, experience the product and provide feedback on how to improve the current experience of the product to add immediate value to the ICP. We don't need you to fully code any feature in its entirety and are not looking for free work. The idea is to identify folks who get** what we are trying to do with ContractKen and find faster alignment with the right candidate.

Do not apply if

You're looking for your first, real-world model building, ML/AI role. We believe that deploying existing models (open source and proprietary) in production and delivering real business value to our customers is 10x more important than hyperparameter tuning or the latest algorithm implementation. While we'd love to entertain experienced ML data scientists, the emphasis on MLOps is as much as it is on experimentation.

PYTHON, SQL, TensorFlow, NumPy, SciPy, Pandas

Enterprise Minds, with core focus on engineering products, automation and intelligence, partners customers on the trajectory towards increasing outcomes, relevance, and growth. 

Harnessing the power of Data and the forces that define AI, Machine Learning and Data Science, we believe in institutionalizing go-to-market models and not just explore possibilities. 

We believe in a customer-centric ethic without and people-centric paradigm within. With a strong sense of community, ownership, and collaboration our people work in a spirit of co-creation, co-innovation, and co-development to engineer next-generation software products with the help of accelerators. 

Through Communities we connect and attract talent that shares skills and expertise. Through Innovation Labs and global design studios we deliver creative solutions. 
We create vertical isolated pods which has narrow but deep focus. We also create horizontal pods to collaborate and deliver sustainable outcomes. 

We follow Agile methodologies to fail fast and deliver scalable and modular solutions. We are constantly self-asses and realign to work with each customer in the most impactful manner. 

Pre-requisites for the Role 

1. Job ID-EMPY0120MS 

1. Primary skill: Python Developer, Django, Problem solving. 

1. Secondary skill: Rest, API 

1. Years of Experience: 4-7 Years  

1. Location: Remote 

Budget- Open  

NP- Immediate 

PYTHON DEVELOPER 

• Design, build, and maintain efficient, reusable, and reliable Python code 
• Design and implement software platform with Microservices Architecture, based on AWS Lambda and Event sourced data 
• Integration of data storage solutions {may include databases, key-value stores, notification queues, etc.} 

• Integration with various backend monitoring tools 
• Identify bottlenecks and bugs, and devise solutions to these problems 
• Help maintain code quality, organization and automatization 
• Participate in early product demonstrations to customersExperience required: 
• Bachelor's or Masters in Computer Science or a related discipline 

• 2-6 years of relevant professional experience 
• Delivery of quality results within aggressive timelines 
• Knowledge of software development processesSkills Required: 
• Experience with Python, along with other common libraries/framework such as Flask, Celery, Django etc., 
• Good understanding with usage of Lambda in Python. 

• Good understanding in testing frameworks like PyTest. 
• Ability to work with IDEs like Visual Studio Code. 
• Basic understanding in developing private PIP packages. 
• Solid understanding of object-oriented programming. 
• Familiarity with concepts of MVC, Mocking, ORM, and RESTful. 

• A knack for writing clean, readable Python code. 
• Ability to integrate multiple data sources and databases into one system. 
• Ability to understand monitoring metrics, such as CPU, Memory, Disk Space, Network latency, and telemetry services. 
• Understanding of fundamental design principles behind a scalable application. 
• Understanding the fundamentals of RDBMS databases. 

• Ability to work with PostgreSQL is a plus. 
• Ability to work with AWS services like Lambda, Kinesis, SQS, SNS etc., is a plus. 
• Proficient understanding of Git. 
• Familiarity with continuous integration and continuous deployment. 
• Effective verbal and written communication skills. 

• Managing the interchange of data between the server and the users.
• Development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end Integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well.
• Writing reusable, testable, and efficient code.
• Design and implementation of low-latency, high-availability, and performant applications.
• Integration of user-facing elements developed by front-end developers with server-side logic
• Implementation of security and data protection.

• Should have worked on the Django REST framework.
• Familiarity with some Pandas, Numpy, text parsing/mining and ORM (Object Relational Mapper) libraries
• Able to integrate multiple data sources and databases into one system
• Understanding of the threading limitations of Python, and multi-process architecture
• Good understanding of server-side templating languages
• Worked on Amazon cloud solutions
• Understanding of accessibility and security compliance
• Knowledge of user authentication and authorization between multiple systems, servers, and environments
• Understanding of fundamental design principles behind a scalable application
• Familiarity with event-driven programming in Python
• Able to create database schemas that represent and support business processes
• Strong unit test and debugging skills
• Proficient understanding of code versioning tool
• Excellent written and verbal communication skills.
• Should know about HDL and LLD.
• Should know about making python packages
• Should have worked on microservice-based Architecture

As a software engineer, you will be the part of a team that focuses on building software applications that scale well. You will play a significant role in shaping our software architecture that provides measurable customer value. You understand both technology and business to know the right trade-offs to make. You will be a technical mentor for your team members. You will work closely with your peers, managers, product, design, and operations teams to create solutions that meet business requirements. You will drive engineering and operational excellence across Scatter. You will collaborate with other engineers to surface common pain points, develop solutions and evangelize best practices.

Qualifications:

2-3 years of professional software engineering experience building customer-facing web and/or mobile applications Strong coding skills using Python, Django, is mandatory. Knowledge on Html, Css, React Js, Jquery, Bootstrap or equivalent programming language is added advantage Graduated from Tier 1 or Tier 2 engineering colleges Excellent knowledge of Data Structures and Algorithms Bachelor or Master degree in Computer Science or a related discipline Experience working in an agile environment Self-quick learner and passionate problem solver Excellent debugging and troubleshooting skills, with an enthusiastic attitude to support and resolve customer problems Good oral and written communication skills Above all, an insatiable desire and ability to learn

Nice to have skills:

Experience with large-scale SaaS applications Experience building web and mobile applications Experience designing services on top of cloud infrastructure like AWS, Azure, etc Prior experience in building product from 0-1

Benefits

Ownership and autonomy to drive customer and culture initiatives Opportunity to get mentored and mentor junior engineers Remote work

We are actively seeking software development engineers who are interested in designing robust trading systems and refining programs to efficiently manage various types of financial market data that facilitate our quantitative investment research. By designing and improving the firm's internal applications, the SDE will play a key role in expanding the firm's trading capabilities.

Responsibilities:

• Management & scaling up existing infrastructure for high-frequency market data capture.
• Develop a scalable and consistent data handling infrastructure for the above data to facilitate efficient backtesting of quantitative investment strategies.
• Perform R& D; to build a software platform in Python for backtesting various kind of investment strategies using the above databases.
• This will involve studying the strategy development process and performance evaluation metrics.
• Develop autopilot risk-management systems to monitor live performance of the Portfolio.
• Improve the existing algorithms to achieve better execution price and reduce the latency.

Requirements:

Our ideal candidate would have graduated with a degree in computer science from a top university with 1-3 years industry experience, along with:

• High Level of proficiency in Python and good knowledge of Matlab/C++/C#.
• Past experience in dealing with large datasets and Knowledge of database administration and network programming will be a plus.
• Well-versed in software engineering principles, frameworks and technologies.
• The ability to manage multiple tasks in a fast-paced environment.
• Excellent analytical and problem solving abilities.
• A keen interest in learning about the financial markets.