Data Engineer

We are looking to expand our existing Python team across our offices in Surat.

The requirements are as follows:

1) Familiar with the the Django REST API Framework.

2) Experience with the FAST API framework will be a plus

3) Strong grasp of basic python programming concepts ( We do ask a lot of questions on this on our interviews :) )

4) Experience with databases like MongoDB , Postgres , Elasticsearch , REDIS will be a plus

5) Experience with any ML library will be a plus.

6) Familiarity with using git , writing unit test cases for all code written and CI/CD concepts will be a plus as well.

7) Familiar with basic code patterns like MVC.

8) Grasp on basic data structures.

We are seeking enthusiastic and motivated fresh graduates with a strong foundation in programming, primarily in Python, and basic knowledge of Java, C#, or JavaScript. This role offers hands-on experience in developing applications, writing clean code, and collaborating on real-world projects under expert guidance.

Key Responsibilities

• Develop and maintain applications using Python as the primary language.

• Assist in coding, debugging, and testing software modules in Java, C#, or JavaScript as needed.

• Collaborate with senior developers to learn best practices and contribute to project deliverables.

• Write clean, efficient, and well-documented code.

• Participate in code reviews and follow standard development processes.

• Continuously learn and adapt to new technologies and frameworks.

Core Expectations

• Eagerness to Learn: Open to acquiring new programming skills and frameworks.

• Adaptability: Ability to work across multiple languages and environments.

• Problem-Solving: Strong analytical skills to troubleshoot and debug issues.

• Team Collaboration: Work effectively with peers and seniors.

• Professionalism: Good communication skills and a positive attitude.

Qualifications

• Bachelor’s degree in Computer Science, IT, or related field.

• Strong understanding of Python (OOP, data structures, basic frameworks like Flask/Django).

• Basic knowledge of Java, C#, or JavaScript.

• Familiarity with version control systems (Git).

• Understanding of databases (SQL/NoSQL) is a plus.

NOTE: Laptop with high speed internet is mandatory

we are looking for a talented and passionate Python Engineer to join our team. As part of our Insights backend team, you will be building new and improving existing services powering the Insights platform. This is a fast-paced role with high growth, visibility, impact, and where many of the decisions for new projects will be driven by you and your team from inception through production. If you are seeking an environment where you get to do meaningful work with other great engineers, then we want to hear from you!

Skills & Requirements

• At least 1 years of experience with Python, Django.
• Well versed in building the backend logic of web applications.
• Strong database skills.
• Solid foundation in designing and developing scalable API’s.
• Understanding of general web architecture.
• A Bachelors, Masters, or PhD in Computer Science, Information Technology, Computer Engineering or some related discipline, or equivalent experience.
• Hands on experience with Django, Flask or other Python frameworks.
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3.
• Debugging applications to ensure low-latency and high-availability.
• Integrating user-facing elements with server-side logic.
• Implementing security and data protection.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills.
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Ability to coordinate with, stakeholders, manage timelines, escalation & provide on time status.
• Familiarity with some ORM (Object Relational Mapper) libraries.
• Web frameworks and RESTful APIs experience.

Salary: ₹600,000.00 - ₹700,000.00 per year

Job Type: Full-time

Benefits: Leave encashment ,Paid sick time

Schedule: Day shift

Supplemental pay types: Performance bonus

Ability to commute/relocate: Lucknow, Uttar Pradesh: Reliably commute or planning to relocate before starting work (Required)

Education: Bachelor's (Preferred)

Position of the role

The Principal Engineer reports to the Domain Lead and plays a key role in driving the technical vision, strategy, and execution of development initiatives. The Principal Engineer collaborates with multiple teams to ensure that software solutions are scalable, cost-optimized, performant, and aligned with business objectives.

Result expectation in terms of result areas and core activities

The Principal Engineer is responsible for defining, designing, and overseeing the implementation of complex software solutions. This role involves deep technical expertise, mentorship, and architectural guidance across multiple teams. The Principal Engineer also acts as a thought leader, influencing technology choices, best practices, and innovation within the organization.

Main objectives of the role

✔ Leading the design and architecture of the software by following best practices that ensure scalability, maintainability, cost optimization, and high performance.

✔ Driving innovation and continuous improvements in software development practices.

✔ Providing technical mentorship and coaching to engineers across teams.

✔ Ensuring the successful delivery of high-quality software aligned with business requirements.

✔ Defining and maintaining coding standards, best practices, and governance frameworks.

✔ Collaborating with product management and other stakeholders to shape the technical roadmap.

✔ Identifying technical debt and implementing strategies to mitigate it effectively.

✔ Promoting a culture of continuous learning, knowledge sharing, and cross-team collaboration.

✔ Leading DevOps, CI/CD, and automation to improve software delivery processes and efficiency.

Specialisation

✔ Deep understanding of software architecture, system design, and performance optimization.

✔ Translating complex business requirements into scalable and efficient software solutions.

✔ Handling large data transformations and ensuring system efficiency under the required load conditions.

✔ Leading initiatives for modernizing the technology stack and implementing best practices.

✔ Ensuring that security, scalability, and maintainability are embedded into development processes.

✔ Driving research and development efforts to explore emerging technologies and their business impact.

✔ Enabling teams to develop and maintain high-quality software through code reviews, architecture guidance, and technical strategy.

✔ Collaborating with product owners and stakeholders to ensure that development aligns with business goals and user needs.

Key processes in the role

✔ Agile / Scrum / Kanban development methodologies.

✔ CI/CD and DevOps practices to streamline delivery.

✔ Cloud-native architecture, monolith and microservices-based development.

✔ Scalable and high-performance computing strategies.

✔ Secure software development lifecycle (SDLC).

✔ Data-driven decision-making.

✔ Performance optimization.

Key relationships (teams and/or position titles)

✔ Engineering Teams (Developers, QA, DevOps).

✔ Head of Engineering and Technology Leadership.

✔ Product Management and Business Stakeholders.

✔ Customer Success and Solution Architects.

✔ External Technical Partners and Vendors.

Requirements

✔ Bachelor's or Master’s degree in Computer Science, Software Engineering, or a related field.

✔ 10+ years of experience in software development, with a proven track record .

✔ Strong experience in Python and modern software engineering practices.

✔ Expertise in cloud computing platforms (AWS, Azure, or GCP).

✔ Experience in architecting and developing scalable, high-performance applications.

✔ Hands-on experience with CI/CD pipelines, DevOps tools, and automation.

✔ Deep understanding of microservices, monolith, APIs, and distributed systems.

✔ Strong experience with database technologies, including SQL and NoSQL.

✔ Excellent communication and leadership skills, with the ability to influence technical decisions across teams.

✔ A passion for mentoring, coaching, and fostering a strong engineering culture.

✔ Experience in defining and implementing technical governance and best practices.

Competences

✔ Strategic Thinking - 4

✔ Analytical Problem Solving - 4

✔ Technical Leadership & Mentorship - 4

✔ Communication & Collaboration - 3

Measures of success

✔ Technical leadership impact - measurable improvements in code quality, architecture, and scalability.

✔ Delivery of high-quality software within agreed timelines and business requirements.

✔ Successful mentorship - improvement in team skill levels, problem-solving capabilities, and innovation.

✔ Reduction of technical debt through strategic refactoring and modernization.

✔ Engineering team satisfaction - based on feedback and collaboration effectiveness.

✔ Improvements in system performance, stability, cost-optimization, and security.

✔ Adoption of best practices and emerging technologies across teams.

✔ Contribution to company-wide strategic initiatives through technical innovation and leadership.

Software Architect

Bangalore, India / Engineering/ Full-time

Job Overview:

As a Software Architect, you will play a crucial role in designing, developing, and maintaining robust and scalable backend solutions for our software applications. You will be responsible for making strategic technical decisions, and collaborating with cross-functional teams to ensure the successful delivery of high-quality software products with scalable backend infrastructure. 

Responsibilities:

• System Architecture:
• Design and architect scalable, efficient, and maintainable backend systems.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
• Technical Leadership:
• Provide technical leadership and guidance to the development team, ensuring best practices and coding standards are followed.
• Mentor and coach team members, fostering a culture of continuous learning and improvement.
• Backend Development:
• Lead the development of backend components, modules, and features primarily on Ruby on Rails tech stack and also be open to contribute in other tech stacks based on Java/Kotlin and Python.
• Implement and maintain APIs, data models, and database structures to support application functionality.
• Performance Optimization:
• Identify and address performance bottlenecks, ensuring optimal system response times and resource utilization.
• Implement caching strategies and other performance optimization techniques.
• Collaboration:
• Collaborate with frontend developers, product managers, and other stakeholders to integrate frontend and backend components seamlessly.
• Participate in code reviews to ensure code quality, adherence to standards, and knowledge sharing within the team.
• Security and Compliance:
• Implement and enforce security best practices to safeguard sensitive data.
• Stay updated on industry trends and emerging technologies to ensure compliance and security standards are met.
• Documentation:
• Create and maintain comprehensive technical documentation for the backend architecture, APIs, and development processes.
• Continuous Improvement:
• Proactively identify opportunities for process improvement and contribute to the evolution of development methodologies and practices.

Qualifications:

• Overall 10+ years of experience, with 2+ years as a Software Architect with a focus on backend development using Ruby on Rails.
• In-depth knowledge of Ruby on Rails framework, database design, and API development.
• Strong understanding of software architecture principles, design patterns, and best practices.
• Experience with performance optimization, scalability, and security considerations.
• Excellent communication and collaboration skills.
• Leadership experience with a demonstrated ability to mentor and guide development teams.
• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience).

Bonus points:

• Familiarity with front-end technologies and frameworks(ReactJs).
• Experience with other programming languages.(Kotlin/Python)
• Experience with cloud platforms and microservices architecture.
• Knowledge of DevOps practices and tools.(AWS, Kubernetes, )

Join us in revolutionizing the way software solutions are developed, and contribute to building cutting-edge applications that make a positive impact on our users and the industry.

Roles and Responsibilities

• Ability to create solution prototype and conduct proof of concept of new tools.

• Work in research and understanding of new tools and areas.

• Clearly articulate pros and cons of various technologies/platforms and perform

detailed analysis of business problems and technical environments to derive a

solution.

• Optimisation of the application for maximum speed and scalability.

• Work on feature development and bug fixing.

Technical skills

• Must have knowledge of the networking in Linux, and basics of computer networks in

general.

• Must have intermediate/advanced knowledge of one programming language,

preferably Python.

• Must have experience of writing shell scripts and configuration files.

• Should be proficient in bash.

• Should have excellent Linux administration capabilities.

• Working experience of SCM. Git is preferred.

• Knowledge of build and CI-CD tools, like Jenkins, Bamboo etc is a plus.

• Understanding of Architecture of OpenStack/Kubernetes is a plus.

• Code contributed to OpenStack/Kubernetes community will be a plus.

• Data Center network troubleshooting will be a plus.

• Understanding of NFV and SDN domain will be a plus.

Soft skills

• Excellent verbal and written communications skills.

• Highly driven, positive attitude, team player, self-learning, self motivating and flexibility

• Strong customer focus - Decent Networking and relationship management

• Flair for creativity and innovation

• Strategic thinking This is an individual contributor role and will need client interaction on technical side.

Must have Skill - Linux, Networking, Python, Cloud

Additional Skills-OpenStack, Kubernetes, Shell, Java, Development

You need to write scalable Python code for developing and implementing robust applications. You would indulge your dedication and passion to build server-side logic ensuring low-latency and high end performance. You should have sound knowledge of Python frameworks such as Django and Flask.

YOUR ‘OKR’ SUMMARY

OKR means Objective and Key Results.

As a Software Engineer at Coredge, you will help develop our next-generation cloud native core solution along with the product and the open-source community to build the Coredge.io vision.

What you will do?

• System engineering and implementation in Python and Golang.

• Working on performance issues using creative experiments and internally developed product features.

• Research, propose, and integrate relevant open-source projects based on product objectives.

• Write organized, efficient, and well documented Python/Golang code as an example for junior engineers.

• Participation in all levels of product definition, design, implementation, testing, and deployment.

• Must include the ability to discuss abstract system architectures from ideas through implementation and

           creatively apply domain experience to solve technical challenges.

• Mentoring software engineers, fostering an environment of trust and accountability.

What you will need?

A strong sense of ownership, urgency, and drive. As an integral part of the development team, you will need the

following skills to succeed.

• Strong Python skills to develop framework(s).

• Hands-on to design & develop re-usable framework components.

• Hands-On experience on developing framework, designing re-usable framework components.

• Experience in engineering practices such as code refactoring, design patterns, design driven development, Continuous Integration, building highly scalable applications, application security and functional programming.

Additional Skills:

• Knowledge of Cloud native would be an advantage.

• Understanding of Kubernetes from Architecture side and also understand the Standard API.

• Code contributed to CNCF or similar community will be plus.

• Performance benchmarking of K8’s or any cloud will be added advantage

Python API DeveloperJD:  
Experience: 4-6 Yrs
Notice Period: 10-20 days or within 1 month

>> Develop and maintain various security software products with queues, caching & database management.
>> Hands-on experience in Coding in Python is required along with Knowledge about Data Structures and object-oriented programming, Algorithms.
>> Extensive experience in developing asynchronous systems.
>> Integration of user-facing elements developed by front-end developers with server-side logic
>> Implementation of security and data protection.
>> Performance tuning, improvement, balancing, usability, automation

Mandatory Skills:

• Python
• Flask/Django
• API

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team

We are actively seeking software development engineers who are interested in designing robust trading systems and refining programs to efficiently manage various types of financial market data that facilitate our quantitative investment research. By designing and improving the firm's internal applications, the SDE will play a key role in expanding the firm's trading capabilities.

Responsibilities:

• Management & scaling up existing infrastructure for high-frequency market data capture.
• Develop a scalable and consistent data handling infrastructure for the above data to facilitate efficient backtesting of quantitative investment strategies.
• Perform R& D; to build a software platform in Python for backtesting various kind of investment strategies using the above databases.
• This will involve studying the strategy development process and performance evaluation metrics.
• Develop autopilot risk-management systems to monitor live performance of the Portfolio.
• Improve the existing algorithms to achieve better execution price and reduce the latency.

Requirements:

Our ideal candidate would have graduated with a degree in computer science from a top university with 1-3 years industry experience, along with:

• High Level of proficiency in Python and good knowledge of Matlab/C++/C#.
• Past experience in dealing with large datasets and Knowledge of database administration and network programming will be a plus.
• Well-versed in software engineering principles, frameworks and technologies.
• The ability to manage multiple tasks in a fast-paced environment.
• Excellent analytical and problem solving abilities.
• A keen interest in learning about the financial markets.