


Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
· You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
· You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
· You will collaborate with Data Scientists in order to design scalable implementations of their models
· You will pair to write clean and iterative code based on TDD
· Leverage various continuous delivery practices to deploy, support and operate data pipelines
· Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
· Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
· Create data models and speak to the tradeoffs of different modeling approaches
· On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
· Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
· Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
· You are equally happy coding and leading a team to implement a solution
· You have a track record of innovation and expertise in Data Engineering
· You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
· You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
· You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
· Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
· You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
· You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
· Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
· Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
· You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
· An interest in coaching others, sharing your experience and knowledge with teammates
· You enjoy influencing others and always advocate for technical excellence while being open to change when needed

About Thoughtworks
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Company video


Connect with the team
Similar jobs
Job Title : Hardware Design Developer – Verilog
Employment Type : Full-Time Contract (8 hours/day)
Location : Remote
Experience : 3+ Years (Mandatory)
Notice Period : Immediate
Job Overview :
We are looking for an experienced Hardware Design Developer to leverage hardware design platforms for generating training data to enhance enterprise LLMs' capabilities. This role offers a unique opportunity to directly impact AI advancements by optimizing hardware designs for training and benchmarking large language models.
Key Responsibilities :
- Develop, configure, and customize hardware design platforms to generate training data for enterprise LLMs.
- Work closely with research teams to translate requirements into actionable insights.
- Ensure high-quality coding, debugging, and documentation to optimize hardware design solutions.
- Collaborate with cross-functional teams to improve LLM performance and automation capabilities.
Required Skills & Experience:
- BS/MS in Electrical Engineering or related field.
- 3 to 5 Years of hardware design development experience.
- Expertise in HDLs (Verilog, SystemVerilog, VHDL, SystemC).
- Strong background in scripting, front-end workflows, and verification processes.
- Familiarity with Synopsys, Cadence, or open-source toolchains.
- Excellent problem-solving and collaboration skills.
Preferred Qualifications :
- Expertise in UVM environments, Formal Verification, and Lint refinement.
- Experience with Computer Architecture, Assembly Debugging, and Assertion Coding (SVA).
- Familiarity with Machine Learning and AI systems.
Mandatory Technical Skills :
- Min 2 Years of relevant experience in Hardware Design and/or Verification.
- Experience with at least one of the following:
- ASIC, VLSI, FPGA, SoC development.
- SystemVerilog, Verilog, Testbench development, and Verification.
- Strong understanding of IP Development and Verification.
Note: This role focuses on LLM training using hardware design, not traditional project development.



Job Description
The Opportunity
The Springboard engineering team is looking for software engineers with strong backend & frontend technical expertise. In this role, you would be responsible for building exciting features aimed at improving our student experience and expanding our student base, using the latest technologies like GenAI, as relevant. You would also contribute to making our platform more robust, flexible and scalable. This is a great opportunity to create a meaningful impact as well as grow in your career.
We are looking for engineers with different levels of experience and expertise. Depending on your proficiency levels, you will join our team as a Software Engineer II, Senior Software Engineer or Lead Software Engineer.
Responsibilities
- Design and develop features for the Springboard platform, which enriches the learning experience of thousands through human guided learning at scale
- Own quality and reliability of the product by getting hands on with code and design reviews, debugging complex issues and so on
- Contribute to the platform architecture through redesign of complex features based on evolving business needs
- Influence and establish best engineering practices through solid design decisions, processes and tools
- Provide technical mentoring to team members
You
- You have experience with web application development, on both, backend and frontend.
- You have a solid understanding of software design principles and best practices.
- You have hands-on experience in,
- Coding and debugging complex systems, with frontend integration.
- Code review, responsible for production deployments.
- Building scalable and fault-tolerant applications.
- Re-architecting / re-designing complex systems / features (i.e. managing technical debt).
- Defining and following best practices for frontend and backend systems.
- You have excellent problem solving skills and are comfortable handling ambiguity.
- You are able to analyze various alternatives and reach optimal decisions.
- You are willing to challenge the status quo, express your opinion and drive change.
- You are able to plan reasonably complex pieces of work and can handle changing priorities, unknowns and challenges with support. You want to contribute to the platform roadmap, aligning with the organization priorities and goals.
- You enjoy mentoring others and helping them solve challenging problems.
- You have excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner. You are able to communicate with various stakeholders to understand their requirements.
- You are a proponent of quality - building best practices, introducing new processes and improvements to make the team more efficient.
Non-negotiables
Must have
- Expertise in Backend development (Python & Django experience preferred)
- Expertise in Frontend development (AngularJS / ReactJS / VueJS experience preferred)
- Experience working with SQL databases
- Experience building multiple significant features for web applications
Good to have
- Experience with Google Cloud Platform (or any cloud platform)
- Experience working with any Learning Management System (LMS), such as Canvas
- Experience working with GenAI ecosystem, including usage of AI tools such as code completion
- Experience with CI/CD pipelines and applications deployed on Kubernetes
- Experience with refactoring (redesigning complex systems / features, breaking monolith into services)
- Experience working with NoSQL databases
- Experience with Web performance optimization, SEO, Gatsby and FE Analytics
- Delivery skills, specifically planning open ended projects
- Mentoring skills
Expectations
- Able to work with open ended problems and come up with efficient solutions
- Able to communicate effectively with business stakeholders to clarify requirements for small to medium tasks and own end to end delivery
- Able to communicate estimations, plan deviations and blockers in an efficient and timely manner to all project stakeholders
- Experience: Minimum 3 years
- Key Skills:
- Experience with Check Point policy creation, updating, and management.
- Ability to analyze logs and troubleshoot issues.
- Expertise in health checks and system optimization.
- Responsibilities:
- Define and push Check Point firewall policies.
- Perform regular health checks and log reviews.
- Ensure compliance with security best practices.
- Location: Bangalore
- Shift: General
- Experience managing SEO and affiliate programs.
- Strong understanding of current online marketing concepts, strategies and best practices.
- Experience in SEO, Email marketing and social media. Knowledge of SEM Rush tool
- Experience in a similar digital marketing role.
- Highly creative with experience in identifying the target audience and devising digital campaigns that engage, inform and motivate.
- Strong communication skills.


- Experience in onsite functional or technical roles on at least four full-lifecycle CPQ projects, with strong implementation expertise in at least two of the following technologies: Conga CPQ and CLM, Salesforce CPQ & billing, Vlocity CPQ
- Two+ years consulting and/or Lead to- Cash (CPQ/ CLM) implementation experience. Experience managing at least two large-scale full-life cycle implementations of Lead to Cash (CPQ/ CLM) solutions, including ownership of the technical solution, management of the overall team and ownership and management of project financials.
- Deep Understanding of the Lead-To-Cash business process and supporting technologies
- Experience defining systems strategy, road-map, developing process flow diagrams, developing systems requirements, designing and prototyping, testing, training, defining support procedures, and implementing practical business solutions.
- Experience supporting pursuit teams.
- Desire to learn additional in-demand CPQ/CLM platforms
- Ability to travel up to 50% on average, based on the work you do and the clients and industries/sectors you serve
- Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
Preferred Qualifications:
- A Bachelor’s degree
- Salesforce or Conga CPQ certified
- Ability to work independently and manage multiple task assignments
- Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint)
- Strong problem solving and troubleshooting skills with the ability to exercise mature judgment
- An advanced degree in the area of specialization
- Experience implementing other CRM platforms (SAP CRM, Oracle, Salesforce.com, Microsoft Dynamics, etc.) or CPQ/CLM technologies (Oracle, Salesforce, Conga, , etc.)
- Proficient in all phases of the Application Development Lifecycle
- Strong technical project management and/or leadership skills


Requirements:
- Design and develop scalable IONIC applications using open source technologies.
- Develop a hybrid application with IONIC, cordova.
- Experience in HTML5 CSS, JQuery and Javascript.
- Experience in hosting application on Appstore.
- Work as part of an agile team on leading edge technologies.
- PHP & Apache stack with JavaScript, JQuery.
- Responsive Web design with HTML5 CSS3 Bootstrap.
- Social media APIs and third party widgets integration.
- Web services Integration - JavaScript and XML (Ajax), Representational state transfer (REST), Javascript Object Notation (JSON).
- End to End Role - Analyze Design, Develop, Deploy, Monitor, Enhance
- Experience on database systems.
Job Location: Navi Mumbai.

Key aspects of this role:
• Meeting with the development team to discuss user interface ideas and applications.
• Reviewing application requirements and interface designs.
• Identifying web-based user interactions.
• Developing and implementing highly-responsive user interface components using React
concepts.
• Writing application interface codes using JavaScript following React.js workflows.
• Troubleshooting interface software and debugging application codes.
• Developing and implementing front-end architecture to support user interface concepts.
• Monitoring and improving front-end performance.
• Documenting application changes and developing updates.
To be the right fit, you'll need:
• Minimum 4+ years relevant experience in application development and React JS.
• Knowledge of React hooks such that use Context, use Reducer, use Effect.
• Knowledge of React props and state management (both functional and class component)
• Strong understanding of Error boundary concept of react.
• Work experience with any react based UI library or Redux is preferable
• Experience in building cross-browser layouts with CSS and HTML


- Experience as a full stack developer or similar role.
- Knowledge of multiple back-end languages is good to have (e.g. Java, Scala, Python, C#, J2EE, Web Services) and JavaScript frameworks (e.g. Angular, React, Node.js)
- Experience developing desktop and mobile applications and familiarity with common stacks.
- Experience with large-scale distributed storage and database systems (SQL or NoSQL, e.g. MongoDB/Cassandra/MySQL).
- Superb communication and collaboration skills.
- Ability to translate business use cases into good taxonomy design.
- Demonstrable skills in understanding importance of data design.

