
Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
· You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
· You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
· You will collaborate with Data Scientists in order to design scalable implementations of their models
· You will pair to write clean and iterative code based on TDD
· Leverage various continuous delivery practices to deploy, support and operate data pipelines
· Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
· Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
· Create data models and speak to the tradeoffs of different modeling approaches
· On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
· Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
· Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
· You are equally happy coding and leading a team to implement a solution
· You have a track record of innovation and expertise in Data Engineering
· You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
· You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
· You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
· Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
· You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
· You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
· Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
· Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
· You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
· An interest in coaching others, sharing your experience and knowledge with teammates
· You enjoy influencing others and always advocate for technical excellence while being open to change when needed

About Thoughtworks
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Company video


Connect with the team
Similar jobs
Job Details
Description
We are looking for a passionate Senior User Experience Designer to join our fast growing team at LogiNext. You’ll collaborate with Product Managers and other UI designers to design new features, translate concepts into living and breathing prototypes, and rapidly iterate on interactions, animations, and details to deliver the best user experience. You will be responsible for conceptualizing & creating highly interactive user interfaces across all supported platforms.
You are passionate about design and are driven to create solutions for our clients that combine business objectives, design principles, and continuous user research into a compelling user experience. You have experience in designing a consistent and adaptable platform-based approach to user experience within a technology-driven and Software-as-a-Service (SaaS) based environment. You are a compulsive problem-solver with excellent visualization and communication skills.
Responsibilities:
- Gather, analyse & process data to determine the user needs & enhance the user experience
- Research & learn new, or re- emerging front- end technologies that facilitate improved user experience.
- Conceptualise designs through storyboards & concept presentations
- Design beautiful digital interfaces and present ideas in a compelling manner
- Perform usability testing with prototypes
- Create wireframes & prototypes to create a perfect user interface
- Create the best visual communication design with graphic design, website design, drawing and illustration, animation, client discussion and standard layouts.
- Mentor other team members in conceptualising and visually articulating design solutions
Requirements:
- Bachelor’s degree or higher in Arts/Commerce/Science/Technology
- 8 to 10 years of experience in UI/UX designing
- Must have experience in designing user interfaces for B2B SaaS Products
- Must have excellent experience using tools such as Sketch, Photoshop, Adobe Illustrator
- Able to work and thrive in a fast-paced, rapidly changing work environment
- Should have excellent communication skills, with an ability to convey ideas clearly & precisely
- Must have leadership skills & a good team player
- Must be pro-active & a self-starter
We are looking for a Senior React Native developer with 5 - 6 years of experience, in building performant mobile applications on Android & iOS platforms. You will be responsible to Architect, build React Native applications.
We are a fast growing product based startup operating out of Chennai.
Responsibilities
- Build pixel-perfect, buttery smooth UIs across Android and iOS.
- Technical design of complex mobile applications
- Leverage native APIs for deep integrations with both platforms.
- Translating designs and wire-frames into high quality code
- Diagnose and fix bugs and performance bottlenecks for performance that feels native.
- Maintain code and write automated tests to ensure the product is of the highest quality.
Requirements
- 5-6 years of demonstrable experience in designing and developing mobile apps using react-native.
- Ability to write well-documented, clean JavaScript code
- Rock solid at working with third-party dependencies and debugging dependency conflicts.
- Familiarity with native build tools, like XCode, Gradle, Android Studio and Visual Studio Code.
- Understanding of REST APIs, the document request model, and offline storage.
Below are a few perks of joining our team:
- Competitive salary
- Fully remote job
- Creative Problem Solving and Entrepreneurial Thinking
- Fast-Paced Environment
- Consistent Engagement from Senior Leadership
Position: Sr. Developer / Lead Developer
Experience: 4 - 9 Years
Work Location: Remote - Work from anywhere / Technopark, Trivandrum
Qualification: B Tech / BE / BCA / MCA / BSC Computers
Skills: Odoo ERP , Python, Postgresql, MYSQL
Required Technical Competency & Qualifications
v In Depth understanding of Odoo ERP and all the default Odoo modules.
v Good Knowledge in ORM methods, Python and JavaScript.
v Strong Knowledge on API integration.
v Capable of working on Odoo framework on existing app and custom module.
v Enhance applications, develop and configure features and functionalities that support business requirements
v Good Knowledge in code repositories- Github.
v Should have good technical support skills.
v Good Analytical, Communication and interpersonal skills.
v Ability to work with a close bound team structure.
v Ability to work under minimal supervision.
v Should be able to work in client facing roles.
Roles & Responsibility:
- Develop a growth strategy focused both on financial gain & customer satisfaction.
- Contacting potential clients to establish rapport & arrange meeting.
- Researching Organizations & individuals to find new opportunities.
- Growing business through the development of new leads and new contracts.
Requirements:
- Candidates with Bachelor’s degree in any stream.
- Experience required at least 2-5 years in sales, marketing & related field
- Representative skill with communication
- Excellent Organizational skill
Work Location: Hyderabad
Experience:4 to 8 Years
Package:Upto 12 LPA
Product Based Company
Notice Period:Immediate Joiners.
Its a Full Time Opportunity with Our Client
Mandatory Skills: WebAPI, Angular 4+ , MVC and SQL
Job Description:
--Expertise in Web API is most preferable.
--Good experience needed in Angular 4+ implementation.
--Must have very good exposure and experience working with C#,ASP.Net, MVC, Entity Framework, Web Service, Java Script, jQuery and SQL Server.
--Strong Knowledge of software implementation best practices.
--Strong experience in debugging and working with n-tier architecture (UI, Business layer and Data Access layer) along some experience with service oriented architectures(SOA)
--Ability to design and optimize SQL server stored procedures.
--Solid understanding of object oriented programming (OOP).
--Experience using version control (Git/Subversion)
--Experience using Jira and Confluence
--Develop and enhance new and existing software applications
--Mentor and train other team members
--Gain knowledge of the Energy Industry
--Provide documentation and training on the solution
Building highly-scalable and secure payments platform
Primary owners of one or more components of the platform and will drive innovation in
your area of ownership
Working with various product teams gathering requirements and adding capabilities
Working with some of the smartest people in the industry and will have ample opportunity to learn and grow
Using cutting-edge cryptography to secure payments beyond industry standards
Deriving actionable insights by mining TBs of data
Building a low-level infrastructure that aims to push the boundaries of network
performance
Participating actively in recruitment and nurturing of engineers as awesome as you
What do we look for?
Review and influence new evolving design, architecture, standards and methods with
stability, maintainability, and scale in mind
Identify patterns and provide solutions to class of problems
Research, evaluate and socialize new tools, technologies, and techniques to improve the value of the system
Be able to multitask, prioritize and handle dependencies with minimal oversight
From a technology perspective, you should have the knowledge and/or experience in a
reasonably sized subset of the following ( the more, the merrier!! )
Worked on one or more large scale java applications
Good understanding of nuances of distributed systems, scalability, and availability
Good knowledge of one or more relational and NoSQL databases and transactions
Shrewd focus on latency and throughput of services
In-depth understanding of concurrency, synchronization, NIO, memory allocation and GC
Experience with IaaS clouds like AWS/Google Cloud, Azure, OpenStack etc..
Experience in working with Message Brokers and Application Containers
Great ability to mentor and train other team members
We’re seeking engineers who are ready to work with new technologies and architectures in a forward-thinking organization that’s always pushing boundaries.
Here, you will take complete, end-to-end ownership of projects across the entire stack. Our ideal candidate should have a firm understanding of web frameworks, APIs, databases, and multiple back end languages. You’ll be joining a small team working at the forefront of new technology, solving the challenges that impact both the front end and back end architecture, and ultimately, delivering amazing global user experiences.
Objectives for this Role
● Work across the full stack, building highly scalable distributed solutions that enable positive user experiences and measurable business growth
● Develop new features and infrastructure development in support of rapidly emerging business and project requirements
● Assume leadership of new projects from conceptualization to deployment
● Ensure application performance, uptime, and scale, maintaining high standards of code quality and thoughtful application design
● Work with agile development methodologies, adhering to best practices and pursuing continued learning opportunities Daily and Monthly Responsibilities
● Participate in all aspects of agile software development including design, implementation, and deployment
● Architect and provide guidance on building end-to-end systems optimized for speed and scale
● Work primarily in Golang, Java, JavaScript and React
● Engage with inspiring designers and front end engineers, and collaborate with leading back end engineers as we create reliable APIs
● Collaborate across time zones via Slack, GitHub comments, documents, and frequent video conferences
Required Skills and Qualifications
● Bachelor’s degree in computer science, information technology, or engineering
● 1+ years of experience building large-scale software applications
● Understanding of building web applications
● Understanding of designing and integrating RESTful APIs
● Knowledge of Golang/Java, React, and JavaScript
● Excellent debugging and optimization skills
● Interest in learning new tools, languages, workflows, and philosophies to grow
We are looking for a Backend Developer who has 4-6 years of experience in designing, developing, and implementing backend services using Python and Django.
- Responsibilities-
- Design highly scalable, testable code and follow Test Driven Development methodology
- Able to write well-organized, modularised code with test cases.
- Contribute to the design and architecture of our backend APIs and deployment of microservices
- Ensure adherence to engineering best practices and maintain the overall quality of our codebase.
- Work with the product team to translate powerful ideas into everyday business value.
- Skills-
- Back-end programming language: Python
- Familiarity with Django or Flask framework
- Familiarity with AWS and Elastic Search
- Experience in SQL and NoSQL databases with an insight into various data modeling use cases
- Experience with system & unit testing
- Familiarity with containerized deployment
- Proficiency with Git
- Sound with data structures and algorithms and have a good understanding of design patterns, software architectures
JD : ML/NLP Tech Lead
- We are looking to hire an ML/NLP Tech lead who can own products for a technology perspective and manage a team of up to 10 members. You will play a pivotal role in re-engineering our products, transformation, and scaling of AssessEd
WHAT ARE WE BUILDING :
- A revolutionary way of providing continuous assessments of a child's skill and learning, pointing the way to the child's potential in the future. This as opposed to the traditional one-time, dipstick methodology of a test that hurriedly bundles the child into a slot, that in-turn - declares- the child to be fit for a career in a specific area or a particular set of courses that would perhaps get him somewhere. At the core of our system is a lot of data - both structured and unstructured.
- We have books and questions and web resources and student reports that drive all our machine learning algorithms. Our goal is to not only figure out how a child is coping but to also figure out how to help him by presenting relevant information and questions to him in topics that he is struggling to learn.
Required Skill sets :
- Wisdom to know when to hustle and when to be calm and dig deep. Strong can do mentality, who is joining us to build on a vision, not to do a job.
- A deep hunger to learn, understand, and apply your knowledge to create technology.
- Ability and Experience tackling hard Natural Language Processing problems, to separate wheat from the chaff, knowledge of mathematical tools to succinctly describe the ideas to implement them in code.
- Very Good understanding of Natural Language Processing and Machine Learning with projects to back the same.
- Strong fundamentals in Linear Algebra, Probability and Random Variables, and Algorithms.
- Strong Systems experience in Distributed Systems Pipeline: Hadoop, Spark, etc.
- Good knowledge of at least one prototyping/scripting language: Python, MATLAB/Octave or R.
- Good understanding of Algorithms and Data Structures.
- Strong programming experience in C++/Java/Lisp/Haskell.
- Good written and verbal communication.
Desired Skill sets :
- Passion for well-engineered product and you are - ticked off- when something engineered is off and you want to get your hands dirty and fix it.
- 3+ yrs of research experience in Machine Learning, Deep Learning and NLP
- Top tier peer-reviewed research publication in areas like Algorithms, Computer Vision/Image Processing, Machine Learning or Optimization (CVPR, ICCV, ICML, NIPS, EMNLP, ACL, SODA, FOCS etc)
- Open Source Contribution (include the link to your projects, GitHub etc.)
- Knowledge of functional programming.
- International level participation in ACM ICPC, IOI, TopCoder, etc
- International level participation in Physics or Math Olympiad
- Intellectual curiosity about advanced math topics like Theoretical Computer Science, Abstract Algebra, Topology, Differential Geometry, Category Theory, etc.
What can you expect :
- Opportunity to work on the interesting and hard research problem, to see the real application of state-of-the-art research into practice.
- Opportunity to work on important problems with big social impact: Massive, and direct impact of the work you do on the lives of students.
- An intellectually invigorating, phenomenal work environment, with massive ownership and growth opportunities.
- Learn effective engineering habits required to build/deploy large production-ready ML applications.
- Ability to do quick iterations and deployments.
- We would be excited to see you publish papers (though certain restrictions do apply).
Website : http://Digitalaristotle.ai
Work Location: - Bangalore









