
Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
· You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
· You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
· You will collaborate with Data Scientists in order to design scalable implementations of their models
· You will pair to write clean and iterative code based on TDD
· Leverage various continuous delivery practices to deploy, support and operate data pipelines
· Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
· Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
· Create data models and speak to the tradeoffs of different modeling approaches
· On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
· Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
· Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
· You are equally happy coding and leading a team to implement a solution
· You have a track record of innovation and expertise in Data Engineering
· You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
· You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
· You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
· Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
· You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
· You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
· Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
· Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
· You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
· An interest in coaching others, sharing your experience and knowledge with teammates
· You enjoy influencing others and always advocate for technical excellence while being open to change when needed

About Thoughtworks
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Company video


Connect with the team
Similar jobs
Company: IDFC
About the company: IDFC Limited was set up in 1997 to finance infrastructure projects in India. With time, the company diversified into asset management, institutional broking and investment banking. In 2014, the Reserve Bank of India granted in-principal approval to IDFC Limited to set up a new bank in the private sector
Job Description - The role entails the responsibility of providing production support to bank's software applications. It includes administering and resolving day to day production applications issues, providing updates and perform root cause analysis
Position: Production Support
Location: Mumbai
Minimum Qualification: Bachelor of Technology (B.Tech) / Bachelor of Science (B.Sc) / Master of Science (M.Sc) /Master of Technology (M.Tech) / Bachelor of Computer Applications (BCA) / Master of Computer Applications (MCA)
Experience: 2 to 5 years of experience in production support and 1 year of relevant experience in CMS/BXP application
CTC: 12 LPA
Employment Type: Full Time
Key Responsibilities:
- Hands on Experience Banking Production Support. Good to have knowledge of Intellect Payment, Collection, BXP, Integrator, Liquidity etc.
- System understanding and hands on experience on Application Support
- Perform all tests on production applications
- Design production support procedures, policies and documentation.
- Prepare recovery procedures for all applications and provide upgrade to same.
- Identify and resolve technical issues.
- Establish the root causes of production errors and escalate serious concerns
- Coordinate with IT groups and external vendors and ensure effective production application services to ensure reliability
- Manage code migration across environments to ensure continued and synchronized functionality
- Gather information independently, carry out necessary research and provide an in-depth analysis to resolve production issues
- Supervise all alerts related to production application and system procedures and provide services proactively
- Prepare and coordinate communications to senior management.
- Deliver regular and customized training to teams within the business.
- Develop test scripts for new/changed production application capabilities.
- Capture and share best- practice knowledge amongst the team
- Stay abreast with global market trends and competitor strategies in key markets
- Leverage in-house synergies through collaboration with internal stakeholders
- Checking the BMC tool to check the tickets and update the status of the tickets accordingly
- Maintaining the SLA, do the critical analysis of application.
Skills and qualification:
- Technical Skill Set: Java, Spring boot, API/Microservice
- Basic Understanding of React, Angular, any UI framework , SQL
- knowledge of database , Log tracing application like Grafana, Jaeger, Kibana, etc ,
- Deployment pipeline like Jenkins, GoCD, GitLab, etc ,
- Good to have Docker, Kubernetes, Git
- Fair Knowledge on Oracle Database, SQL, PL/SQL, Java, Web Server, App Server, Linux, Windows Server
• 4+ years of experience in Native iOS development.
• Strong in data structure and algorithms.
• Strong knowledge of iOS UI design guidelines, design patterns, and best practices.
• Strong knowledge of iOS Framework, different versions of iOS, and how to deal with
different screen sizes.
• Proficient in Swift programming, Cocoa, Xcode, and iOS Apps architecture and
implementation
• Experience with Analytics, offline syncing, deep-linking, Notifications, Autolayout,
Multithreading, etc
• Familiarity with Agile development, Scrums, Continuous integration (CI-CD), and TDD
processes.
• Knowledge of iOS debugging, unit-testing, memory, and performance optimization tools
as well as experience with automated and manual testing platforms
• Experience in shipping applications through App store
• Proficient understanding of code versioning tools, such as Git
We’re hiring a Full Stack Developer with strong hands-on experience in Java, Spring Boot, and Angular to join our growing tech team.
🔧 What You'll Do
- Design and develop scalable full stack web applications
- Write clean, maintainable code using Java (Spring Boot) and Angular
- Collaborate with cross-functional teams to deliver high-quality features
- Optimize applications for performance and security
- Participate in code reviews and technical discussions
✅ What We’re Looking For
- 5+ years of professional experience in full stack development
- Strong expertise in Java, Spring Boot, and Angular
- Solid understanding of REST APIs, Microservices, and frontend integration
- Knowledge of databases and version control (Git)
- Excellent problem-solving and communication skills
- Immediate joiners are highly preferred
We Are Hiring For Tally Customer Support
Job Role: Customer Support, Filed Sales.
Candidates Must Have Good Communication Skills.
Candidates Must Have Knowledge in Tally.
Candidates Must Have Two Wheeler.
Experience : 0 to 1 Year.
Qualification: B.com, M.com or any Degree
Job Location: Hyderabad, Secunderabad, Anantapur, Bhimavaram, Kadapa, Chirala, Vijayawada, kurnool
As a Full-stack Developer, you will be involved in designing and implementing web/cloud applications. You will be responsible for designing, programming and technically guiding the team. You will be working with a broad spectrum of technologies in a fast-moving environment.
You must possess:
- 2 to 5 years of professional experience in web application development
- good logical and problem-solving skills.
- working experience in building enterprise-scale, multi-tier, distributed applications.
- hands-on experience in Agile software development methodology including implementing CICD processes.
- good communication skills.
You should be able to:
- work in teams and coordinate activities effectively with members
- experiment with new technologies
- learn new skills on the fly
- work with a dynamic fast-paced team
- make technological recommendations based on thorough research
- write and debug asynchronous and multi-threaded code
You will:
- Analyze requirements and translate them into tasks for subordinates.
- Independently think of solutions to complex requirements.
- Diagnose and troubleshoot issues related to application stability, scalability, and availability.
- Understand source code and improve the code-review process.
- Grow and train a competent development team.
- Introduce new technologies, processes, and tools to the organization.
- Proactively identify defects and weaknesses within the application and suggest remediation.
General technical requirements:
- Good exposure to server-side frameworks and libraries used by C#, Java, Node, Python, PHP, and Ruby. Preference will be given to candidates with working experience with .NET Core MVC/Web-API.
- Good exposure to client-side frameworks such as Angular, React, Vue, and Backbone
- Experience in writing optimized queries for databases like SQL Server, MySQL/MariaDB, Postgres, and others
- Experience in working with NoSQL databases such as MongoDB, CouchDB, Cassandra, and others.
- Experience in working with one or more build tools like Ant, Maven, MSBuild, Make/CMake, Gulp, and other such tools
- Experience with implementing CI/CD using tools such as Ansible, Jenkins, TeamCity, and other such tools
- Working knowledge of Docker and good containerization concepts
- Have hands-on experience in using the *NIX shell to create/execute scripts and perform basic configuration and system troubleshooting.
We are Hiring an Android developer to engineer the application which will run over Android.
Job Responsibilities:
* Building and Designing advanced Android applications for Android platform
* Experience with third-party libraries and APIs
* To use and work with outside APIs and data sources
* To work and make sure improved application performance and bug fixing
* Continuous evaluation, discovery and implementation of new technologies to maximize the efficiency of development.
* Should have experience with Android SDK
* Familiarity with RESTful APIs to connect Android applications to back-end services.
* Solid understanding of the full mobile development life cycle
* Keep up to date on the latest industry trends in the mobile technologies
Job Types: Full-time, Regular / Permanent
Schedule: Day shift
Education: Bachelor's (Preferred)
Experience:
Android Development: Over 1 & 2 Year
total work: 1 year & above (Preferred)
Perks:
* 5 days Working & Alternate Saturday half day
* Salary no bar for right candidates
* Monthly Celebration
* Excellent Work Environment
* Supportive Staff
Work Remotely: No
location : Surat(Gujarat)
- Experience and expertise in Python Development and its different libraries like Pyspark, pandas, NumPy
- Expertise in ADF, Databricks.
- Creating and maintaining data interfaces across a number of different protocols (file, API.).
- Creating and maintaining internal business process solutions to keep our corporate system data in sync and reduce manual processes where appropriate.
- Creating and maintaining monitoring and alerting workflows to improve system transparency.
- Facilitate the development of our Azure cloud infrastructure relative to Data and Application systems.
- Design and lead development of our data infrastructure including data warehouses, data marts, and operational data stores.
- Experience in using Azure services such as ADLS Gen 2, Azure Functions, Azure messaging services, Azure SQL Server, Azure KeyVault, Azure Cognitive services etc.
We are looking for an iOS developer who possesses a passion for pushing mobile technologies to the limits and will work with our team of talented engineers to design and build the next generation of our mobile applications.
Requirements
-BS/MS degree in Computer Science, Engineering or a related subject
-1 to 4 years of work experience
-Proven working experience in software development
-Working experience in iOS development
-Have published one or more iOS apps in the app store
-A deep familiarity with Objective-C and Cocoa Touch
-Experience working with iOS frameworks such as Core Data, Core Animation, Core Graphics and Core Text
-Experience with third-party libraries and APIs
-Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies
-Solid understanding of the full mobile development life cycle
Responsibilities
-Design and build advanced applications for the iOS platform
-Collaborate with cross-functional teams to define, design, and ship new features.
-Unit-test code for robustness, including edge cases, usability, and general reliability.
-Work on bug fixing and improving application performance.
-Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Roles & Responsibilities:
- Work as a Web Developer to create front end & backend of websites
- Play a key role in the design lifecycle, from brief through to design and release/implementation
- Should have good knowledge of HTML, CSS, REACT JS, NODE JS, POSTGRES, GIT, REST API.
- A good understanding of servers, hosting, domains, DNS
- Ensure all designs work across all browsers and on all devices
- Help to design elements of mobile apps
- Ensure all designs are produced to deliver a great user experience
Key Skills/Experience:
- A minimum of one year of experience in designing and developing websites and web apps
- Good working experience in React JS, Redux, JavaScript ES6, NodeJS, AJAX, HTML, CSS, etc
- Knowledge about REST API
- Who has worked on libraries such as Bootstrap, Material is.
- Experience with Unit testing, Git, GitHub, and other DevOps and CI/CD tool
- A strong portfolio that demonstrates a range of work and techniques
- A passion for strong web design that delivers a great user experience
- A good understanding of the latest web design trends
- Study design briefs and determine requirements
- Schedule projects and define budget constraints
- Conceptualize visuals based on requirements
- Prepare rough drafts and present ideas
- Develop illustrations, logos and other designs using software or by hand
- Use the appropriate colors and layouts for each graphic
- Work with team and manager to produce final design
- Test graphics across various media
- Amend designs after feedback
- Ensure final graphics and layouts are visually appealing and on-brand
- Requirements
- Proven graphic designing experience
- A strong portfolio of illustrations or other graphics
- Familiarity with design software and technologies (such as InDesign, Illustrator, Dreamweaver, Photoshop)
- A keen eye for aesthetics and details
- Excellent communication skills
- Ability to work methodically and meet deadlines
- Degree in Design, Fine Arts or related field is a plus










